2024-01-30T07:52:48.347 INFO:root:teuthology version: 0.0.1.dev253+g6128cc3 2024-01-30T07:52:48.347 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527 --name vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --verbose -- /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/orig.config.yaml 2024-01-30T07:52:48.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T07:52:48.480 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527 branch: wip-vshankar-testing-20240125.044502 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7537527' kernel: client: branch: testing flavor: default kdb: true sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20240125.044502 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 661946e7044723130c03627323f6a879a9848cb5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 661946e7044723130c03627323f6a879a9848cb5 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240125.044502 sha1: 661946e7044723130c03627323f6a879a9848cb5 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9619 sha1: 661946e7044723130c03627323f6a879a9848cb5 sleep_before_teardown: 0 subset: 293/1024 suite: fs suite_branch: wip-vshankar-testing-20240125.044502 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 661946e7044723130c03627323f6a879a9848cb5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhcXTz47Q+zkZzTIXI2j0hmxu83s4Q995ZrafznMRDBN9wT/6b91rIdjaURyGLi/T//ffQ16Huu2EBCf5xKBRY= smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBISYSxzPJZxz2tLlA24jtu5bAFrYxWA3NZeD2gUlridovHbk4HybnS7vBAPs6U45ldUaxhJDNwBpxu2lt13Gv/g= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6128cc3ecb49b7d62475e3595041c19b5326ca7c timestamp: 2024-01-30_07:34:06 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-30T07:52:48.480 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa; will attempt to use it 2024-01-30T07:52:48.481 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks 2024-01-30T07:52:48.481 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-30T07:52:48.482 INFO:teuthology.task.internal:Checking packages... 2024-01-30T07:52:48.505 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '661946e7044723130c03627323f6a879a9848cb5' 2024-01-30T07:52:48.505 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-30T07:52:48.505 INFO:teuthology.packaging:ref: None 2024-01-30T07:52:48.505 INFO:teuthology.packaging:tag: None 2024-01-30T07:52:48.506 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240125.044502 2024-01-30T07:52:48.506 INFO:teuthology.packaging:sha1: 661946e7044723130c03627323f6a879a9848cb5 2024-01-30T07:52:48.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20240125.044502 2024-01-30T07:52:48.721 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-885-g661946e7-1jammy 2024-01-30T07:52:48.722 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-30T07:52:48.730 INFO:teuthology.task.internal:no buildpackages task found 2024-01-30T07:52:48.730 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-30T07:52:48.782 INFO:teuthology.task.internal:Saving configuration 2024-01-30T07:52:48.797 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-30T07:52:48.821 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-30T07:52:48.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-30 07:47:19.082437', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILI/K5caS76pAKaueLrTiO1NDkVXDxWeTOBp6vXWk8NC'} 2024-01-30T07:52:48.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-30 07:47:19.080985', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE0I/s4xfuoNRaktAQx6PI/nfqpOuyGVuFanmmfh/b7y'} 2024-01-30T07:52:48.870 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-30T07:52:48.878 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-30T07:52:48.879 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-01-30T07:52:48.879 INFO:teuthology.run_tasks:Running task console_log... 2024-01-30T07:52:48.977 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdef7edf3a0>, signals=[15]) 2024-01-30T07:52:48.978 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-30T07:52:49.063 INFO:teuthology.task.internal:Opening connections... 2024-01-30T07:52:49.063 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T07:52:49.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:52:49.147 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T07:52:49.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:52:49.227 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-30T07:52:49.238 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-01-30T07:52:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-01-30T07:52:49.244 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-30T07:52:49.291 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2024-01-30T07:52:49.292 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-01-30T07:52:49.312 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2024-01-30T07:52:49.319 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2024-01-30T07:52:49.319 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="22.04" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=jammy 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-30T07:52:49.364 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=jammy 2024-01-30T07:52:49.365 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-01-30T07:52:49.387 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-30T07:52:49.401 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-30T07:52:49.439 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-30T07:52:49.440 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-01-30T07:52:49.442 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2024-01-30T07:52:49.447 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-30T07:52:49.468 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-30T07:52:49.468 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-01-30T07:52:49.488 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2024-01-30T07:52:49.504 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-30T07:52:49.566 INFO:teuthology.run_tasks:Running task kernel... 2024-01-30T07:52:49.640 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'} 2024-01-30T07:52:49.640 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-01-30T07:52:49.640 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-01-30T07:52:49.640 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-30T07:52:49.641 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-30T07:52:49.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T07:52:49.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-30T07:52:49.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T07:52:49.650 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-30T07:52:49.830 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-30T07:52:49.830 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd42140e628558a450ba1d39a9d0835a2fa62cda"... 2024-01-30T07:52:49.830 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2024-01-30T07:52:49.837 INFO:teuthology.orchestra.run.smithi125.stdout:5.15.0-56-generic 2024-01-30T07:52:49.837 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-30T07:52:49.837 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-30T07:52:49.838 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-01-30T07:52:49.838 DEBUG:teuthology.orchestra.run.smithi125:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-30T07:52:49.889 INFO:teuthology.orchestra.run.smithi125.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-30T07:52:49.891 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-30T07:52:49.891 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd42140e628558a450ba1d39a9d0835a2fa62cda"... 2024-01-30T07:52:49.891 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-01-30T07:52:49.897 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-56-generic 2024-01-30T07:52:49.897 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-30T07:52:49.897 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-30T07:52:49.897 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-30T07:52:49.897 DEBUG:teuthology.orchestra.run.smithi050:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-30T07:52:49.948 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: git config --global init.defaultBranch 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-30T07:52:50.011 INFO:teuthology.orchestra.run.smithi125.stderr:hint: 2024-01-30T07:52:50.012 INFO:teuthology.orchestra.run.smithi125.stderr:hint: git branch -m 2024-01-30T07:52:50.012 INFO:teuthology.orchestra.run.smithi125.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-30T07:52:50.015 DEBUG:teuthology.orchestra.run.smithi125:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: git config --global init.defaultBranch 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: 2024-01-30T07:52:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:hint: git branch -m 2024-01-30T07:52:50.074 INFO:teuthology.orchestra.run.smithi050.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-30T07:52:50.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-30T07:52:50.083 DEBUG:teuthology.orchestra.run.smithi125:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-30T07:52:50.138 DEBUG:teuthology.orchestra.run.smithi125:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-30T07:52:50.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-30T07:52:50.200 DEBUG:teuthology.orchestra.run.smithi050:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-30T07:54:32.614 INFO:teuthology.orchestra.run.smithi050.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-30T07:54:32.614 INFO:teuthology.orchestra.run.smithi050.stderr: * [new branch] main -> origin/main 2024-01-30T07:54:32.640 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190312 -> 20190312 2024-01-30T07:54:32.640 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190416 -> 20190416 2024-01-30T07:54:32.640 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190514 -> 20190514 2024-01-30T07:54:32.640 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190618 -> 20190618 2024-01-30T07:54:32.640 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190717 -> 20190717 2024-01-30T07:54:32.640 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190815 -> 20190815 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190923 -> 20190923 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20191022 -> 20191022 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20191215 -> 20191215 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200122 -> 20200122 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200316 -> 20200316 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200421 -> 20200421 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200519 -> 20200519 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200619 -> 20200619 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200721 -> 20200721 2024-01-30T07:54:32.642 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200817 -> 20200817 2024-01-30T07:54:32.644 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200918 -> 20200918 2024-01-30T07:54:32.644 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201022 -> 20201022 2024-01-30T07:54:32.644 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201118 -> 20201118 2024-01-30T07:54:32.644 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201218 -> 20201218 2024-01-30T07:54:32.644 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210208 -> 20210208 2024-01-30T07:54:32.644 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210315 -> 20210315 2024-01-30T07:54:32.644 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210511 -> 20210511 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210716 -> 20210716 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210818 -> 20210818 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210919 -> 20210919 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20211027 -> 20211027 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20211216 -> 20211216 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220209 -> 20220209 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220310 -> 20220310 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220411 -> 20220411 2024-01-30T07:54:32.645 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220509 -> 20220509 2024-01-30T07:54:32.647 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220610 -> 20220610 2024-01-30T07:54:32.647 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220708 -> 20220708 2024-01-30T07:54:32.647 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220815 -> 20220815 2024-01-30T07:54:32.647 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220913 -> 20220913 2024-01-30T07:54:32.647 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221012 -> 20221012 2024-01-30T07:54:32.647 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221109 -> 20221109 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221214 -> 20221214 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230117 -> 20230117 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230210 -> 20230210 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230310 -> 20230310 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230404 -> 20230404 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230515 -> 20230515 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230625 -> 20230625 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230804 -> 20230804 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230919 -> 20230919 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231030 -> 20231030 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231111 -> 20231111 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231211 -> 20231211 2024-01-30T07:54:32.648 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240115 -> 20240115 2024-01-30T07:54:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:Updating files: 48% (1721/3543) Updating files: 49% (1737/3543) Updating files: 50% (1772/3543) Updating files: 51% (1807/3543) Updating files: 52% (1843/3543) Updating files: 53% (1878/3543) Updating files: 54% (1914/3543) Updating files: 55% (1949/3543) Updating files: 56% (1985/3543) Updating files: 57% (2020/3543) Updating files: 58% (2055/3543) Updating files: 59% (2091/3543) Updating files: 60% (2126/3543) Updating files: 61% (2162/3543) Updating files: 62% (2197/3543) Updating files: 63% (2233/3543) Updating files: 64% (2268/3543) Updating files: 64% (2277/3543) Updating files: 65% (2303/3543) Updating files: 66% (2339/3543) Updating files: 67% (2374/3543) Updating files: 68% (2410/3543) Updating files: 69% (2445/3543) Updating files: 70% (2481/3543) Updating files: 71% (2516/3543) Updating files: 72% (2551/3543) Updating files: 73% (2587/3543) Updating files: 74% (2622/3543) Updating files: 75% (2658/3543) Updating files: 76% (2693/3543) Updating files: 77% (2729/3543) Updating files: 77% (2734/3543) Updating files: 78% (2764/3543) Updating files: 79% (2799/3543) Updating files: 80% (2835/3543) Updating files: 81% (2870/3543) Updating files: 82% (2906/3543) Updating files: 83% (2941/3543) Updating files: 83% (2971/3543) Updating files: 84% (2977/3543) Updating files: 85% (3012/3543) Updating files: 86% (3047/3543) Updating files: 87% (3083/3543) Updating files: 88% (3118/3543) Updating files: 89% (3154/3543) Updating files: 90% (3189/3543) Updating files: 91% (3225/3543) Updating files: 92% (3260/3543) Updating files: 93% (3295/3543) Updating files: 94% (3331/3543) Updating files: 95% (3366/3543) Updating files: 96% (3402/3543) Updating files: 97% (3437/3543) Updating files: 98% (3473/3543) Updating files: 99% (3508/3543) Updating files: 100% (3543/3543) Updating files: 100% (3543/3543), done. 2024-01-30T07:54:36.985 INFO:teuthology.orchestra.run.smithi050.stdout:HEAD is now at fc5c48aa Merge branch 'robot/patch-0-1706548231' into 'main' 2024-01-30T07:54:37.005 INFO:teuthology.task.kernel:Downloading kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on client.0... 2024-01-30T07:54:37.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-30T07:54:37.145 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ 2024-01-30T07:54:37.145 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ --input-file=- 2024-01-30T07:54:37.148 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2024-01-30T07:54:38.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30 07:54:39 URL:https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb [39118482/39118482] -> "/tmp/linux-image.deb" [1] 2024-01-30T07:54:38.886 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2024-01-30 07:54:39-- 2024-01-30T07:54:38.886 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 1.7s 2024-01-30T07:54:38.887 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 37M in 1.5s (25.4 MB/s) 2024-01-30T07:54:38.891 INFO:teuthology.task.kernel:Installing kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on client.0... 2024-01-30T07:54:38.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo dpkg -i /tmp/linux-image.deb 2024-01-30T07:54:39.132 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-6.7.0-gcd42140e6285. 2024-01-30T07:54:41.129 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-30T07:54:41.134 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-30T07:54:41.255 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-30T07:54:42.059 INFO:teuthology.orchestra.run.smithi125.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-30T07:54:42.059 INFO:teuthology.orchestra.run.smithi125.stderr: * [new branch] main -> origin/main 2024-01-30T07:54:42.087 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190312 -> 20190312 2024-01-30T07:54:42.087 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190416 -> 20190416 2024-01-30T07:54:42.087 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190514 -> 20190514 2024-01-30T07:54:42.087 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190618 -> 20190618 2024-01-30T07:54:42.088 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190717 -> 20190717 2024-01-30T07:54:42.088 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190815 -> 20190815 2024-01-30T07:54:42.088 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190923 -> 20190923 2024-01-30T07:54:42.089 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20191022 -> 20191022 2024-01-30T07:54:42.089 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20191215 -> 20191215 2024-01-30T07:54:42.089 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200122 -> 20200122 2024-01-30T07:54:42.089 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200316 -> 20200316 2024-01-30T07:54:42.090 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200421 -> 20200421 2024-01-30T07:54:42.090 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200519 -> 20200519 2024-01-30T07:54:42.090 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200619 -> 20200619 2024-01-30T07:54:42.090 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200721 -> 20200721 2024-01-30T07:54:42.090 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200817 -> 20200817 2024-01-30T07:54:42.090 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200918 -> 20200918 2024-01-30T07:54:42.090 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20201022 -> 20201022 2024-01-30T07:54:42.091 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20201118 -> 20201118 2024-01-30T07:54:42.091 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20201218 -> 20201218 2024-01-30T07:54:42.091 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210208 -> 20210208 2024-01-30T07:54:42.091 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210315 -> 20210315 2024-01-30T07:54:42.091 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210511 -> 20210511 2024-01-30T07:54:42.091 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210716 -> 20210716 2024-01-30T07:54:42.092 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210818 -> 20210818 2024-01-30T07:54:42.093 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210919 -> 20210919 2024-01-30T07:54:42.093 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20211027 -> 20211027 2024-01-30T07:54:42.093 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20211216 -> 20211216 2024-01-30T07:54:42.093 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220209 -> 20220209 2024-01-30T07:54:42.093 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220310 -> 20220310 2024-01-30T07:54:42.093 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220411 -> 20220411 2024-01-30T07:54:42.094 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220509 -> 20220509 2024-01-30T07:54:42.094 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220610 -> 20220610 2024-01-30T07:54:42.094 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220708 -> 20220708 2024-01-30T07:54:42.094 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220815 -> 20220815 2024-01-30T07:54:42.094 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220913 -> 20220913 2024-01-30T07:54:42.094 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20221012 -> 20221012 2024-01-30T07:54:42.094 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20221109 -> 20221109 2024-01-30T07:54:42.095 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20221214 -> 20221214 2024-01-30T07:54:42.095 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230117 -> 20230117 2024-01-30T07:54:42.095 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230210 -> 20230210 2024-01-30T07:54:42.096 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230310 -> 20230310 2024-01-30T07:54:42.096 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230404 -> 20230404 2024-01-30T07:54:42.096 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230515 -> 20230515 2024-01-30T07:54:42.096 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230625 -> 20230625 2024-01-30T07:54:42.097 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230804 -> 20230804 2024-01-30T07:54:42.097 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230919 -> 20230919 2024-01-30T07:54:42.097 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20231030 -> 20231030 2024-01-30T07:54:42.097 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20231111 -> 20231111 2024-01-30T07:54:42.097 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20231211 -> 20231211 2024-01-30T07:54:42.097 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20240115 -> 20240115 2024-01-30T07:54:44.765 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-30T07:54:44.879 INFO:teuthology.orchestra.run.smithi050.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-30T07:54:46.180 INFO:teuthology.orchestra.run.smithi125.stderr:Updating files: 51% (1823/3543) Updating files: 52% (1843/3543) Updating files: 53% (1878/3543) Updating files: 54% (1914/3543) Updating files: 55% (1949/3543) Updating files: 56% (1985/3543) Updating files: 57% (2020/3543) Updating files: 58% (2055/3543) Updating files: 59% (2091/3543) Updating files: 60% (2126/3543) Updating files: 61% (2162/3543) Updating files: 62% (2197/3543) Updating files: 63% (2233/3543) Updating files: 64% (2268/3543) Updating files: 65% (2303/3543) Updating files: 65% (2335/3543) Updating files: 66% (2339/3543) Updating files: 67% (2374/3543) Updating files: 68% (2410/3543) Updating files: 69% (2445/3543) Updating files: 70% (2481/3543) Updating files: 71% (2516/3543) Updating files: 72% (2551/3543) Updating files: 73% (2587/3543) Updating files: 74% (2622/3543) Updating files: 75% (2658/3543) Updating files: 76% (2693/3543) Updating files: 77% (2729/3543) Updating files: 78% (2764/3543) Updating files: 79% (2799/3543) Updating files: 80% (2835/3543) Updating files: 81% (2870/3543) Updating files: 81% (2901/3543) Updating files: 82% (2906/3543) Updating files: 83% (2941/3543) Updating files: 84% (2977/3543) Updating files: 85% (3012/3543) Updating files: 86% (3047/3543) Updating files: 87% (3083/3543) Updating files: 88% (3118/3543) Updating files: 89% (3154/3543) Updating files: 90% (3189/3543) Updating files: 91% (3225/3543) Updating files: 92% (3260/3543) Updating files: 93% (3295/3543) Updating files: 94% (3331/3543) Updating files: 95% (3366/3543) Updating files: 96% (3402/3543) Updating files: 96% (3420/3543) Updating files: 97% (3437/3543) Updating files: 98% (3473/3543) Updating files: 99% (3508/3543) Updating files: 100% (3543/3543) Updating files: 100% (3543/3543), done. 2024-01-30T07:54:46.185 INFO:teuthology.orchestra.run.smithi125.stdout:HEAD is now at fc5c48aa Merge branch 'robot/patch-0-1706548231' into 'main' 2024-01-30T07:54:46.204 INFO:teuthology.task.kernel:Downloading kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on client.1... 2024-01-30T07:54:46.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-30T07:54:46.343 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ 2024-01-30T07:54:46.343 DEBUG:teuthology.orchestra.run.smithi125:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ --input-file=- 2024-01-30T07:54:46.345 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi125.front.sepia.ceph.com to complete... 2024-01-30T07:54:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30 07:54:48 URL:https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb [39118482/39118482] -> "/tmp/linux-image.deb" [1] 2024-01-30T07:54:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:FINISHED --2024-01-30 07:54:48-- 2024-01-30T07:54:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:Total wall clock time: 1.5s 2024-01-30T07:54:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:Downloaded: 1 files, 37M in 1.4s (27.6 MB/s) 2024-01-30T07:54:47.846 INFO:teuthology.task.kernel:Installing kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on client.1... 2024-01-30T07:54:47.847 DEBUG:teuthology.orchestra.run.smithi125:> sudo dpkg -i /tmp/linux-image.deb 2024-01-30T07:54:48.064 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package linux-image-6.7.0-gcd42140e6285. 2024-01-30T07:54:50.046 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-30T07:54:50.050 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-30T07:54:50.167 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-30T07:54:53.297 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-30T07:54:53.400 INFO:teuthology.orchestra.run.smithi125.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-30T07:55:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-01-30T07:55:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-30T07:55:05.924 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-01-30T07:55:06.268 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-30T07:55:06.287 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-30T07:55:06.611 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-30T07:55:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-30T07:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-30T07:55:06.685 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-30T07:55:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-30T07:55:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-30T07:55:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-30T07:55:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-01-30T07:55:07.064 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-deb -c /tmp/linux-image.deb 2024-01-30T07:55:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./ 2024-01-30T07:55:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./boot/ 2024-01-30T07:55:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4444641 2024-01-25 04:04 ./boot/System.map-6.7.0-gcd42140e6285 2024-01-30T07:55:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 170149 2024-01-25 04:04 ./boot/config-6.7.0-gcd42140e6285 2024-01-30T07:55:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11441152 2024-01-25 04:04 ./boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/ 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/ 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postinst.d/ 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postrm.d/ 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/preinst.d/ 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/prerm.d/ 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/ 2024-01-30T07:55:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/ 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/ 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/ 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/ 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/ 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 490345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 152241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-30T07:55:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-30T07:55:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-30T07:55:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-30T07:55:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-30T07:55:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-30T07:55:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-30T07:55:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/ 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/ 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/ 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpuid.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/msr.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/ 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 353705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-30T07:55:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 881649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-30T07:55:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2276625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm.ko 2024-01-30T07:55:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/af_alg.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_hash.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_skcipher.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ansi_cprng.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/anubis.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/arc4.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/ 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/ 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_memcpy.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_pq.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_tx.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_xor.ko 2024-01-30T07:55:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/raid6test.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authenc.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authencesn.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blake2b_generic.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_common.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_generic.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/camellia_generic.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast5_generic.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast6_generic.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast_common.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ccm.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cmac.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crc32_generic.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cryptd.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_engine.ko 2024-01-30T07:55:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_simd.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_user.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cts.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/des_generic.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/dh_generic.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/echainiv.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/essiv.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/fcrypt.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/khazad.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lrw.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4hc.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/md4.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/michael_mic.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcbc.ko 2024-01-30T07:55:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcrypt.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/rmd160.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/seed.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/serpent_generic.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 149481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tcrypt.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tea.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_common.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_generic.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/vmac.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/wp512.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xcbc.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xor.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xts.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xxhash_generic.ko 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ 2024-01-30T07:55:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_extlog.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_pad.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/ 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/einj.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ec_sys.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/platform_profile.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbs.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbshc.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 104729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/video.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/acard-ahci.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci_platform.ko 2024-01-30T07:55:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 88401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci_platform.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_acpi.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ali.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_amd.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_artop.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atiixp.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atp867x.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd640.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd64x.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cypress.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_efar.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt366.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt37x.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-30T07:55:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it8213.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it821x.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_jmicron.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_legacy.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_marvell.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_mpiix.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_netcell.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ninja32.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87410.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87415.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_oldpiix.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_opti.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_optidma.ko 2024-01-30T07:55:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pcmcia.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_piccolo.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_radisys.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rdc.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rz1000.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sch.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_serverworks.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sil680.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sl82c105.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_triflex.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_via.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pdc_adma.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_inic162x.ko 2024-01-30T07:55:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_mv.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_nv.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_promise.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_qstor.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil24.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sis.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_svw.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sx4.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_uli.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_via.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_vsc.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ks0108.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/ 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/bcma.ko 2024-01-30T07:55:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/ 2024-01-30T07:55:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/ 2024-01-30T07:55:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/aoe.ko 2024-01-30T07:55:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/ 2024-01-30T07:55:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 965305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/drbd.ko 2024-01-30T07:55:07.164 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 173353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/floppy.ko 2024-01-30T07:55:07.164 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/ 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 116321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/nbd.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/ 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 110737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/null_blk.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/pktcdvd.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 263769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/rbd.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/ 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/ 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/zram.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/applicom.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hangcheck-timer.ko 2024-01-30T07:55:07.165 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/ 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/via-rng.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 148609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 139313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-30T07:55:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/lp.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/ 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/mwave.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/nvram.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ppdev.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tlclk.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/ 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-30T07:55:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/ 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/ 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-palmas.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-si5351.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-twl6040.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-wm831x.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/ 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ 2024-01-30T07:55:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 246841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/ 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/ 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 517033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-aes.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-sha.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/ 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/ 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/dca.ko 2024-01-30T07:55:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/ 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/amd64_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/e752x_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/edac_mce_amd.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3000_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3200_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5100_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5400_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7300_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7core_edac.ko 2024-01-30T07:55:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i82975x_edac.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ie31200_edac.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/sb_edac.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/x38_edac.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/ 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-gpio.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max14577.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max77693.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max8997.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-palmas.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/ 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/ 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-30T07:55:07.171 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/ 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-arizona.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9052.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9055.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-dln2.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-generic.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ich.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-kempld.ko 2024-01-30T07:55:07.172 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max7300.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max730x.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max732x.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-vx855.ko 2024-01-30T07:55:07.173 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/ 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-a4tech.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-apple.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-appleir.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-aureal.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-axff.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-belkin.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cherry.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-chicony.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cp2112.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cypress.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-dr.ko 2024-01-30T07:55:07.174 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elecom.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elo.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-emsff.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ezkey.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gaff.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-generic.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gt683r.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gyration.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtekff.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-hyperv.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-icade.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kensington.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-keytouch.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kye.ko 2024-01-30T07:55:07.175 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lcpower.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-led.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lenovo.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lg-g15.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-magicmouse.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-microsoft.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-monterey.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-multitouch.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ntrig.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ortek.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-penmount.ko 2024-01-30T07:55:07.176 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-petalynx.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-picolcd.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-pl.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-plantronics.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-primax.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-rmi.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-common.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-30T07:55:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-saitek.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-samsung.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sjoy.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sony.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-speedlink.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-steelseries.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sunplus.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tivo.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tmff.ko 2024-01-30T07:55:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-topseed.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-twinhan.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-uclogic.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-waltop.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 143473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-wiimote.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-xinmo.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zpff.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zydacron.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 269281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/uhid.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/ 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-30T07:55:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 217873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/wacom.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/ 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_balloon.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_utils.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 305321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_vmbus.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru3.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7414.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7418.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adc128d818.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1025.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1026.ko 2024-01-30T07:55:07.180 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1029.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1031.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm9240.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ads7828.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7410.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7411.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7462.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7470.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7475.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7x10.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/amc6821.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/applesmc.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asb100.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asc7621.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/atxp1.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/coretemp.ko 2024-01-30T07:55:07.181 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dme1737.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds1621.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds620.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc1403.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc2103.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc6w201.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71805f.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71882fg.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f75375s.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fam15h_power.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fschmd.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g760a.ko 2024-01-30T07:55:07.182 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g762.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl518sm.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl520sm.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hih6130.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5500_temp.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5k_amb.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmaem.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmpex.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina209.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina2xx.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 130449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/it87.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/jc42.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k10temp.ko 2024-01-30T07:55:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k8temp.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lineage-pem.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm63.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm73.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm75.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm77.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm78.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm80.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm83.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm85.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm87.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm90.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm92.ko 2024-01-30T07:55:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm93.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95234.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95241.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95245.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc2945.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4151.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4215.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4222.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4245.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4260.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4261.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max16065.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1619.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1668.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max197.ko 2024-01-30T07:55:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6639.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6650.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6697.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mcp3021.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6683.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775-core.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct7802.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87360.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87427.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pcf8591.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-30T07:55:07.186 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/powr1220.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5627.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5636.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht15.ko 2024-01-30T07:55:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht21.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/shtc1.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sis5595.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47b397.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m1.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m192.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/thmc50.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp102.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp103.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp401.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp421.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via-cputemp.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via686a.ko 2024-01-30T07:55:07.188 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt1211.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt8231.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627ehf.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627hf.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83781d.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83791d.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83792d.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83793.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83795.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l785ts.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l786ng.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/ 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/ 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-30T07:55:07.189 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/ 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-30T07:55:07.190 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-30T07:55:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-mux.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-smbus.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-stub.ko 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/ 2024-01-30T07:55:07.192 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 273609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 883681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_core.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 324329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 282601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-30T07:55:07.193 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 493217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-30T07:55:07.194 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/ 2024-01-30T07:55:07.194 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 420561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-30T07:55:07.194 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/ 2024-01-30T07:55:07.194 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 741449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-30T07:55:07.194 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ 2024-01-30T07:55:07.194 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 296881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 153801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/ 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 168969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 263081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ 2024-01-30T07:55:07.228 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 111425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 128753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 129529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/evbug.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ff-memless.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/ 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/gameport.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/joydev.ko 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/ 2024-01-30T07:55:07.229 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8323.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8333.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-30T07:55:07.230 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt1070.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt2160.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/stowaway.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/matrix-keymap.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/ 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/appletouch.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/bcm5974.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 123417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/cyapatp.ko 2024-01-30T07:55:07.231 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 335953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/psmouse.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/sermouse.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/ 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/altera_ps2.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/arc_ps2.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ct82c710.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/parkbd.ko 2024-01-30T07:55:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/pcips2.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ps2mult.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serio_raw.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serport.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/sparse-keymap.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/ 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-88pm860x.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-adp5520.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-bd2802.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-blinkm.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da903x.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da9052.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-gpio.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3530.ko 2024-01-30T07:55:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3533.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm355x.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3642.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp3944.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp8788.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-max8997.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-mc13783.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca9532.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca955x.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca963x.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-ss4200.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-tca6507.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-30T07:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm8350.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/ 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/ 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 647193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/bcache.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bio-prison.ko 2024-01-30T07:55:07.235 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bufio.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache-smq.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 155897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-crypt.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-delay.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-era.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-flakey.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log-userspace.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-mirror.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-multipath.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-queue-length.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-raid.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-region-hash.ko 2024-01-30T07:55:07.236 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-round-robin.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-service-time.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-snapshot.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-switch.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 181865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-thin-pool.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-verity.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-zero.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/faulty.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/linear.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/multipath.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/ 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 199937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid0.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid1.ko 2024-01-30T07:55:07.237 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 158657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid10.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 393777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid456.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/ 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/ 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 178137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptbase.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptctl.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptfc.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptlan.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 123321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptsas.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptscsih.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptspi.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm800.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm805.ko 2024-01-30T07:55:07.238 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm80x.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona-i2c.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 123721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/bcm590xx.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/dln2.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/janz-cmodio.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/kempld-core.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-core.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lp3943.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_ich.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_sch.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/max8907.ko 2024-01-30T07:55:07.239 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/menf21bmc.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/retu-mfd.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/si476x-core.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/sm501.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps65010.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps6507x.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/viperboard.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/vx855.ko 2024-01-30T07:55:07.240 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wl1273-core.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wm8994.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/ 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds9802als.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds990x.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/bh1770glc.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/ 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/core.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/ 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/cb710.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ds1682.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/dummy-irq.ko 2024-01-30T07:55:07.241 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/ 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/echo.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/ 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/at24.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/max6875.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/enclosure.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/ 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 152201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hmc6352.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hpilo.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ics932s401.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29003.ko 2024-01-30T07:55:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29020.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/ 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/ 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-me.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-txe.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 313641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/phantom.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/ 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_7xx1.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_core.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tsl2550.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_balloon.ko 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/ 2024-01-30T07:55:07.243 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 183609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/ 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 490849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/bonding.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/ 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/ 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 455065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dummy.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/eql.ko 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ 2024-01-30T07:55:07.244 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/ 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 130553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/ 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/ 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/ 2024-01-30T07:55:07.245 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/ 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/ 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/ 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-30T07:55:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 176761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1421529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 128569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 131337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 314553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 323745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 193497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-30T07:55:07.247 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 347257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1044793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 166193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/ 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 204345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/ 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-30T07:55:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 141225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/ 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dnet.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/ 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 281137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ethoc.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fealnx.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/ 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ 2024-01-30T07:55:07.249 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 295481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 584497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 246209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 937673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 287305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 514569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 734353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-30T07:55:07.250 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 151769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/jme.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/ 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/ 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 727473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 278961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1118201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-30T07:55:07.251 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 95665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/ 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/ 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 150905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/ 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 136721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-30T07:55:07.252 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/ 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/ 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 227897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 671937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/ 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/ 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 192353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/ 2024-01-30T07:55:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 104241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/ 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1064737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/ 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/ 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/ 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/ 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-30T07:55:07.254 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-30T07:55:07.255 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-30T07:55:07.255 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 487593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-30T07:55:07.320 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/ 2024-01-30T07:55:07.320 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-30T07:55:07.320 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 166097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/ 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/ 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/ 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/ 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/ 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-30T07:55:07.321 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/ 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/defxx.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/ 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 216985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/geneve.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/ 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 236225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/ 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ifb.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvlan.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvtap.ko 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/ 2024-01-30T07:55:07.322 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mii.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/netconsole.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/nlmon.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/ 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/amd.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-30T07:55:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm87xx.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/broadcom.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/cicada.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/davicom.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/et1011c.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/icplus.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/lxt.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/marvell.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/micrel.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/national.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 95561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/phylink.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/qsemi.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/realtek.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/smsc.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ste10Xp.ko 2024-01-30T07:55:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/vitesse.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/ 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/plip.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_async.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppoe.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppox.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pptp.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sb1000.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/ 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/slip.ko 2024-01-30T07:55:07.325 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sungem_phy.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/tap.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/ 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_random.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/veth.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/ 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/ 2024-01-30T07:55:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 301281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/vxlan.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/ 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ntb.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/ 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/ 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 265777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme-core.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/ 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 131249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_cs.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_pc.ko 2024-01-30T07:55:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_serial.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/ 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/ 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/pci-stub.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/xen-pcifront.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/ 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/i82092.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 146289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pd6729.ko 2024-01-30T07:55:07.328 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/ 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/ 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/ 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/ 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/ 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/ 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/ 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-30T07:55:07.329 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acerhdf.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 132025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-30T07:55:07.330 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/hdaps.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/ 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel_ips.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-30T07:55:07.331 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/ 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9030_battery.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9052-battery.ko 2024-01-30T07:55:07.332 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/gpio-charger.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max14577_charger.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max17042_battery.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8903_charger.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8925_power.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/sbs-battery.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/test_power.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-30T07:55:07.333 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_power.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm8350_power.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/ 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/ 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/ 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps_parport.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/pps_core.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp.ko 2024-01-30T07:55:07.334 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp_kvm.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/ 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9052.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9055.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9063.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-30T07:55:07.335 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-em3027.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max6900.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8907.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8925.ko 2024-01-30T07:55:07.336 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8997.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8998.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-palmas.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-30T07:55:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-x1205.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-9xxx.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-sas.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-xxxx.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 135185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/BusLogic.ko 2024-01-30T07:55:07.338 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/a100u2w.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/ 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 271113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/advansys.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/ 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 356929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 296049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/ 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 189185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/am53c974.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/ 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/atp870u.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/ 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 247009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-30T07:55:07.339 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/ 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1171945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/bfa.ko 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/ 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 237721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/ 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ch.ko 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/ 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 308921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/ 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-30T07:55:07.340 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 146625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dc395x.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dmx3191d.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/ 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 212425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esp_scsi.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/ 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 158505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fdomain.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/ 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 263489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/fnic.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 201817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hpsa.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hptiop.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hv_storvsc.ko 2024-01-30T07:55:07.341 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/imm.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/initio.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 266537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ipr.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ips.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/ 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 317153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/isci.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/ 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 315209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/libfc.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 145585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/ 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 216441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/libsas.ko 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/ 2024-01-30T07:55:07.342 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2197481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/ 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 310841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/ 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 659801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/ 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvumi.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/ 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-30T07:55:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/ 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 366401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pmcraid.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ppa.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla1280.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/ 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/ 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 559033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qlogicfas408.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/raid_class.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 261241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_debug.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 173937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-30T07:55:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 279313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ses.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/st.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/stex.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 164961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/virtio_scsi.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/wd719x.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/xen-scsifront.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 129441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ssb.ko 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/ 2024-01-30T07:55:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/ 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 736769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/ 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_file.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_iblock.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 930697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_mod.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_pscsi.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_user.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/ 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/ 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/ 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-30T07:55:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-30T07:55:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/moxa.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/mxser.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_gsm.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_hdlc.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/nozomi.ko 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/ 2024-01-30T07:55:07.348 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/ 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_uart.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/arc_uart.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/ 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/rp2.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/ 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 535985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-30T07:55:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/ 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_aec.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_cif.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_mf624.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_netx.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pci_generic.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_sercos3.ko 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/ 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/ 2024-01-30T07:55:07.350 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/ 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-acm.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usblp.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usbtmc.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ulpi.ko 2024-01-30T07:55:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/ 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/ 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 454385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/ 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/ 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-30T07:55:07.352 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 92489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/ 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-30T07:55:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 161225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/ 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-30T07:55:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 157681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 156409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ 2024-01-30T07:55:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811_cs.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/ 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/mdc800.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/microtek.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/adutux.ko 2024-01-30T07:55:07.356 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/appledisplay.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cytherm.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ehset.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi26.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi62.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ezusb.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/idmouse.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/iowarrior.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ldusb.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/legousbtower.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/lvstest.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/ 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-30T07:55:07.357 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usb3503.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usblcd.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbtest.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/uss720.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/yurex.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/ 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/usbmon.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/ 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 301697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/ 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-generic.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-30T07:55:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/aircable.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ark3116.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ch341.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cp210x.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cyberjack.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/empeg.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/f81232.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 175193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-30T07:55:07.359 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 137081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_ti.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipaq.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipw.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ir-usb.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mct_u232.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/metro-usb.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7720.ko 2024-01-30T07:55:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7840.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mxuport.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/navman.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/omninet.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/opticon.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 191801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/option.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/oti6858.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/pl2303.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcaux.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcserial.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/quatech2.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/safe_serial.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/sierra.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-30T07:55:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ssu100.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/symbolserial.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_debug.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usbserial.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/visor.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/whiteheat.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/uas.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-30T07:55:07.362 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-karma.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 180225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/usb-storage.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/ 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-30T07:55:07.363 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/ 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/ 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 154297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/ 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_net.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_scsi.ko 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/ 2024-01-30T07:55:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/ 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/apple_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/bd6107.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lcd.ko 2024-01-30T07:55:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/ 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2482.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2490.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-30T07:55:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/ 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/wire.ko 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ 2024-01-30T07:55:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/acquirewdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/advantechwdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/dw_wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/hpwdt.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/i6300esb.ko 2024-01-30T07:55:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ib700wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ibmasr.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it87_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/machzwd.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/nv_tco.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-30T07:55:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/retu_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/softdog.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/via_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-30T07:55:07.370 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wdt_pci.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/xen_wdt.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/ 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-evtchn.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntalloc.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntdev.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/ 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 176441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-privcmd.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-scsiback.ko 2024-01-30T07:55:07.371 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 166753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/9p.ko 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/adfs.ko 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 163449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/affs.ko 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 935033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/kafs.ko 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/autofs4.ko 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/ 2024-01-30T07:55:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/befs.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/ 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/bfs.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/binfmt_misc.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/ 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 3455857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/btrfs.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/ 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 306009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/cachefiles.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1336985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ceph.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/ 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/coda.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/ 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/configfs.ko 2024-01-30T07:55:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/ 2024-01-30T07:55:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/cramfs.ko 2024-01-30T07:55:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/ 2024-01-30T07:55:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 644073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/dlm.ko 2024-01-30T07:55:07.424 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/ 2024-01-30T07:55:07.424 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/efs.ko 2024-01-30T07:55:07.424 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1506641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/f2fs.ko 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/msdos.ko 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/freevxfs.ko 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 226481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/fscache.ko 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/cuse.ko 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1229913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/gfs2.ko 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 141985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/hfs.ko 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/ 2024-01-30T07:55:07.425 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 223225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/hfsplus.ko 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 193569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/hpfs.ko 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/isofs.ko 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 419881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/jfs.ko 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 282049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/lockd.ko 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/minix.ko 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/netfs.ko 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/ 2024-01-30T07:55:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/ 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/ 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 117465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1057969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfs.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv2.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 120265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv3.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2042153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv4.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/ 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/grace.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/nfs_acl.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/ 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1563929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/nfsd.ko 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/ 2024-01-30T07:55:07.427 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 590713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/nilfs2.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/ 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-celtic.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-centeuro.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-croatian.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-cyrillic.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-gaelic.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-greek.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-iceland.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-inuit.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-roman.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-romanian.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-turkish.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ascii.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1250.ko 2024-01-30T07:55:07.428 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1251.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1255.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp737.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp775.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp850.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp852.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp855.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp857.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp860.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp861.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp862.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp863.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp864.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp865.ko 2024-01-30T07:55:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp866.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp869.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp874.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp932.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 142673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp936.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 165745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp949.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 118121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp950.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_euc-jp.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-1.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-13.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-14.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-15.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-2.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-3.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-4.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-5.ko 2024-01-30T07:55:07.430 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-6.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-7.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-9.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-r.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-ru.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-u.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_utf8.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 220553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ntfs.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 244737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 440737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ 2024-01-30T07:55:07.431 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2593521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/ 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/omfs.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/ 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 370697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/overlay.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ramoops.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/ 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/qnx4.ko 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/ 2024-01-30T07:55:07.432 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/qnx6.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/ 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_tree.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v1.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v2.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/ 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 532025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/reiserfs.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/ 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/romfs.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/ 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/ 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2683249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/cifs.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/ 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_arc4.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_md4.ko 2024-01-30T07:55:07.433 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 134777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/squashfs.ko 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/sysv.ko 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 248425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/udf.ko 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 162537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ufs.ko 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4014433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/xfs.ko 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/locktorture.ko 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/ 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/test_udelay.ko 2024-01-30T07:55:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/torture.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc-itu-t.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc7.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc8.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/ 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libarc4.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libdes.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/interval_tree_test.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/libcrc32c.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lru_cache.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/ 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4_compress.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4hc_compress.ko 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/ 2024-01-30T07:55:07.435 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/cordic.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/memory-notifier-error-inject.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/notifier-error-inject.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/percpu_test.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/pm-notifier-error-inject.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/ 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 143353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/raid6_pq.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/rbtree_test.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/ 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-kstrtox.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-string_helpers.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_bpf.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_firmware.ko 2024-01-30T07:55:07.436 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_module.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_user_copy.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_bm.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_fsm.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_kmp.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/ 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/xz_dec_test.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/ 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/hwpoison-inject.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/ 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/6lowpan.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_dest.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_fragment.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_hop.ko 2024-01-30T07:55:07.437 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_mobility.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_routing.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_udp.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/ 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/garp.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/mrp.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/p8022.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/psnap.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/stp.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/ 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/8021q.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/ 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 198905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_fd.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_rdma.ko 2024-01-30T07:55:07.438 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_virtio.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/ 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 649977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/batman-adv.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/ 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/br_netfilter.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 785817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/bridge.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-30T07:55:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtables.ko 2024-01-30T07:55:07.440 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/ 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1046753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/libceph.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/ 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 126041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/pktgen.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/ 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 194529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_diag.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv4.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv6.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/ 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 390129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/dsa_core.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_brcm.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_dsa.ko 2024-01-30T07:55:07.441 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_none.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_trailer.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/ 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/hsr.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 255849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ah4.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/esp4.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/fou.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/gre.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/inet_diag.ko 2024-01-30T07:55:07.442 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_gre.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_tunnel.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_vti.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipcomp.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipip.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-30T07:55:07.443 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-30T07:55:07.444 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_bic.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_dctcp.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_diag.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_highspeed.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_htcp.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_hybla.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_illinois.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_lp.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_scalable.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_vegas.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_veno.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_westwood.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_yeah.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tunnel4.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_diag.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_tunnel.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-30T07:55:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ah6.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/esp6.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/fou6.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_gre.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_tunnel.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_vti.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ipcomp6.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/mip6.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-30T07:55:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-30T07:55:07.447 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/sit.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/tunnel6.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/ 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/af_key.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/ 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_core.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_eth.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip6.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_netlink.ko 2024-01-30T07:55:07.448 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ppp.ko 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/ 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/lapb.ko 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/ 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc.ko 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 268265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc2.ko 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/ 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 290441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/mac802154.ko 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/ 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/mpls_gso.ko 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ 2024-01-30T07:55:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 118801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 110753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-30T07:55:07.450 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 412561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conncount.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 411489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack.ko 2024-01-30T07:55:07.451 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 118193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_log_syslog.ko 2024-01-30T07:55:07.452 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 96545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_irc.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_sip.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 614025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_tables.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_log.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-30T07:55:07.453 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_chain_nat.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_compat.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_ct.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fib.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_hash.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_limit.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_log.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_masq.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_nat.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_numgen.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_osf.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_queue.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_redir.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject.ko 2024-01-30T07:55:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject_inet.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_socket.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_synproxy.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_tproxy.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/x_tables.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_AUDIT.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CT.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_DSCP.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HL.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HMARK.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LED.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LOG.ko 2024-01-30T07:55:07.455 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NETMAP.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFLOG.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_RATEEST.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_SECMARK.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TEE.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TPROXY.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TRACE.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_addrtype.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_bpf.ko 2024-01-30T07:55:07.456 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cgroup.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cluster.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_comment.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connbytes.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlabel.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlimit.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connmark.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_conntrack.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cpu.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dccp.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_devgroup.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dscp.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ecn.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_esp.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hashlimit.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_helper.ko 2024-01-30T07:55:07.457 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hl.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipcomp.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_iprange.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipvs.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_l2tp.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_length.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_limit.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mac.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mark.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_multiport.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nat.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nfacct.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_osf.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_owner.ko 2024-01-30T07:55:07.458 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_physdev.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_pkttype.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_policy.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_quota.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_rateest.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_realm.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_recent.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_sctp.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_set.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_socket.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_state.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_statistic.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_string.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpmss.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpudp.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_time.ko 2024-01-30T07:55:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_u32.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/ 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/netlink_diag.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/ 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/nsh.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/ 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 383481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/openvswitch.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-geneve.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-gre.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-vxlan.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/ 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/af_packet_diag.ko 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/ 2024-01-30T07:55:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 112057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/phonet.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/pn_pep.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/ 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 252953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 164937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_rdma.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_tcp.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/ 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 818777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/rxrpc.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/ 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_csum.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_gact.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_ipt.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_mirred.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_nat.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_pedit.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_police.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_simple.ko 2024-01-30T07:55:07.461 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_skbedit.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_vlan.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_basic.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_bpf.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_cgroup.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_flow.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_fw.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_route.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_u32.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_cmp.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_ipset.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_meta.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_nbyte.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_text.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_u32.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_choke.ko 2024-01-30T07:55:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_codel.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_drr.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq_codel.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_gred.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hfsc.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hhf.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_htb.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_ingress.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio_lib.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_multiq.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_netem.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_pie.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_plug.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_prio.ko 2024-01-30T07:55:07.463 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_qfq.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_red.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfb.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfq.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_tbf.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_teql.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/ 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 932169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp_diag.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/ 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/ 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 336777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1518417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/sunrpc.ko 2024-01-30T07:55:07.464 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/ 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 708281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/ 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/diag.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 866345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/tipc.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/ 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/unix_diag.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/ 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/ 2024-01-30T07:55:07.465 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 125409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/x25.ko 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/ 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_algo.ko 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 104161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_user.ko 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/ 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/ 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/irqbypass.ko 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 641009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 625033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias.bin 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7677 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23634 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.alias.bin 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9916 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.bin 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70653 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.modinfo 2024-01-30T07:55:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 147734 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 234045 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep.bin 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 210 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.devname 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72797 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.order 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 879 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.softdep 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 255175 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 309826 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols.bin 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/ 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/ 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/ 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/ 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 171 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/changelog.Debian.gz 2024-01-30T07:55:07.467 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 691 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/copyright 2024-01-30T07:55:07.468 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gcd42140e6285 2024-01-30T07:55:07.468 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gcd42140e6285 2024-01-30T07:55:07.469 DEBUG:teuthology.orchestra.run.smithi050:> egrep '(submenu|menuentry.*6.7.0-gcd42140e6285).*{' /boot/grub/grub.cfg 2024-01-30T07:55:07.476 INFO:teuthology.orchestra.run.smithi050.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-30T07:55:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-30T07:55:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-30T07:55:07.477 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-30T07:55:07.477 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gcd42140e6285 2024-01-30T07:55:07.477 DEBUG:teuthology.orchestra.run.smithi050:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-30T07:55:07.521 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi050.front.sepia.ceph.com to complete... 2024-01-30T07:55:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-01-30T07:55:08.081 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-30T07:55:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-01-30T07:55:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-30T07:55:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-30T07:55:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-30T07:55:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-30T07:55:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-30T07:55:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-30T07:55:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-30T07:55:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-30T07:55:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-30T07:55:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-01-30T07:55:14.085 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub' 2024-01-30T07:55:14.095 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-30T07:55:14.124 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2024-01-30T07:55:14.407 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-30T07:55:14.425 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-30T07:55:14.709 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-30T07:55:14.742 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-30T07:55:14.802 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-30T07:55:14.809 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-30T07:55:14.965 INFO:teuthology.orchestra.run.smithi125.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-30T07:55:14.966 INFO:teuthology.orchestra.run.smithi125.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-30T07:55:14.966 INFO:teuthology.orchestra.run.smithi125.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-30T07:55:15.012 INFO:teuthology.orchestra.run.smithi125.stderr:done 2024-01-30T07:55:15.185 DEBUG:teuthology.orchestra.run.smithi125:> dpkg-deb -c /tmp/linux-image.deb 2024-01-30T07:55:15.193 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./ 2024-01-30T07:55:15.193 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./boot/ 2024-01-30T07:55:15.193 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 4444641 2024-01-25 04:04 ./boot/System.map-6.7.0-gcd42140e6285 2024-01-30T07:55:15.205 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 170149 2024-01-25 04:04 ./boot/config-6.7.0-gcd42140e6285 2024-01-30T07:55:15.205 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11441152 2024-01-25 04:04 ./boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postinst.d/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postrm.d/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/preinst.d/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/prerm.d/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/ 2024-01-30T07:55:15.225 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/ 2024-01-30T07:55:15.226 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ 2024-01-30T07:55:15.226 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 490345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-30T07:55:15.228 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-30T07:55:15.228 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 93113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 152241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-30T07:55:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/ 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/ 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/ 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpuid.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/msr.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/ 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 353705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-30T07:55:15.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 881649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-30T07:55:15.231 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2276625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/af_alg.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_hash.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_skcipher.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ansi_cprng.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/anubis.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/arc4.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/ 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/ 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_memcpy.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_pq.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-30T07:55:15.306 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_tx.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_xor.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/raid6test.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authenc.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authencesn.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blake2b_generic.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_common.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_generic.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/camellia_generic.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast5_generic.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast6_generic.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast_common.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ccm.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cmac.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crc32_generic.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cryptd.ko 2024-01-30T07:55:15.307 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_engine.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_simd.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_user.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cts.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/des_generic.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/dh_generic.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/echainiv.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/essiv.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/fcrypt.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/khazad.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lrw.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4hc.ko 2024-01-30T07:55:15.308 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/md4.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/michael_mic.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcbc.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcrypt.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/rmd160.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/seed.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/serpent_generic.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 149481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tcrypt.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tea.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_common.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_generic.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/vmac.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/wp512.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xcbc.ko 2024-01-30T07:55:15.309 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xor.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xts.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xxhash_generic.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_extlog.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_pad.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/ 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/einj.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ec_sys.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/platform_profile.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbs.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbshc.ko 2024-01-30T07:55:15.310 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 104729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/video.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/acard-ahci.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci_platform.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 88401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci_platform.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_acpi.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ali.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_amd.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_artop.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atiixp.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atp867x.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd640.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd64x.ko 2024-01-30T07:55:15.311 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cypress.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_efar.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt366.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt37x.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it8213.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it821x.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_jmicron.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_legacy.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_marvell.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_mpiix.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_netcell.ko 2024-01-30T07:55:15.312 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ninja32.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87410.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87415.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_oldpiix.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_opti.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_optidma.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pcmcia.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_piccolo.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_radisys.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rdc.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rz1000.ko 2024-01-30T07:55:15.313 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sch.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_serverworks.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sil680.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sl82c105.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_triflex.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_via.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pdc_adma.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_inic162x.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_mv.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_nv.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_promise.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_qstor.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil.ko 2024-01-30T07:55:15.314 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil24.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sis.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_svw.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sx4.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_uli.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_via.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_vsc.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ks0108.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/ 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 124473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/bcma.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/ 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/ 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/aoe.ko 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/ 2024-01-30T07:55:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 965305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/drbd.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 173353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/floppy.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/ 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 94297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 116321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/nbd.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/ 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 110737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/null_blk.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 98281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/pktcdvd.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 263769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/rbd.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/ 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 98185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/ 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/zram.ko 2024-01-30T07:55:15.316 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/applicom.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hangcheck-timer.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/ 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/via-rng.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 148609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-30T07:55:15.317 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 139313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/lp.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/ 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 84097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/mwave.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/nvram.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ppdev.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tlclk.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/ 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-30T07:55:15.318 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/ 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/ 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-palmas.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-si5351.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-twl6040.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-wm831x.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/ 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-30T07:55:15.319 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 246841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp.ko 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 517033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-aes.ko 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-sha.ko 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/ 2024-01-30T07:55:15.320 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/dca.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/ 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 79953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/amd64_edac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/e752x_edac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/edac_mce_amd.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3000_edac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3200_edac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5100_edac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5400_edac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7300_edac.ko 2024-01-30T07:55:15.321 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7core_edac.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i82975x_edac.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ie31200_edac.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/sb_edac.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/x38_edac.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/ 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-gpio.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max14577.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max77693.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max8997.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-palmas.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/ 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-30T07:55:15.322 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/ 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/ 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-arizona.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9052.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9055.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-dln2.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 77849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-generic.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ich.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-30T07:55:15.323 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-kempld.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max7300.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max730x.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max732x.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-30T07:55:15.324 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-vx855.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/ 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-a4tech.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-apple.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-appleir.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-aureal.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-axff.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-belkin.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cherry.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-chicony.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cp2112.ko 2024-01-30T07:55:15.325 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cypress.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-dr.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elecom.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elo.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-emsff.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ezkey.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gaff.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-generic.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gt683r.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gyration.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtekff.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-hyperv.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-icade.ko 2024-01-30T07:55:15.326 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kensington.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-keytouch.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kye.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lcpower.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-led.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lenovo.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lg-g15.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-magicmouse.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-microsoft.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-monterey.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-multitouch.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ntrig.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ortek.ko 2024-01-30T07:55:15.327 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-penmount.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-petalynx.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-picolcd.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-pl.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-plantronics.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-primax.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-rmi.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-common.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-30T07:55:15.328 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-saitek.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-samsung.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sjoy.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sony.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-speedlink.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-steelseries.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sunplus.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tivo.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tmff.ko 2024-01-30T07:55:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-topseed.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-twinhan.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-uclogic.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-waltop.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 143473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-wiimote.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-xinmo.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zpff.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zydacron.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 269281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/uhid.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/ 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-30T07:55:15.330 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 217873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/wacom.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/ 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_balloon.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_utils.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 305321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_vmbus.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru3.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7414.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7418.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adc128d818.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1025.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1026.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1029.ko 2024-01-30T07:55:15.331 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1031.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm9240.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ads7828.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7410.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7411.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7462.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7470.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7475.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7x10.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/amc6821.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/applesmc.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asb100.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asc7621.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/atxp1.ko 2024-01-30T07:55:15.332 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/coretemp.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 99601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dme1737.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds1621.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds620.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc1403.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc2103.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc6w201.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71805f.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 94689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71882fg.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f75375s.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fam15h_power.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fschmd.ko 2024-01-30T07:55:15.333 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g760a.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g762.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl518sm.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl520sm.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hih6130.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5500_temp.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5k_amb.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmaem.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmpex.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina209.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina2xx.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 130449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/it87.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/jc42.ko 2024-01-30T07:55:15.334 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k10temp.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k8temp.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lineage-pem.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm63.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm73.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm75.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm77.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm78.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm80.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm83.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm85.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm87.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm90.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm92.ko 2024-01-30T07:55:15.335 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm93.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95234.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95241.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95245.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc2945.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4151.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4215.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4222.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4245.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4260.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4261.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max16065.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1619.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1668.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max197.ko 2024-01-30T07:55:15.336 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6639.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6650.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6697.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mcp3021.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6683.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 119689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775-core.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct7802.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87360.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87427.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pcf8591.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-30T07:55:15.337 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/powr1220.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5627.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5636.ko 2024-01-30T07:55:15.338 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht15.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht21.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/shtc1.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sis5595.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47b397.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m1.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m192.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/thmc50.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp102.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp103.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp401.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp421.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via-cputemp.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via686a.ko 2024-01-30T07:55:15.339 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt1211.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt8231.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627ehf.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627hf.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83781d.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83791d.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83792d.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83793.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 119505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83795.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l785ts.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l786ng.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-30T07:55:15.340 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/ 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/ 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/ 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-30T07:55:15.341 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-30T07:55:15.342 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-mux.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-smbus.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-stub.ko 2024-01-30T07:55:15.343 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/ 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 273609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 883681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_core.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 324329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 282601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ 2024-01-30T07:55:15.344 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 493217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 420561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 741449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 296881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 153801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 168969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 263081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-30T07:55:15.345 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 111425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 128753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 129529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/evbug.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ff-memless.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/ 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/gameport.ko 2024-01-30T07:55:15.346 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/joydev.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/ 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8323.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8333.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-30T07:55:15.347 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt1070.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt2160.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/stowaway.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/matrix-keymap.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/ 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/appletouch.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/bcm5974.ko 2024-01-30T07:55:15.348 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 123417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/cyapatp.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 335953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/psmouse.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/sermouse.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/ 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 109873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/altera_ps2.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/arc_ps2.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ct82c710.ko 2024-01-30T07:55:15.349 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/parkbd.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/pcips2.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ps2mult.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serio_raw.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serport.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/sparse-keymap.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/ 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-88pm860x.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-adp5520.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-bd2802.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-blinkm.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da903x.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da9052.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-gpio.ko 2024-01-30T07:55:15.350 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3530.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3533.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm355x.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3642.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp3944.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp8788.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-max8997.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-mc13783.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca9532.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca955x.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca963x.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-ss4200.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-tca6507.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm8350.ko 2024-01-30T07:55:15.351 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/ 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/ 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 647193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/bcache.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bio-prison.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 93409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bufio.ko 2024-01-30T07:55:15.352 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache-smq.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 155897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 107257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-crypt.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-delay.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-era.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-flakey.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log-userspace.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-mirror.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-multipath.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-queue-length.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-raid.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-region-hash.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-round-robin.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-service-time.ko 2024-01-30T07:55:15.353 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 109529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-snapshot.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-switch.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 181865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-thin-pool.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-verity.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-zero.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/faulty.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/linear.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/multipath.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/ 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 199937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid0.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid1.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 158657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid10.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 393777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid456.ko 2024-01-30T07:55:15.354 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/ 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/ 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 178137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptbase.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptctl.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptfc.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptlan.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 123321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptsas.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptscsih.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptspi.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm800.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm805.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm80x.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona-i2c.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 123721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona.ko 2024-01-30T07:55:15.355 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/bcm590xx.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/dln2.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/janz-cmodio.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/kempld-core.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-core.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lp3943.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_ich.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_sch.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/max8907.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/menf21bmc.ko 2024-01-30T07:55:15.356 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/retu-mfd.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/si476x-core.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/sm501.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps65010.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps6507x.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/viperboard.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/vx855.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wl1273-core.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wm8994.ko 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ 2024-01-30T07:55:15.357 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/ 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds9802als.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds990x.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/bh1770glc.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/ 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/core.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/ 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/cb710.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ds1682.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/dummy-irq.ko 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/ 2024-01-30T07:55:15.358 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/echo.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/ 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/at24.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/max6875.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/enclosure.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/ 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 152201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hmc6352.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hpilo.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ics932s401.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29003.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29020.ko 2024-01-30T07:55:15.359 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/ 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/ 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-me.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-txe.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 313641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/phantom.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/ 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_7xx1.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_core.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tsl2550.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_balloon.ko 2024-01-30T07:55:15.360 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/ 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 183609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/ 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 490849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/bonding.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/ 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/ 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 455065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dummy.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/eql.ko 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ 2024-01-30T07:55:15.361 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/ 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 130553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 99049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/ 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/ 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/ 2024-01-30T07:55:15.362 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/ 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/ 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/ 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-30T07:55:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 90345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/ 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 176761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1421529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-30T07:55:15.364 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 128569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-30T07:55:15.442 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-30T07:55:15.442 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 131337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 314553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/ 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 323745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/ 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 193497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 347257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1044793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-30T07:55:15.443 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 166193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/ 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 204345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/ 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 141225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-30T07:55:15.444 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/ 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dnet.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/ 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 281137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ethoc.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fealnx.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/ 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 90369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-30T07:55:15.445 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 295481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 584497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 246209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 937673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 287305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/ 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 514569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 93497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-30T07:55:15.446 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 734353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 151769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 86921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/jme.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/ 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/ 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 727473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 278961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-30T07:55:15.447 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1118201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 95665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/ 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/ 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 150905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-30T07:55:15.448 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/ 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 136721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/ 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/ 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 227897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 671937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/ 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/ 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-30T07:55:15.449 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 192353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/ 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 104241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/ 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1064737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/ 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/ 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/ 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-30T07:55:15.450 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/ 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 487593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/ 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 166097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/ 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-30T07:55:15.451 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/ 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 86529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/ 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/ 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/ 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/ 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/defxx.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/ 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 216985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-30T07:55:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/geneve.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/ 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 236225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/ 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ifb.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 85817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvlan.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvtap.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/ 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-30T07:55:15.453 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mii.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/netconsole.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/nlmon.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/ 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/amd.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm87xx.ko 2024-01-30T07:55:15.454 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/broadcom.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/cicada.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/davicom.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/et1011c.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/icplus.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/lxt.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/marvell.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 76409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/micrel.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/national.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 95561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/phylink.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/qsemi.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/realtek.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/smsc.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ste10Xp.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/vitesse.ko 2024-01-30T07:55:15.455 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/ 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/plip.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_async.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppoe.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppox.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pptp.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sb1000.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/ 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/slip.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sungem_phy.ko 2024-01-30T07:55:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/tap.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/ 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 107089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_random.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 86945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/veth.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/ 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 144361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/ 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 301281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/vxlan.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/ 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 144001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-30T07:55:15.457 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ntb.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/ 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/ 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 265777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme-core.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/ 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 131249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_cs.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 85377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_pc.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_serial.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/ 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/ 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-30T07:55:15.458 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/pci-stub.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/xen-pcifront.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/ 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/i82092.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 146289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pd6729.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/ 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/ 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/ 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-30T07:55:15.459 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/ 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/ 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/ 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/ 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acerhdf.ko 2024-01-30T07:55:15.460 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 132025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/hdaps.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/ 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel_ips.ko 2024-01-30T07:55:15.461 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/ 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-30T07:55:15.462 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9030_battery.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9052-battery.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/gpio-charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max14577_charger.ko 2024-01-30T07:55:15.463 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max17042_battery.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8903_charger.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8925_power.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/sbs-battery.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/test_power.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_power.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm8350_power.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/ 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/ 2024-01-30T07:55:15.464 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/ 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps_parport.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/pps_core.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp_kvm.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/ 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9052.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9055.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9063.ko 2024-01-30T07:55:15.465 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-em3027.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-30T07:55:15.466 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max6900.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8907.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8925.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8997.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8998.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-palmas.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-30T07:55:15.467 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-30T07:55:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-x1205.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 77617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-9xxx.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-sas.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-xxxx.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 135185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/BusLogic.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/a100u2w.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/ 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 271113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/advansys.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/ 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 356929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 296049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/ 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 189185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-30T07:55:15.469 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/am53c974.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/ 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/atp870u.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/ 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 247009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/ 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1171945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/bfa.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/ 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 237721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/ 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 115369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ch.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/ 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 308921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-30T07:55:15.470 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/ 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 76145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 146625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 75553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dc395x.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dmx3191d.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/ 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 212425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esp_scsi.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/ 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 158505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-30T07:55:15.471 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fdomain.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/ 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 263489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/fnic.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 201817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hpsa.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hptiop.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hv_storvsc.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/imm.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/initio.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 266537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ipr.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ips.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/ 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 317153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/isci.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-30T07:55:15.472 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/ 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 315209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/libfc.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 145585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/ 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 216441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/libsas.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/ 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2197481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/ 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 310841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 84649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/ 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 659801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/ 2024-01-30T07:55:15.473 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 119561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvumi.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/ 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/ 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 366401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 124633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pmcraid.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ppa.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla1280.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/ 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 85289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-30T07:55:15.474 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/ 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 559033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qlogicfas408.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/raid_class.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 261241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_debug.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 173937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 279313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ses.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 115889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/st.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/stex.ko 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-30T07:55:15.475 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 164961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/virtio_scsi.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/wd719x.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/xen-scsifront.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 129441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ssb.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/ 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/ 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 736769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/ 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_file.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_iblock.ko 2024-01-30T07:55:15.476 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 930697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_mod.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_pscsi.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_user.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/ 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 75593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/ 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/ 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-30T07:55:15.477 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ 2024-01-30T07:55:15.478 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/moxa.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/mxser.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_gsm.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_hdlc.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/nozomi.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/ 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/ 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_uart.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/arc_uart.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-30T07:55:15.479 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/ 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/rp2.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/ 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 535985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/ 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_aec.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_cif.ko 2024-01-30T07:55:15.480 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_mf624.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_netx.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pci_generic.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_sercos3.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/ 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/ 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 144617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-30T07:55:15.481 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/ 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-acm.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usblp.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usbtmc.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ulpi.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/ 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/ 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 454385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/ 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/ 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-30T07:55:15.482 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 92489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 85609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-30T07:55:15.483 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/ 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-30T07:55:15.484 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 161225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/ 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 157681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 76057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-30T07:55:15.485 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 75073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 65809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 156409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811_cs.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/ 2024-01-30T07:55:15.486 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/mdc800.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/microtek.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/adutux.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/appledisplay.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cytherm.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ehset.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi26.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi62.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ezusb.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/idmouse.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/iowarrior.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ldusb.ko 2024-01-30T07:55:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/legousbtower.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/lvstest.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/ 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usb3503.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usblcd.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbtest.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/uss720.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/yurex.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/ 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/usbmon.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/ 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 301697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-30T07:55:15.488 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/ 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-generic.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/aircable.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ark3116.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ch341.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cp210x.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cyberjack.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-30T07:55:15.489 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/empeg.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/f81232.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 175193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 137081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 124833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_ti.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipaq.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipw.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ir-usb.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 107521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-30T07:55:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mct_u232.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/metro-usb.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7720.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7840.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mxuport.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/navman.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/omninet.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/opticon.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 191801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/option.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/oti6858.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/pl2303.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcaux.ko 2024-01-30T07:55:15.491 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcserial.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/quatech2.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/safe_serial.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/sierra.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ssu100.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/symbolserial.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_debug.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usbserial.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/visor.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/whiteheat.ko 2024-01-30T07:55:15.492 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/uas.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-karma.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-30T07:55:15.493 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 180225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/usb-storage.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/ 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/ 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/ 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 154297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 77609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/ 2024-01-30T07:55:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_net.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_scsi.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/ 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/ 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/apple_bl.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/bd6107.ko 2024-01-30T07:55:15.495 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lcd.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-30T07:55:15.496 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/ 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2482.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2490.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/ 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-30T07:55:15.497 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/wire.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/acquirewdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/advantechwdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/dw_wdt.ko 2024-01-30T07:55:15.498 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/hpwdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/i6300esb.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ib700wdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ibmasr.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it87_wdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-30T07:55:15.499 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/machzwd.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/nv_tco.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/retu_wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-30T07:55:15.500 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/softdog.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/via_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wdt_pci.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/xen_wdt.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/ 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-evtchn.ko 2024-01-30T07:55:15.501 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntalloc.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntdev.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/ 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 176441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-privcmd.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-scsiback.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/ 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/ 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 166753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/9p.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/ 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/adfs.ko 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/ 2024-01-30T07:55:15.502 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 163449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/affs.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/ 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 935033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/kafs.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/ 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/autofs4.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/ 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/befs.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/ 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/bfs.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/binfmt_misc.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/ 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 3455857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/btrfs.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/ 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 306009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/cachefiles.ko 2024-01-30T07:55:15.503 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1336985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ceph.ko 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/ 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/coda.ko 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/ 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/configfs.ko 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/ 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/cramfs.ko 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/ 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 644073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/dlm.ko 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/ 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/efs.ko 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/ 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1506641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/f2fs.ko 2024-01-30T07:55:15.504 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/ 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/msdos.ko 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/ 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/freevxfs.ko 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/ 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 226481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/fscache.ko 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/ 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/cuse.ko 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/ 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1229913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/gfs2.ko 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/ 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 141985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/hfs.ko 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/ 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 223225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/hfsplus.ko 2024-01-30T07:55:15.505 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 193569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/hpfs.ko 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/isofs.ko 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 419881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/jfs.ko 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 282049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/lockd.ko 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/minix.ko 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 124649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/netfs.ko 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/ 2024-01-30T07:55:15.506 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/ 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/ 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 117465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1057969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfs.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv2.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 120265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv3.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2042153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv4.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/ 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/grace.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/nfs_acl.ko 2024-01-30T07:55:15.507 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/ 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1563929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/nfsd.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/ 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 590713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/nilfs2.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/ 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-celtic.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-centeuro.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-croatian.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-cyrillic.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-gaelic.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-greek.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-iceland.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-inuit.ko 2024-01-30T07:55:15.508 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-roman.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-romanian.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-turkish.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ascii.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1250.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1251.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1255.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp737.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp775.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp850.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp852.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp855.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp857.ko 2024-01-30T07:55:15.509 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp860.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp861.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp862.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp863.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp864.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp865.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp866.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp869.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp874.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 94137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp932.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 142673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp936.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 165745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp949.ko 2024-01-30T07:55:15.510 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 118121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp950.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_euc-jp.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-1.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-13.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-14.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-15.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-2.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-3.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-4.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-5.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-6.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-7.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-9.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-r.ko 2024-01-30T07:55:15.511 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-ru.ko 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-u.ko 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_utf8.ko 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 220553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ntfs.ko 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 244737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 440737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-30T07:55:15.512 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2593521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/ 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/omfs.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/ 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 370697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/overlay.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ramoops.ko 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/ 2024-01-30T07:55:15.513 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/qnx4.ko 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/ 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/qnx6.ko 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/ 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_tree.ko 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v1.ko 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v2.ko 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/ 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 532025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/reiserfs.ko 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/ 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/romfs.ko 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/ 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/ 2024-01-30T07:55:15.514 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2683249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/cifs.ko 2024-01-30T07:55:15.551 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/ 2024-01-30T07:55:15.551 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_arc4.ko 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_md4.ko 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/ 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 134777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/squashfs.ko 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/ 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 91249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/sysv.ko 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/ 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 248425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/udf.ko 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 162537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ufs.ko 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/ 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 4014433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/xfs.ko 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/ 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/ 2024-01-30T07:55:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/locktorture.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/ 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/test_udelay.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/torture.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc-itu-t.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc7.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc8.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/ 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libarc4.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libdes.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/interval_tree_test.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/libcrc32c.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lru_cache.ko 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/ 2024-01-30T07:55:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4_compress.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4hc_compress.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/ 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/cordic.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/memory-notifier-error-inject.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/notifier-error-inject.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/percpu_test.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/pm-notifier-error-inject.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/ 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 143353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/raid6_pq.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/rbtree_test.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/ 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-kstrtox.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-string_helpers.ko 2024-01-30T07:55:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 4876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_bpf.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_firmware.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_module.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_user_copy.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_bm.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_fsm.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_kmp.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/ 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/xz_dec_test.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/ 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/hwpoison-inject.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/ 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/6lowpan.ko 2024-01-30T07:55:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_dest.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_fragment.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_hop.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_mobility.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_routing.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_udp.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/ 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/garp.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/mrp.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/p8022.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/psnap.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/stp.ko 2024-01-30T07:55:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/ 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/8021q.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/ 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 198905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_fd.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_rdma.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_virtio.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/ 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 649977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/batman-adv.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/ 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 65137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/br_netfilter.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 785817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/bridge.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-30T07:55:15.557 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-30T07:55:15.558 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtables.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/ 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1046753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/libceph.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/ 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 126041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/pktgen.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/ 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 194529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_diag.ko 2024-01-30T07:55:15.559 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv4.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv6.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/ 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 390129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/dsa_core.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_brcm.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_dsa.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_none.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_trailer.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/ 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 99881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/hsr.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 255849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-30T07:55:15.560 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ah4.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/esp4.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/fou.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/gre.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/inet_diag.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_gre.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_tunnel.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_vti.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipcomp.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipip.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-30T07:55:15.561 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-30T07:55:15.562 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_bic.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_dctcp.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_diag.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_highspeed.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_htcp.ko 2024-01-30T07:55:15.563 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_hybla.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_illinois.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_lp.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_scalable.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_vegas.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_veno.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_westwood.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_yeah.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tunnel4.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_diag.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_tunnel.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ 2024-01-30T07:55:15.564 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ah6.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/esp6.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/fou6.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_gre.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 93977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_tunnel.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_vti.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ipcomp6.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/mip6.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-30T07:55:15.565 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-30T07:55:15.566 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/sit.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/tunnel6.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/ 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 84433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/af_key.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/ 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_core.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_eth.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip6.ko 2024-01-30T07:55:15.567 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_netlink.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ppp.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/ 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/lapb.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/ 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 268265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc2.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/ 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 290441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/mac802154.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/ 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/mpls_gso.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 118801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set.ko 2024-01-30T07:55:15.568 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 110753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-30T07:55:15.569 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 412561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-30T07:55:15.570 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conncount.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 411489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 118193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-30T07:55:15.571 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 91737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_log_syslog.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 96545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_irc.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_sip.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 614025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_tables.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink.ko 2024-01-30T07:55:15.572 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_log.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_chain_nat.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_compat.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_ct.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fib.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_hash.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_limit.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_log.ko 2024-01-30T07:55:15.573 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_masq.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_nat.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_numgen.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_osf.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_queue.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_redir.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject_inet.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_socket.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_synproxy.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_tproxy.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/x_tables.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_AUDIT.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-30T07:55:15.574 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CT.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_DSCP.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HL.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HMARK.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LED.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LOG.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NETMAP.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFLOG.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_RATEEST.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_SECMARK.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-30T07:55:15.575 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TEE.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TPROXY.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TRACE.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_addrtype.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_bpf.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cgroup.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cluster.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_comment.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connbytes.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlabel.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlimit.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connmark.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_conntrack.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cpu.ko 2024-01-30T07:55:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dccp.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_devgroup.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dscp.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ecn.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_esp.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hashlimit.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_helper.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hl.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipcomp.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_iprange.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipvs.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_l2tp.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_length.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_limit.ko 2024-01-30T07:55:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mac.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mark.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_multiport.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nat.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nfacct.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_osf.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_owner.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_physdev.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_pkttype.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_policy.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_quota.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_rateest.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_realm.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_recent.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_sctp.ko 2024-01-30T07:55:15.578 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_set.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_socket.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_state.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_statistic.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_string.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpmss.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpudp.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_time.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_u32.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/ 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/netlink_diag.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/ 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/nsh.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/ 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 383481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/openvswitch.ko 2024-01-30T07:55:15.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-geneve.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-gre.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-vxlan.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/ 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/af_packet_diag.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/ 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/phonet.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/pn_pep.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/ 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 252953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 164937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_rdma.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_tcp.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/ 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 818777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/rxrpc.ko 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/ 2024-01-30T07:55:15.580 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_csum.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_gact.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_ipt.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_mirred.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_nat.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_pedit.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_police.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_simple.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_skbedit.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_vlan.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_basic.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_bpf.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_cgroup.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_flow.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_fw.ko 2024-01-30T07:55:15.581 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_route.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_u32.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_cmp.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_ipset.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_meta.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_nbyte.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_text.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_u32.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_choke.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_codel.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_drr.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq_codel.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_gred.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hfsc.ko 2024-01-30T07:55:15.582 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hhf.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_htb.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_ingress.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio_lib.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_multiq.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_netem.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_pie.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_plug.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_prio.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_qfq.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_red.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfb.ko 2024-01-30T07:55:15.583 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfq.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_tbf.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_teql.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/ 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 932169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp_diag.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/ 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/ 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 336777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1518417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/sunrpc.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/ 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 708281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/ 2024-01-30T07:55:15.584 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/diag.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 866345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/tipc.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/ 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/unix_diag.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/ 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 86417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 98017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/ 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/x25.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/ 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_algo.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-30T07:55:15.585 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 104161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_user.ko 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/ 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/ 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/irqbypass.ko 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 641009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 625033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias.bin 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7677 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23634 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.alias.bin 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9916 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.bin 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70653 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.modinfo 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 147734 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 234045 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep.bin 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 210 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.devname 2024-01-30T07:55:15.586 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72797 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.order 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 879 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.softdep 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 255175 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 309826 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols.bin 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/ 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/ 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/ 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/ 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 171 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/changelog.Debian.gz 2024-01-30T07:55:15.587 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 691 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/copyright 2024-01-30T07:55:15.588 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gcd42140e6285 2024-01-30T07:55:15.588 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gcd42140e6285 2024-01-30T07:55:15.588 DEBUG:teuthology.orchestra.run.smithi125:> egrep '(submenu|menuentry.*6.7.0-gcd42140e6285).*{' /boot/grub/grub.cfg 2024-01-30T07:55:15.600 INFO:teuthology.orchestra.run.smithi125.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-30T07:55:15.600 INFO:teuthology.orchestra.run.smithi125.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-30T07:55:15.600 INFO:teuthology.orchestra.run.smithi125.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-30T07:55:15.601 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-30T07:55:15.601 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gcd42140e6285 2024-01-30T07:55:15.601 DEBUG:teuthology.orchestra.run.smithi125:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-30T07:55:15.644 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi125.front.sepia.ceph.com to complete... 2024-01-30T07:55:16.030 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub' 2024-01-30T07:55:16.031 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-30T07:55:16.059 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2024-01-30T07:55:16.235 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-30T07:55:16.241 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-30T07:55:16.473 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-30T07:55:16.479 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-30T07:55:16.525 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-30T07:55:16.532 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-30T07:55:16.664 INFO:teuthology.orchestra.run.smithi125.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-30T07:55:16.664 INFO:teuthology.orchestra.run.smithi125.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-30T07:55:16.664 INFO:teuthology.orchestra.run.smithi125.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-30T07:55:16.675 INFO:teuthology.orchestra.run.smithi125.stderr:done 2024-01-30T07:55:17.800 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-01-30T07:55:40.050 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-30T07:55:40.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-30T07:55:40.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:55:47.810 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-30T07:55:47.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-30T07:55:47.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:55:58.396 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-01-30T07:56:07.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-30T07:56:07.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:56:22.460 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-30T07:56:31.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-30T07:56:31.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:56:49.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-30T07:57:01.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-30T07:57:01.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:57:02.250 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-01-30T07:57:03.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-30T07:57:03.336 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.7.0-gcd42140e6285"... 2024-01-30T07:57:03.337 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2024-01-30T07:57:03.386 INFO:teuthology.orchestra.run.smithi125.stdout:6.7.0-gcd42140e6285 2024-01-30T07:57:03.386 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gcd42140e6285 vs 6.7.0-gcd42140e6285 2024-01-30T07:57:03.386 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-30T07:57:03.387 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-30T07:57:04.389 DEBUG:teuthology.parallel:result is None 2024-01-30T07:57:07.404 DEBUG:teuthology.orchestra.remote:timed out 2024-01-30T07:57:19.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-30T07:57:19.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T07:57:19.648 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-01-30T07:57:20.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-30T07:57:20.397 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-gcd42140e6285"... 2024-01-30T07:57:20.397 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-01-30T07:57:20.448 INFO:teuthology.orchestra.run.smithi050.stdout:6.7.0-gcd42140e6285 2024-01-30T07:57:20.448 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gcd42140e6285 vs 6.7.0-gcd42140e6285 2024-01-30T07:57:20.448 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-30T07:57:20.448 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-30T07:57:21.449 DEBUG:teuthology.parallel:result is None 2024-01-30T07:57:21.450 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-30T07:57:21.457 INFO:teuthology.task.internal:Creating test directory... 2024-01-30T07:57:21.457 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-30T07:57:21.460 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-30T07:57:21.469 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-30T07:57:21.480 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-30T07:57:21.492 INFO:teuthology.task.internal:Creating archive directory... 2024-01-30T07:57:21.492 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-30T07:57:21.511 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-30T07:57:21.537 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-30T07:57:21.544 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-30T07:57:21.544 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-30T07:57:21.575 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-30T07:57:21.652 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-30T07:57:21.675 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-30T07:57:21.675 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-30T07:57:21.700 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-30T07:57:21.703 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-30T07:57:21.712 INFO:teuthology.task.internal:Configuring sudo... 2024-01-30T07:57:21.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-30T07:57:21.715 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-30T07:57:21.736 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-30T07:57:21.785 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-30T07:57:21.785 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-30T07:57:21.788 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-30T07:57:21.797 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-30T07:57:21.845 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-30T07:57:21.897 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T07:57:21.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-30T07:57:21.972 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-30T07:57:21.981 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-30T07:57:22.030 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T07:57:22.030 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-30T07:57:22.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-01-30T07:57:22.106 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2024-01-30T07:57:22.236 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-30T07:57:22.243 INFO:teuthology.task.internal:Starting timer... 2024-01-30T07:57:22.243 INFO:teuthology.run_tasks:Running task pcp... 2024-01-30T07:57:22.258 INFO:teuthology.run_tasks:Running task selinux... 2024-01-30T07:57:22.267 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2024-01-30T07:57:22.267 DEBUG:teuthology.task.selinux:Excluding smithi125: OS 'ubuntu' does not support SELinux 2024-01-30T07:57:22.267 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-30T07:57:22.267 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-30T07:57:22.267 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-30T07:57:22.267 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-30T07:57:22.278 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-30T07:57:22.294 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-30T07:57:22.295 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi125.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-30T08:04:51.474 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi125.front.sepia.ceph.com')] 2024-01-30T08:04:51.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-30T08:04:51.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T08:04:51.561 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-01-30T08:04:51.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-01-30T08:04:51.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-30T08:04:51.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T08:04:51.768 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-01-30T08:04:51.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-30T08:04:51.879 INFO:teuthology.run_tasks:Running task clock... 2024-01-30T08:04:51.890 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-30T08:04:51.890 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-30T08:04:51.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-30T08:04:51.894 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-30T08:04:51.894 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-30T08:04:51.930 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-30T08:04:51.930 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Command line: ntpd -gq 2024-01-30T08:04:51.930 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: ---------------------------------------------------- 2024-01-30T08:04:51.930 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: ntp-4 is maintained by Network Time Foundation, 2024-01-30T08:04:51.930 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-30T08:04:51.930 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: corporation. Support and training for ntp-4 are 2024-01-30T08:04:51.931 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: available at https://www.nwtime.org/support 2024-01-30T08:04:51.931 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: ---------------------------------------------------- 2024-01-30T08:04:51.931 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: proto: precision = 0.043 usec (-24) 2024-01-30T08:04:51.931 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: basedate set to 2022-02-04 2024-01-30T08:04:51.931 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: gps base set to 2022-02-06 (week 2196) 2024-01-30T08:04:51.932 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-30T08:04:51.932 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-30T08:04:51.932 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-30T08:04:51.933 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: restrict ::: KOD does nothing without LIMITED. 2024-01-30T08:04:51.934 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Listen and drop on 0 v6wildcard [::]:123 2024-01-30T08:04:51.934 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-30T08:04:51.934 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Listen normally on 2 lo 127.0.0.1:123 2024-01-30T08:04:51.934 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Listen normally on 3 ens1f0 172.21.15.50:123 2024-01-30T08:04:51.934 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Listen normally on 4 lo [::1]:123 2024-01-30T08:04:51.934 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%4]:123 2024-01-30T08:04:51.934 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:51 ntpd[16762]: Listening on routing socket on fd #22 for interface updates 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Command line: ntpd -gq 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: ---------------------------------------------------- 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: ntp-4 is maintained by Network Time Foundation, 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: corporation. Support and training for ntp-4 are 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: available at https://www.nwtime.org/support 2024-01-30T08:04:51.960 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: ---------------------------------------------------- 2024-01-30T08:04:51.961 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: proto: precision = 0.042 usec (-24) 2024-01-30T08:04:51.961 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: basedate set to 2022-02-04 2024-01-30T08:04:51.961 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: gps base set to 2022-02-06 (week 2196) 2024-01-30T08:04:51.962 INFO:teuthology.orchestra.run.smithi125.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-30T08:04:51.962 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-30T08:04:51.962 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: restrict ::: KOD does nothing without LIMITED. 2024-01-30T08:04:51.962 INFO:teuthology.orchestra.run.smithi125.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-30T08:04:51.963 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Listen and drop on 0 v6wildcard [::]:123 2024-01-30T08:04:51.963 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-30T08:04:51.963 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Listen normally on 2 lo 127.0.0.1:123 2024-01-30T08:04:51.963 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Listen normally on 3 enp3s0f1 172.21.15.125:123 2024-01-30T08:04:51.963 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Listen normally on 4 lo [::1]:123 2024-01-30T08:04:51.964 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d739%5]:123 2024-01-30T08:04:51.964 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:51 ntpd[16865]: Listening on routing socket on fd #22 for interface updates 2024-01-30T08:04:52.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:52 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:52 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:52 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:52 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:52 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:52.959 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:52 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:52.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:52 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:53 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:53 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:54.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:54 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:54.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:54.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:54.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:54.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:54.963 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:54 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:55.960 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:55 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:55.960 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:55 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:56.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:56 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:56.964 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:56.965 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:56 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.932 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:58.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:58.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:58.933 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:58.933 INFO:teuthology.orchestra.run.smithi050.stdout:30 Jan 08:04:58 ntpd[16762]: ntpd: time slew -0.000217 s 2024-01-30T08:04:58.933 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.000217s 2024-01-30T08:04:58.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-30T08:04:58.934 INFO:teuthology.orchestra.run.smithi050.stderr:30 Jan 08:04:58 ntpd[16762]: can't open /var/log/ntpstats/loopstats.20240130: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: can't open /var/log/ntpstats/rawstats.20240130: Permission denied 2024-01-30T08:04:58.961 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-30T08:04:58.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: can't open /var/log/ntpstats/peerstats.20240130: Permission denied 2024-01-30T08:04:58.962 INFO:teuthology.orchestra.run.smithi125.stdout:30 Jan 08:04:58 ntpd[16865]: ntpd: time slew +0.001691 s 2024-01-30T08:04:58.962 INFO:teuthology.orchestra.run.smithi125.stdout:ntpd: time slew +0.001691s 2024-01-30T08:04:58.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-30T08:04:58.962 INFO:teuthology.orchestra.run.smithi125.stderr:30 Jan 08:04:58 ntpd[16865]: can't open /var/log/ntpstats/loopstats.20240130: Permission denied 2024-01-30T08:04:59.029 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-01-30T08:04:59.029 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-01-30T08:04:59.029 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.029 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.030 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.030 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.062 INFO:teuthology.orchestra.run.smithi125.stdout: remote refid st t when poll reach delay offset jitter 2024-01-30T08:04:59.062 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================== 2024-01-30T08:04:59.062 INFO:teuthology.orchestra.run.smithi125.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.062 INFO:teuthology.orchestra.run.smithi125.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.062 INFO:teuthology.orchestra.run.smithi125.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.062 INFO:teuthology.orchestra.run.smithi125.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:04:59.063 INFO:teuthology.run_tasks:Running task install... 2024-01-30T08:04:59.072 DEBUG:teuthology.task.install:project ceph 2024-01-30T08:04:59.072 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}} 2024-01-30T08:04:59.072 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'} 2024-01-30T08:04:59.072 INFO:teuthology.task.install:Using flavor: default 2024-01-30T08:04:59.078 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-30T08:04:59.078 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-30T08:04:59.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2024-01-30T08:04:59.079 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-key list | grep Ceph 2024-01-30T08:04:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-30T08:04:59.206 INFO:teuthology.orchestra.run.smithi125.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-30T08:04:59.238 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-30T08:04:59.238 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2024-01-30T08:04:59.239 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-30T08:04:59.239 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-30T08:04:59.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-30T08:04:59.256 INFO:teuthology.orchestra.run.smithi125.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-30T08:04:59.256 INFO:teuthology.orchestra.run.smithi125.stdout:uid [ unknown] Ceph.com (release key) 2024-01-30T08:04:59.257 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-30T08:04:59.257 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-30T08:04:59.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-30T08:04:59.457 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default/ 2024-01-30T08:04:59.457 INFO:teuthology.task.install.deb:Package version is 19.0.0-885-g661946e7-1jammy 2024-01-30T08:04:59.468 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default/ 2024-01-30T08:04:59.468 INFO:teuthology.task.install.deb:Package version is 19.0.0-885-g661946e7-1jammy 2024-01-30T08:04:59.632 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:04:59.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-30T08:04:59.634 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:04:59.635 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-30T08:04:59.654 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-get update 2024-01-30T08:04:59.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-01-30T08:04:59.850 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-30T08:04:59.865 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-30T08:04:59.869 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-30T08:04:59.887 INFO:teuthology.orchestra.run.smithi125.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy InRelease 2024-01-30T08:04:59.900 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-30T08:04:59.910 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-30T08:04:59.932 INFO:teuthology.orchestra.run.smithi125.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-30T08:04:59.964 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2024-01-30T08:04:59.977 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-30T08:05:00.007 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy InRelease 2024-01-30T08:05:00.021 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-30T08:05:00.061 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-30T08:05:00.102 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-30T08:05:00.147 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-30T08:05:00.208 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2024-01-30T08:05:00.460 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 28.8 kB in 1s (50.3 kB/s) 2024-01-30T08:05:01.446 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-01-30T08:05:01.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-885-g661946e7-1jammy cephadm=19.0.0-885-g661946e7-1jammy ceph-mds=19.0.0-885-g661946e7-1jammy ceph-mgr=19.0.0-885-g661946e7-1jammy ceph-common=19.0.0-885-g661946e7-1jammy ceph-fuse=19.0.0-885-g661946e7-1jammy ceph-test=19.0.0-885-g661946e7-1jammy ceph-volume=19.0.0-885-g661946e7-1jammy radosgw=19.0.0-885-g661946e7-1jammy python3-rados=19.0.0-885-g661946e7-1jammy python3-rgw=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy python3-rbd=19.0.0-885-g661946e7-1jammy libcephfs2=19.0.0-885-g661946e7-1jammy libcephfs-dev=19.0.0-885-g661946e7-1jammy librados2=19.0.0-885-g661946e7-1jammy librbd1=19.0.0-885-g661946e7-1jammy rbd-fuse=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy cephfs-shell=19.0.0-885-g661946e7-1jammy cephfs-top=19.0.0-885-g661946e7-1jammy cephfs-mirror=19.0.0-885-g661946e7-1jammy 2024-01-30T08:05:01.537 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-01-30T08:05:01.708 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-01-30T08:05:01.709 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-01-30T08:05:01.868 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-01-30T08:05:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-30T08:05:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-30T08:05:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-30T08:05:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-30T08:05:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-30T08:05:01.869 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-30T08:05:01.869 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-01-30T08:05:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-30T08:05:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-30T08:05:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-30T08:05:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-30T08:05:01.871 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-30T08:05:01.871 INFO:teuthology.orchestra.run.smithi050.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-30T08:05:01.871 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-30T08:05:01.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-30T08:05:01.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-30T08:05:01.872 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-01-30T08:05:01.873 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-30T08:05:02.029 INFO:teuthology.orchestra.run.smithi050.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-30T08:05:02.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-30T08:05:02.032 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-30T08:05:02.032 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-30T08:05:02.032 INFO:teuthology.orchestra.run.smithi050.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-30T08:05:02.032 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-30T08:05:02.032 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-30T08:05:02.032 INFO:teuthology.orchestra.run.smithi050.stdout: socat unzip xmlstarlet zip 2024-01-30T08:05:02.376 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-30T08:05:02.376 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 173 MB of archives. 2024-01-30T08:05:02.376 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-30T08:05:02.376 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-885-g661946e7-1jammy [3,514 kB] 2024-01-30T08:05:02.632 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-30T08:05:02.666 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-30T08:05:02.687 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-30T08:05:02.768 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-30T08:05:02.808 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-30T08:05:02.815 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-30T08:05:02.843 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-30T08:05:03.009 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-30T08:05:03.015 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-30T08:05:03.025 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-30T08:05:03.028 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-30T08:05:03.028 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-30T08:05:03.035 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-30T08:05:03.036 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-30T08:05:03.039 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-30T08:05:03.039 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-30T08:05:03.040 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-30T08:05:03.086 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-30T08:05:03.090 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-30T08:05:03.094 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-30T08:05:03.095 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-30T08:05:03.157 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-30T08:05:03.158 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-30T08:05:03.159 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-30T08:05:03.159 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-30T08:05:03.160 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-30T08:05:03.160 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-30T08:05:03.161 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-30T08:05:03.161 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-30T08:05:03.201 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-30T08:05:03.203 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-30T08:05:03.251 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-30T08:05:03.251 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-30T08:05:03.252 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-30T08:05:03.253 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-30T08:05:03.253 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-30T08:05:03.255 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-30T08:05:03.255 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-30T08:05:03.256 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-30T08:05:03.262 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-30T08:05:03.301 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-30T08:05:03.301 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-30T08:05:03.310 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-30T08:05:03.312 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-30T08:05:03.315 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-30T08:05:03.316 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-30T08:05:03.317 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-30T08:05:03.319 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-30T08:05:03.322 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-30T08:05:03.329 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-885-g661946e7-1jammy [3,209 kB] 2024-01-30T08:05:03.355 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-30T08:05:03.373 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-30T08:05:03.376 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-30T08:05:03.517 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-30T08:05:03.518 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-01-30T08:05:03.525 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-30T08:05:03.525 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-30T08:05:03.527 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-30T08:05:03.630 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-30T08:05:03.632 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-30T08:05:03.633 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-30T08:05:03.650 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-30T08:05:03.651 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-30T08:05:03.651 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-30T08:05:03.652 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-30T08:05:03.653 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-30T08:05:03.654 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-30T08:05:03.671 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-30T08:05:03.694 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-30T08:05:03.706 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-30T08:05:03.712 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-30T08:05:03.716 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-30T08:05:03.718 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-30T08:05:03.728 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-30T08:05:03.736 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-30T08:05:03.737 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-30T08:05:03.741 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-30T08:05:03.770 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-30T08:05:03.781 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-30T08:05:03.782 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-30T08:05:03.790 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-30T08:05:03.790 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-30T08:05:03.818 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-30T08:05:03.819 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-30T08:05:03.822 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-30T08:05:03.823 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-30T08:05:03.842 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-30T08:05:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-30T08:05:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-30T08:05:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-30T08:05:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-30T08:05:04.209 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-885-g661946e7-1jammy [710 kB] 2024-01-30T08:05:04.332 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-885-g661946e7-1jammy [356 kB] 2024-01-30T08:05:04.400 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-885-g661946e7-1jammy [32.8 kB] 2024-01-30T08:05:04.402 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-885-g661946e7-1jammy [180 kB] 2024-01-30T08:05:04.437 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-885-g661946e7-1jammy [64.1 kB] 2024-01-30T08:05:04.443 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-885-g661946e7-1jammy [330 kB] 2024-01-30T08:05:04.495 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-885-g661946e7-1jammy [6,233 kB] 2024-01-30T08:05:05.808 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-885-g661946e7-1jammy [112 kB] 2024-01-30T08:05:05.829 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-885-g661946e7-1jammy [465 kB] 2024-01-30T08:05:05.926 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-885-g661946e7-1jammy [23.0 MB] 2024-01-30T08:05:08.527 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-30T08:05:08.547 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-30T08:05:08.566 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-30T08:05:09.000 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 28.8 kB in 9s (3,160 B/s) 2024-01-30T08:05:09.387 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-885-g661946e7-1jammy [5,059 kB] 2024-01-30T08:05:09.927 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2024-01-30T08:05:09.941 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-885-g661946e7-1jammy cephadm=19.0.0-885-g661946e7-1jammy ceph-mds=19.0.0-885-g661946e7-1jammy ceph-mgr=19.0.0-885-g661946e7-1jammy ceph-common=19.0.0-885-g661946e7-1jammy ceph-fuse=19.0.0-885-g661946e7-1jammy ceph-test=19.0.0-885-g661946e7-1jammy ceph-volume=19.0.0-885-g661946e7-1jammy radosgw=19.0.0-885-g661946e7-1jammy python3-rados=19.0.0-885-g661946e7-1jammy python3-rgw=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy python3-rbd=19.0.0-885-g661946e7-1jammy libcephfs2=19.0.0-885-g661946e7-1jammy libcephfs-dev=19.0.0-885-g661946e7-1jammy librados2=19.0.0-885-g661946e7-1jammy librbd1=19.0.0-885-g661946e7-1jammy rbd-fuse=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy cephfs-shell=19.0.0-885-g661946e7-1jammy cephfs-top=19.0.0-885-g661946e7-1jammy cephfs-mirror=19.0.0-885-g661946e7-1jammy 2024-01-30T08:05:09.970 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-885-g661946e7-1jammy [240 kB] 2024-01-30T08:05:09.999 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-885-g661946e7-1jammy [124 kB] 2024-01-30T08:05:10.014 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2024-01-30T08:05:10.024 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-885-g661946e7-1jammy [1,518 kB] 2024-01-30T08:05:10.186 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2024-01-30T08:05:10.186 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2024-01-30T08:05:10.191 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-885-g661946e7-1jammy [6,239 kB] 2024-01-30T08:05:10.346 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages were automatically installed and are no longer required: 2024-01-30T08:05:10.346 INFO:teuthology.orchestra.run.smithi125.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-30T08:05:10.346 INFO:teuthology.orchestra.run.smithi125.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-30T08:05:10.346 INFO:teuthology.orchestra.run.smithi125.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-30T08:05:10.347 INFO:teuthology.orchestra.run.smithi125.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-30T08:05:10.347 INFO:teuthology.orchestra.run.smithi125.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-30T08:05:10.347 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout:The following additional packages will be installed: 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-30T08:05:10.349 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-30T08:05:10.350 INFO:teuthology.orchestra.run.smithi125.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout:Suggested packages: 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-30T08:05:10.351 INFO:teuthology.orchestra.run.smithi125.stdout:Recommended packages: 2024-01-30T08:05:10.352 INFO:teuthology.orchestra.run.smithi125.stdout: btrfs-tools 2024-01-30T08:05:10.500 INFO:teuthology.orchestra.run.smithi125.stdout:The following NEW packages will be installed: 2024-01-30T08:05:10.500 INFO:teuthology.orchestra.run.smithi125.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-30T08:05:10.500 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-30T08:05:10.500 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-30T08:05:10.500 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-30T08:05:10.500 INFO:teuthology.orchestra.run.smithi125.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-30T08:05:10.501 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-30T08:05:10.502 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-30T08:05:10.502 INFO:teuthology.orchestra.run.smithi125.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-30T08:05:10.502 INFO:teuthology.orchestra.run.smithi125.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-30T08:05:10.502 INFO:teuthology.orchestra.run.smithi125.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-30T08:05:10.502 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-30T08:05:10.502 INFO:teuthology.orchestra.run.smithi125.stdout: socat unzip xmlstarlet zip 2024-01-30T08:05:10.572 INFO:teuthology.orchestra.run.smithi125.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-30T08:05:10.572 INFO:teuthology.orchestra.run.smithi125.stdout:Need to get 173 MB of archives. 2024-01-30T08:05:10.572 INFO:teuthology.orchestra.run.smithi125.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-30T08:05:10.572 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-30T08:05:10.592 INFO:teuthology.orchestra.run.smithi125.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-30T08:05:10.604 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-30T08:05:10.651 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-30T08:05:10.674 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-30T08:05:10.677 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-30T08:05:10.689 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-30T08:05:10.723 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-885-g661946e7-1jammy [3,514 kB] 2024-01-30T08:05:10.733 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-30T08:05:10.736 INFO:teuthology.orchestra.run.smithi125.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-30T08:05:10.744 INFO:teuthology.orchestra.run.smithi125.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-30T08:05:10.748 INFO:teuthology.orchestra.run.smithi125.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-30T08:05:10.752 INFO:teuthology.orchestra.run.smithi125.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-30T08:05:10.755 INFO:teuthology.orchestra.run.smithi125.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-30T08:05:10.757 INFO:teuthology.orchestra.run.smithi125.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-30T08:05:10.759 INFO:teuthology.orchestra.run.smithi125.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-30T08:05:10.760 INFO:teuthology.orchestra.run.smithi125.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-30T08:05:10.760 INFO:teuthology.orchestra.run.smithi125.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-30T08:05:10.776 INFO:teuthology.orchestra.run.smithi125.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-30T08:05:10.778 INFO:teuthology.orchestra.run.smithi125.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-30T08:05:10.780 INFO:teuthology.orchestra.run.smithi125.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-30T08:05:10.780 INFO:teuthology.orchestra.run.smithi125.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-30T08:05:10.795 INFO:teuthology.orchestra.run.smithi125.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-30T08:05:10.796 INFO:teuthology.orchestra.run.smithi125.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-30T08:05:10.797 INFO:teuthology.orchestra.run.smithi125.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-30T08:05:10.797 INFO:teuthology.orchestra.run.smithi125.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-30T08:05:10.797 INFO:teuthology.orchestra.run.smithi125.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-30T08:05:10.798 INFO:teuthology.orchestra.run.smithi125.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-30T08:05:10.815 INFO:teuthology.orchestra.run.smithi125.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-30T08:05:10.815 INFO:teuthology.orchestra.run.smithi125.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-30T08:05:10.818 INFO:teuthology.orchestra.run.smithi125.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-30T08:05:10.818 INFO:teuthology.orchestra.run.smithi125.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-30T08:05:10.834 INFO:teuthology.orchestra.run.smithi125.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-30T08:05:10.835 INFO:teuthology.orchestra.run.smithi125.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-30T08:05:10.836 INFO:teuthology.orchestra.run.smithi125.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-30T08:05:10.836 INFO:teuthology.orchestra.run.smithi125.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-30T08:05:10.837 INFO:teuthology.orchestra.run.smithi125.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-30T08:05:10.838 INFO:teuthology.orchestra.run.smithi125.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-30T08:05:10.854 INFO:teuthology.orchestra.run.smithi125.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-30T08:05:10.854 INFO:teuthology.orchestra.run.smithi125.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-30T08:05:10.859 INFO:teuthology.orchestra.run.smithi125.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-30T08:05:10.859 INFO:teuthology.orchestra.run.smithi125.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-30T08:05:10.873 INFO:teuthology.orchestra.run.smithi125.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-30T08:05:10.873 INFO:teuthology.orchestra.run.smithi125.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-30T08:05:10.875 INFO:teuthology.orchestra.run.smithi125.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-30T08:05:10.877 INFO:teuthology.orchestra.run.smithi125.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-30T08:05:10.877 INFO:teuthology.orchestra.run.smithi125.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-30T08:05:10.879 INFO:teuthology.orchestra.run.smithi125.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-30T08:05:10.892 INFO:teuthology.orchestra.run.smithi125.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-30T08:05:10.895 INFO:teuthology.orchestra.run.smithi125.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-30T08:05:10.895 INFO:teuthology.orchestra.run.smithi125.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-30T08:05:10.896 INFO:teuthology.orchestra.run.smithi125.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-30T08:05:10.899 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-885-g661946e7-1jammy [22.7 MB] 2024-01-30T08:05:10.912 INFO:teuthology.orchestra.run.smithi125.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-30T08:05:10.964 INFO:teuthology.orchestra.run.smithi125.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-30T08:05:10.965 INFO:teuthology.orchestra.run.smithi125.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-01-30T08:05:10.967 INFO:teuthology.orchestra.run.smithi125.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-30T08:05:10.967 INFO:teuthology.orchestra.run.smithi125.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-30T08:05:10.968 INFO:teuthology.orchestra.run.smithi125.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-30T08:05:10.988 INFO:teuthology.orchestra.run.smithi125.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-30T08:05:10.990 INFO:teuthology.orchestra.run.smithi125.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-30T08:05:10.991 INFO:teuthology.orchestra.run.smithi125.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-30T08:05:11.010 INFO:teuthology.orchestra.run.smithi125.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-30T08:05:11.010 INFO:teuthology.orchestra.run.smithi125.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-30T08:05:11.018 INFO:teuthology.orchestra.run.smithi125.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-30T08:05:11.019 INFO:teuthology.orchestra.run.smithi125.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-30T08:05:11.020 INFO:teuthology.orchestra.run.smithi125.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-30T08:05:11.020 INFO:teuthology.orchestra.run.smithi125.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-30T08:05:11.021 INFO:teuthology.orchestra.run.smithi125.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-30T08:05:11.022 INFO:teuthology.orchestra.run.smithi125.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-30T08:05:11.025 INFO:teuthology.orchestra.run.smithi125.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-30T08:05:11.037 INFO:teuthology.orchestra.run.smithi125.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-30T08:05:11.039 INFO:teuthology.orchestra.run.smithi125.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-30T08:05:11.040 INFO:teuthology.orchestra.run.smithi125.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-30T08:05:11.057 INFO:teuthology.orchestra.run.smithi125.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-30T08:05:11.060 INFO:teuthology.orchestra.run.smithi125.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-30T08:05:11.060 INFO:teuthology.orchestra.run.smithi125.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-30T08:05:11.062 INFO:teuthology.orchestra.run.smithi125.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-30T08:05:11.062 INFO:teuthology.orchestra.run.smithi125.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-30T08:05:11.067 INFO:teuthology.orchestra.run.smithi125.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-30T08:05:11.068 INFO:teuthology.orchestra.run.smithi125.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-30T08:05:11.077 INFO:teuthology.orchestra.run.smithi125.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-30T08:05:11.077 INFO:teuthology.orchestra.run.smithi125.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-30T08:05:11.078 INFO:teuthology.orchestra.run.smithi125.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-30T08:05:11.096 INFO:teuthology.orchestra.run.smithi125.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-30T08:05:11.098 INFO:teuthology.orchestra.run.smithi125.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-30T08:05:11.100 INFO:teuthology.orchestra.run.smithi125.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-30T08:05:11.108 INFO:teuthology.orchestra.run.smithi125.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-30T08:05:11.109 INFO:teuthology.orchestra.run.smithi125.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-30T08:05:11.109 INFO:teuthology.orchestra.run.smithi125.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-30T08:05:11.111 INFO:teuthology.orchestra.run.smithi125.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-30T08:05:11.134 INFO:teuthology.orchestra.run.smithi125.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-30T08:05:11.213 INFO:teuthology.orchestra.run.smithi125.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-885-g661946e7-1jammy [3,209 kB] 2024-01-30T08:05:11.394 INFO:teuthology.orchestra.run.smithi125.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-885-g661946e7-1jammy [710 kB] 2024-01-30T08:05:11.430 INFO:teuthology.orchestra.run.smithi125.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-885-g661946e7-1jammy [356 kB] 2024-01-30T08:05:11.440 INFO:teuthology.orchestra.run.smithi125.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-885-g661946e7-1jammy [32.8 kB] 2024-01-30T08:05:11.462 INFO:teuthology.orchestra.run.smithi125.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-885-g661946e7-1jammy [180 kB] 2024-01-30T08:05:11.463 INFO:teuthology.orchestra.run.smithi125.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-885-g661946e7-1jammy [64.1 kB] 2024-01-30T08:05:11.464 INFO:teuthology.orchestra.run.smithi125.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-885-g661946e7-1jammy [330 kB] 2024-01-30T08:05:11.472 INFO:teuthology.orchestra.run.smithi125.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-885-g661946e7-1jammy [6,233 kB] 2024-01-30T08:05:11.766 INFO:teuthology.orchestra.run.smithi125.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-885-g661946e7-1jammy [112 kB] 2024-01-30T08:05:11.767 INFO:teuthology.orchestra.run.smithi125.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-885-g661946e7-1jammy [465 kB] 2024-01-30T08:05:11.794 INFO:teuthology.orchestra.run.smithi125.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-885-g661946e7-1jammy [23.0 MB] 2024-01-30T08:05:12.728 INFO:teuthology.orchestra.run.smithi125.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-885-g661946e7-1jammy [5,059 kB] 2024-01-30T08:05:12.926 INFO:teuthology.orchestra.run.smithi125.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-885-g661946e7-1jammy [240 kB] 2024-01-30T08:05:12.931 INFO:teuthology.orchestra.run.smithi125.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-885-g661946e7-1jammy [124 kB] 2024-01-30T08:05:12.935 INFO:teuthology.orchestra.run.smithi125.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-885-g661946e7-1jammy [1,518 kB] 2024-01-30T08:05:12.992 INFO:teuthology.orchestra.run.smithi125.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-885-g661946e7-1jammy [6,239 kB] 2024-01-30T08:05:13.222 INFO:teuthology.orchestra.run.smithi125.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-885-g661946e7-1jammy [22.7 MB] 2024-01-30T08:05:14.115 INFO:teuthology.orchestra.run.smithi125.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-885-g661946e7-1jammy [14.0 kB] 2024-01-30T08:05:14.115 INFO:teuthology.orchestra.run.smithi125.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-885-g661946e7-1jammy [865 kB] 2024-01-30T08:05:14.140 INFO:teuthology.orchestra.run.smithi125.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-885-g661946e7-1jammy [2,183 kB] 2024-01-30T08:05:14.227 INFO:teuthology.orchestra.run.smithi125.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-885-g661946e7-1jammy [770 kB] 2024-01-30T08:05:14.253 INFO:teuthology.orchestra.run.smithi125.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-885-g661946e7-1jammy [139 kB] 2024-01-30T08:05:14.257 INFO:teuthology.orchestra.run.smithi125.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-885-g661946e7-1jammy [1,876 kB] 2024-01-30T08:05:14.312 INFO:teuthology.orchestra.run.smithi125.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-885-g661946e7-1jammy [8,625 kB] 2024-01-30T08:05:14.634 INFO:teuthology.orchestra.run.smithi125.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-885-g661946e7-1jammy [14.2 kB] 2024-01-30T08:05:14.634 INFO:teuthology.orchestra.run.smithi125.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-885-g661946e7-1jammy [48.9 MB] 2024-01-30T08:05:15.591 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-885-g661946e7-1jammy [14.0 kB] 2024-01-30T08:05:15.591 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-885-g661946e7-1jammy [865 kB] 2024-01-30T08:05:15.753 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-885-g661946e7-1jammy [2,183 kB] 2024-01-30T08:05:16.359 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-885-g661946e7-1jammy [770 kB] 2024-01-30T08:05:16.503 INFO:teuthology.orchestra.run.smithi125.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-885-g661946e7-1jammy [121 kB] 2024-01-30T08:05:16.504 INFO:teuthology.orchestra.run.smithi125.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-885-g661946e7-1jammy [226 kB] 2024-01-30T08:05:16.506 INFO:teuthology.orchestra.run.smithi125.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-885-g661946e7-1jammy [34.0 kB] 2024-01-30T08:05:16.506 INFO:teuthology.orchestra.run.smithi125.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-885-g661946e7-1jammy [23.4 kB] 2024-01-30T08:05:16.507 INFO:teuthology.orchestra.run.smithi125.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-885-g661946e7-1jammy [38.4 kB] 2024-01-30T08:05:16.507 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-885-g661946e7-1jammy [139 kB] 2024-01-30T08:05:16.508 INFO:teuthology.orchestra.run.smithi125.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-885-g661946e7-1jammy [12.3 MB] 2024-01-30T08:05:16.620 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-885-g661946e7-1jammy [1,876 kB] 2024-01-30T08:05:16.960 INFO:teuthology.orchestra.run.smithi125.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-885-g661946e7-1jammy [91.7 kB] 2024-01-30T08:05:17.010 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-885-g661946e7-1jammy [8,625 kB] 2024-01-30T08:05:17.587 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 173 MB in 6s (26.8 MB/s) 2024-01-30T08:05:17.737 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-30T08:05:17.803 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-30T08:05:17.806 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-30T08:05:17.844 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-30T08:05:18.147 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-30T08:05:18.160 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-30T08:05:18.175 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-885-g661946e7-1jammy [14.2 kB] 2024-01-30T08:05:18.175 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-885-g661946e7-1jammy [48.9 MB] 2024-01-30T08:05:18.205 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-30T08:05:18.466 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cmd2. 2024-01-30T08:05:18.479 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-30T08:05:18.525 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-30T08:05:18.836 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-30T08:05:18.849 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-30T08:05:18.936 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-30T08:05:19.281 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-30T08:05:19.295 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-30T08:05:19.339 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-30T08:05:19.726 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-30T08:05:19.740 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-30T08:05:19.792 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-30T08:05:20.188 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-30T08:05:20.202 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-30T08:05:20.245 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:05:20.832 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-30T08:05:20.847 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-30T08:05:20.890 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:05:21.243 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-30T08:05:21.258 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-30T08:05:21.301 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:05:21.655 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-30T08:05:21.669 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-30T08:05:21.713 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-30T08:05:22.015 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librados2. 2024-01-30T08:05:22.030 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../010-librados2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:22.065 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:22.468 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librbd1. 2024-01-30T08:05:22.482 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../011-librbd1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:22.526 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:22.946 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libcephfs2. 2024-01-30T08:05:22.960 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:22.988 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-885-g661946e7-1jammy [121 kB] 2024-01-30T08:05:22.989 INFO:teuthology.orchestra.run.smithi050.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-885-g661946e7-1jammy [226 kB] 2024-01-30T08:05:23.004 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:23.005 INFO:teuthology.orchestra.run.smithi050.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-885-g661946e7-1jammy [34.0 kB] 2024-01-30T08:05:23.024 INFO:teuthology.orchestra.run.smithi050.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-885-g661946e7-1jammy [23.4 kB] 2024-01-30T08:05:23.025 INFO:teuthology.orchestra.run.smithi050.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-885-g661946e7-1jammy [38.4 kB] 2024-01-30T08:05:23.025 INFO:teuthology.orchestra.run.smithi050.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-885-g661946e7-1jammy [12.3 MB] 2024-01-30T08:05:23.290 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rados. 2024-01-30T08:05:23.304 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../013-python3-rados_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:23.348 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:23.642 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-30T08:05:23.656 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:23.691 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:23.919 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cephfs. 2024-01-30T08:05:23.934 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:23.977 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:24.096 INFO:teuthology.orchestra.run.smithi050.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-885-g661946e7-1jammy [91.7 kB] 2024-01-30T08:05:24.330 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-30T08:05:24.344 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:24.388 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:24.708 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-prettytable. 2024-01-30T08:05:24.723 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-30T08:05:24.762 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 173 MB in 22s (7,844 kB/s) 2024-01-30T08:05:24.766 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-30T08:05:24.911 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-30T08:05:24.980 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-30T08:05:24.983 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-30T08:05:25.027 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rbd. 2024-01-30T08:05:25.027 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-30T08:05:25.041 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:25.077 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:25.288 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-30T08:05:25.302 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-30T08:05:25.338 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-30T08:05:25.371 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-30T08:05:25.386 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-30T08:05:25.463 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-30T08:05:25.641 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cmd2. 2024-01-30T08:05:25.655 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-30T08:05:25.699 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-30T08:05:25.749 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-30T08:05:25.763 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-30T08:05:25.807 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-30T08:05:26.036 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-30T08:05:26.051 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-30T08:05:26.118 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-30T08:05:26.133 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-30T08:05:26.136 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-30T08:05:26.176 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-30T08:05:26.480 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package lua5.1. 2024-01-30T08:05:26.481 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-30T08:05:26.494 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-30T08:05:26.497 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-30T08:05:26.530 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-30T08:05:26.539 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-30T08:05:26.851 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-30T08:05:26.866 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package lua-any. 2024-01-30T08:05:26.867 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-30T08:05:26.880 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-30T08:05:26.901 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-30T08:05:26.924 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-30T08:05:27.185 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package zip. 2024-01-30T08:05:27.200 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-30T08:05:27.243 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking zip (3.0-12build2) ... 2024-01-30T08:05:27.329 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-30T08:05:27.345 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-30T08:05:27.396 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:05:27.546 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package unzip. 2024-01-30T08:05:27.561 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-30T08:05:27.596 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-30T08:05:27.816 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-30T08:05:27.832 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-30T08:05:27.874 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:05:28.008 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package luarocks. 2024-01-30T08:05:28.022 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-30T08:05:28.066 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-30T08:05:28.194 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-30T08:05:28.210 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-30T08:05:28.244 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:05:28.432 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librgw2. 2024-01-30T08:05:28.445 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../027-librgw2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:28.490 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:28.623 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-30T08:05:28.638 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-30T08:05:28.680 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-30T08:05:28.993 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rgw. 2024-01-30T08:05:29.008 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:29.009 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librados2. 2024-01-30T08:05:29.025 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-librados2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:29.052 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:29.072 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:29.337 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-30T08:05:29.351 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-30T08:05:29.387 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-30T08:05:29.605 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librbd1. 2024-01-30T08:05:29.621 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-librbd1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:29.680 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:29.706 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libradosstriper1. 2024-01-30T08:05:29.721 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:29.765 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:30.067 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2024-01-30T08:05:30.082 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:30.124 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:30.193 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-common. 2024-01-30T08:05:30.208 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../031-ceph-common_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:30.243 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:30.385 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2024-01-30T08:05:30.400 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-rados_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:30.444 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:30.788 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-30T08:05:30.804 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:30.846 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:31.099 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2024-01-30T08:05:31.114 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:31.157 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:31.452 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-30T08:05:31.467 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:31.490 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-base. 2024-01-30T08:05:31.501 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:31.504 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../032-ceph-base_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:31.548 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:31.838 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2024-01-30T08:05:31.853 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-30T08:05:31.896 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-30T08:05:32.135 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-30T08:05:32.149 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2024-01-30T08:05:32.149 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-30T08:05:32.164 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:32.194 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-30T08:05:32.207 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:32.488 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cheroot. 2024-01-30T08:05:32.502 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-30T08:05:32.538 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-30T08:05:32.560 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-30T08:05:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-30T08:05:32.618 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-30T08:05:32.816 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-30T08:05:32.830 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-30T08:05:32.866 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-30T08:05:32.904 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-30T08:05:32.920 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-30T08:05:32.962 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-30T08:05:33.177 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-30T08:05:33.192 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-30T08:05:33.236 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-30T08:05:33.240 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-30T08:05:33.256 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-30T08:05:33.299 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-30T08:05:33.563 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-30T08:05:33.578 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-30T08:05:33.621 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-30T08:05:33.635 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua5.1. 2024-01-30T08:05:33.651 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-30T08:05:33.693 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-30T08:05:33.891 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-tempora. 2024-01-30T08:05:33.905 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-30T08:05:33.940 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-30T08:05:34.038 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-any. 2024-01-30T08:05:34.054 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-30T08:05:34.097 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-30T08:05:34.210 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-portend. 2024-01-30T08:05:34.225 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-30T08:05:34.268 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-30T08:05:34.316 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package zip. 2024-01-30T08:05:34.331 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-30T08:05:34.366 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking zip (3.0-12build2) ... 2024-01-30T08:05:34.571 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-30T08:05:34.585 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-30T08:05:34.629 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-30T08:05:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package unzip. 2024-01-30T08:05:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-30T08:05:34.860 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-30T08:05:34.957 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-30T08:05:34.972 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-30T08:05:35.015 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-30T08:05:35.352 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-natsort. 2024-01-30T08:05:35.366 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-30T08:05:35.410 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-30T08:05:35.738 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-logutils. 2024-01-30T08:05:35.753 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-30T08:05:35.797 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-30T08:05:35.940 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package luarocks. 2024-01-30T08:05:35.955 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-30T08:05:36.014 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-30T08:05:36.107 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-30T08:05:36.122 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-30T08:05:36.168 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-30T08:05:36.389 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2024-01-30T08:05:36.402 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-mako. 2024-01-30T08:05:36.403 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-librgw2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:36.417 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-30T08:05:36.439 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:36.452 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-30T08:05:36.772 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-30T08:05:36.787 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-30T08:05:36.830 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-30T08:05:36.866 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2024-01-30T08:05:36.881 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:36.924 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:37.158 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-30T08:05:37.172 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-30T08:05:37.216 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-30T08:05:37.310 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-30T08:05:37.325 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-30T08:05:37.369 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-30T08:05:37.527 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webob. 2024-01-30T08:05:37.542 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-30T08:05:37.585 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-30T08:05:37.688 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2024-01-30T08:05:37.704 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:37.747 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:37.913 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-waitress. 2024-01-30T08:05:37.928 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-30T08:05:37.965 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-30T08:05:38.142 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2024-01-30T08:05:38.157 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-ceph-common_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:38.191 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:38.282 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-tempita. 2024-01-30T08:05:38.297 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-30T08:05:38.341 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-30T08:05:38.652 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-paste. 2024-01-30T08:05:38.666 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-30T08:05:38.710 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-30T08:05:39.021 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-30T08:05:39.035 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-30T08:05:39.080 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-30T08:05:39.314 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2024-01-30T08:05:39.336 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-ceph-base_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:39.407 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-30T08:05:39.422 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-30T08:05:39.465 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-30T08:05:39.581 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:39.760 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webtest. 2024-01-30T08:05:39.775 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-30T08:05:39.818 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-30T08:05:40.088 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pecan. 2024-01-30T08:05:40.103 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-30T08:05:40.135 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-30T08:05:40.138 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-30T08:05:40.149 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-30T08:05:40.217 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-30T08:05:40.450 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-certifi. 2024-01-30T08:05:40.465 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-30T08:05:40.500 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-30T08:05:40.521 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cheroot. 2024-01-30T08:05:40.536 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-30T08:05:40.579 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-30T08:05:40.854 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-idna. 2024-01-30T08:05:40.868 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-30T08:05:40.890 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-30T08:05:40.906 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-30T08:05:40.911 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-30T08:05:40.940 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-30T08:05:41.218 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-30T08:05:41.223 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-urllib3. 2024-01-30T08:05:41.233 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-30T08:05:41.237 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-30T08:05:41.281 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-30T08:05:41.292 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-30T08:05:41.579 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-30T08:05:41.595 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-30T08:05:41.600 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-requests. 2024-01-30T08:05:41.615 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-30T08:05:41.637 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-30T08:05:41.658 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-30T08:05:41.940 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempora. 2024-01-30T08:05:41.956 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-30T08:05:41.964 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-30T08:05:41.979 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-30T08:05:41.998 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-30T08:05:42.014 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-30T08:05:42.260 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-portend. 2024-01-30T08:05:42.275 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-30T08:05:42.317 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-30T08:05:42.331 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:42.343 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-30T08:05:42.375 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:42.638 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-30T08:05:42.653 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-30T08:05:42.696 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-30T08:05:42.763 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-30T08:05:42.778 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:42.821 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:42.999 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-30T08:05:43.014 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-30T08:05:43.057 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-30T08:05:43.166 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-30T08:05:43.181 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-30T08:05:43.224 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-30T08:05:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2024-01-30T08:05:43.426 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-30T08:05:43.485 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-30T08:05:43.510 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-openssl. 2024-01-30T08:05:43.525 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-30T08:05:43.560 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-30T08:05:43.797 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2024-01-30T08:05:43.813 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-30T08:05:43.855 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-30T08:05:43.880 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr. 2024-01-30T08:05:43.895 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:43.938 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:44.158 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-30T08:05:44.174 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-30T08:05:44.216 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-30T08:05:44.358 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mon. 2024-01-30T08:05:44.373 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:44.502 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2024-01-30T08:05:44.518 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-30T08:05:44.552 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-30T08:05:44.856 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-30T08:05:44.871 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-30T08:05:44.914 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-30T08:05:45.024 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:45.217 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-30T08:05:45.232 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-30T08:05:45.275 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-30T08:05:45.594 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-osd. 2024-01-30T08:05:45.602 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2024-01-30T08:05:45.609 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:45.618 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-30T08:05:45.644 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:45.661 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-30T08:05:46.022 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2024-01-30T08:05:46.038 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-30T08:05:46.083 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-30T08:05:46.372 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph. 2024-01-30T08:05:46.375 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2024-01-30T08:05:46.387 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../068-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:46.391 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-30T08:05:46.433 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-30T08:05:46.622 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:46.761 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2024-01-30T08:05:46.777 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-30T08:05:46.819 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-30T08:05:46.925 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-fuse. 2024-01-30T08:05:46.939 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:46.983 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:47.156 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-30T08:05:47.171 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-30T08:05:47.214 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-30T08:05:47.336 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mds. 2024-01-30T08:05:47.350 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:47.394 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:47.517 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-30T08:05:47.533 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-30T08:05:47.612 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-30T08:05:47.764 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephadm. 2024-01-30T08:05:47.779 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../071-cephadm_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:47.816 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:47.911 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2024-01-30T08:05:47.927 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-30T08:05:47.961 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-30T08:05:48.125 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-30T08:05:48.139 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-30T08:05:48.183 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-30T08:05:48.206 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2024-01-30T08:05:48.225 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-30T08:05:48.257 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-30T08:05:48.469 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-30T08:05:48.483 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-30T08:05:48.518 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-30T08:05:48.569 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-certifi. 2024-01-30T08:05:48.584 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-30T08:05:48.645 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-30T08:05:48.955 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-idna. 2024-01-30T08:05:48.971 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-30T08:05:49.013 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-30T08:05:49.333 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-urllib3. 2024-01-30T08:05:49.349 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-30T08:05:49.391 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-30T08:05:49.498 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-babel. 2024-01-30T08:05:49.512 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-30T08:05:49.557 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-30T08:05:49.753 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests. 2024-01-30T08:05:49.768 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-30T08:05:49.811 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-30T08:05:49.876 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jinja2. 2024-01-30T08:05:49.890 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-01-30T08:05:49.959 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-30T08:05:50.098 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-30T08:05:50.112 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-30T08:05:50.147 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-30T08:05:50.313 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-30T08:05:50.326 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:50.371 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:50.425 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-30T08:05:50.440 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:50.483 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:50.715 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-30T08:05:50.729 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-30T08:05:50.774 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-30T08:05:50.905 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-30T08:05:50.921 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:50.963 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:51.083 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-routes. 2024-01-30T08:05:51.099 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-30T08:05:51.135 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-30T08:05:51.302 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-30T08:05:51.306 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-30T08:05:51.341 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-30T08:05:51.460 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-30T08:05:51.468 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:51.516 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:51.625 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2024-01-30T08:05:51.635 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-30T08:05:51.675 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-30T08:05:51.933 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-30T08:05:51.949 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-30T08:05:51.991 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-30T08:05:52.031 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2024-01-30T08:05:52.046 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:52.089 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:52.492 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2024-01-30T08:05:52.508 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:52.519 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-joblib. 2024-01-30T08:05:52.533 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-30T08:05:52.550 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:52.578 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-30T08:05:52.956 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-30T08:05:52.970 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-30T08:05:53.108 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-30T08:05:53.161 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2024-01-30T08:05:53.177 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:53.220 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:53.420 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-sklearn. 2024-01-30T08:05:53.434 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-30T08:05:53.477 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-30T08:05:53.998 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2024-01-30T08:05:54.013 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:54.048 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:54.095 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-30T08:05:54.109 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:54.145 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:54.334 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2024-01-30T08:05:54.349 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:54.392 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:54.895 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2024-01-30T08:05:54.910 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:54.953 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:55.173 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cachetools. 2024-01-30T08:05:55.189 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-30T08:05:55.231 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-30T08:05:55.323 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2024-01-30T08:05:55.339 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-cephadm_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:05:55.384 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:55.534 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-30T08:05:55.550 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-30T08:05:55.592 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-30T08:05:55.668 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-30T08:05:55.683 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-30T08:05:55.717 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-30T08:05:55.962 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-30T08:05:55.978 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-30T08:05:56.020 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-30T08:05:56.087 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-30T08:05:56.103 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-30T08:05:56.137 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-30T08:05:56.449 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rsa. 2024-01-30T08:05:56.463 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-30T08:05:56.507 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-30T08:05:57.036 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-google-auth. 2024-01-30T08:05:57.051 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-30T08:05:57.094 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-30T08:05:57.242 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-babel. 2024-01-30T08:05:57.257 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-30T08:05:57.300 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-30T08:05:57.381 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-30T08:05:57.396 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-30T08:05:57.430 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-30T08:05:57.620 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2024-01-30T08:05:57.634 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-01-30T08:05:57.678 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-30T08:05:57.691 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-websocket. 2024-01-30T08:05:57.707 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-30T08:05:57.741 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-30T08:05:58.053 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-30T08:05:58.064 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-30T08:05:58.068 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-30T08:05:58.080 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:58.111 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-30T08:05:58.122 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:58.493 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-30T08:05:58.509 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-30T08:05:58.551 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-30T08:05:58.758 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-30T08:05:58.772 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:58.812 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2024-01-30T08:05:58.816 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:58.828 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-30T08:05:58.861 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-30T08:05:59.136 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-30T08:05:59.150 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-30T08:05:59.182 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-30T08:05:59.194 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-30T08:05:59.198 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:05:59.256 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:05:59.514 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-30T08:05:59.528 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-30T08:05:59.572 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-30T08:05:59.668 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-30T08:05:59.684 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-30T08:05:59.726 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-30T08:05:59.850 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package jq. 2024-01-30T08:05:59.864 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-30T08:05:59.908 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-30T08:06:00.161 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package socat. 2024-01-30T08:06:00.175 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-30T08:06:00.218 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-30T08:06:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2024-01-30T08:06:00.254 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-30T08:06:00.313 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-30T08:06:00.564 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package xmlstarlet. 2024-01-30T08:06:00.578 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-30T08:06:00.622 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-30T08:06:00.650 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-30T08:06:00.665 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-30T08:06:00.785 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-30T08:06:01.009 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-test. 2024-01-30T08:06:01.023 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../099-ceph-test_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:01.076 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:01.096 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2024-01-30T08:06:01.112 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-30T08:06:01.154 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-30T08:06:01.831 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-30T08:06:01.845 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:01.888 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:02.900 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2024-01-30T08:06:02.916 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-30T08:06:02.958 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-30T08:06:03.180 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-volume. 2024-01-30T08:06:03.196 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:03.247 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:03.278 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-30T08:06:03.294 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-30T08:06:03.336 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-30T08:06:03.690 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-30T08:06:03.692 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-30T08:06:03.706 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-30T08:06:03.708 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:03.739 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-30T08:06:03.758 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:04.004 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2024-01-30T08:06:04.017 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-30T08:06:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-30T08:06:04.095 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-colorama. 2024-01-30T08:06:04.111 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-30T08:06:04.153 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-30T08:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2024-01-30T08:06:04.379 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-30T08:06:04.421 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-30T08:06:04.473 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephfs-shell. 2024-01-30T08:06:04.488 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:04.539 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:04.775 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-30T08:06:04.791 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-30T08:06:04.833 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-30T08:06:04.833 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephfs-top. 2024-01-30T08:06:04.849 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:04.900 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:05.219 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-30T08:06:05.235 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:05.285 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:05.319 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2024-01-30T08:06:05.335 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-30T08:06:05.377 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-30T08:06:05.664 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-30T08:06:05.679 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-30T08:06:05.705 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-30T08:06:05.722 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-30T08:06:05.722 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-30T08:06:05.755 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-30T08:06:06.076 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-30T08:06:06.090 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-30T08:06:06.134 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-30T08:06:06.455 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package nvme-cli. 2024-01-30T08:06:06.460 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-30T08:06:06.469 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-30T08:06:06.475 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:06.505 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-30T08:06:06.518 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:06.855 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-30T08:06:06.869 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-30T08:06:06.876 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package pkg-config. 2024-01-30T08:06:06.890 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-30T08:06:06.913 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-30T08:06:06.934 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-30T08:06:07.187 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-30T08:06:07.203 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-30T08:06:07.210 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-30T08:06:07.224 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-30T08:06:07.245 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-30T08:06:07.268 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-30T08:06:07.537 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2024-01-30T08:06:07.552 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-30T08:06:07.595 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-30T08:06:07.698 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-30T08:06:07.713 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-30T08:06:07.773 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-30T08:06:07.890 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2024-01-30T08:06:07.905 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-30T08:06:07.948 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-30T08:06:08.076 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pastescript. 2024-01-30T08:06:08.091 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-30T08:06:08.134 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-30T08:06:08.268 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2024-01-30T08:06:08.284 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-30T08:06:08.326 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-30T08:06:08.454 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pluggy. 2024-01-30T08:06:08.469 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-30T08:06:08.512 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-30T08:06:08.689 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2024-01-30T08:06:08.704 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-ceph-test_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:08.772 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:08.790 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-psutil. 2024-01-30T08:06:08.806 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-30T08:06:08.857 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-30T08:06:09.193 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-py. 2024-01-30T08:06:09.209 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-30T08:06:09.243 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-30T08:06:09.530 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pygments. 2024-01-30T08:06:09.545 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-30T08:06:09.580 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-30T08:06:10.042 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-30T08:06:10.057 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-30T08:06:10.134 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-30T08:06:10.386 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-toml. 2024-01-30T08:06:10.401 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-30T08:06:10.436 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-30T08:06:10.748 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pytest. 2024-01-30T08:06:10.763 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-30T08:06:10.805 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-30T08:06:10.827 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2024-01-30T08:06:10.843 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:10.876 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:11.117 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-simplejson. 2024-01-30T08:06:11.133 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-30T08:06:11.167 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-30T08:06:11.222 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-30T08:06:11.238 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:11.271 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:11.445 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-30T08:06:11.461 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-30T08:06:11.503 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-30T08:06:11.584 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-colorama. 2024-01-30T08:06:11.600 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-30T08:06:11.641 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-30T08:06:11.894 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-shell. 2024-01-30T08:06:11.910 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:11.952 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:12.247 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-top. 2024-01-30T08:06:12.263 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-30T08:06:12.296 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:12.466 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package radosgw. 2024-01-30T08:06:12.481 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../122-radosgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:12.499 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-30T08:06:12.515 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:12.524 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:12.549 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:12.860 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-30T08:06:12.877 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-30T08:06:12.918 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-30T08:06:13.118 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package rbd-fuse. 2024-01-30T08:06:13.134 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:13.176 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:13.298 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-30T08:06:13.314 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-30T08:06:13.355 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-30T08:06:13.487 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-30T08:06:13.735 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2024-01-30T08:06:13.751 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-30T08:06:13.782 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-30T08:06:13.793 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-30T08:06:13.908 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-30T08:06:14.167 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-30T08:06:14.232 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pkg-config. 2024-01-30T08:06:14.248 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-30T08:06:14.289 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-30T08:06:14.543 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-30T08:06:14.559 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-30T08:06:14.574 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-30T08:06:14.600 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-30T08:06:15.054 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-30T08:06:15.070 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-30T08:06:15.112 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-30T08:06:15.166 INFO:teuthology.orchestra.run.smithi125.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-30T08:06:15.210 INFO:teuthology.orchestra.run.smithi125.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-30T08:06:15.259 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:15.423 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2024-01-30T08:06:15.439 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-30T08:06:15.473 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-30T08:06:15.802 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2024-01-30T08:06:15.804 INFO:teuthology.orchestra.run.smithi125.stdout:Adding system user cephadm....done 2024-01-30T08:06:15.818 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-30T08:06:15.859 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-30T08:06:15.965 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-30T08:06:16.138 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2024-01-30T08:06:16.154 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-30T08:06:16.221 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-30T08:06:16.241 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-30T08:06:16.484 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-30T08:06:16.574 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2024-01-30T08:06:16.585 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-30T08:06:16.590 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-30T08:06:16.631 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-30T08:06:16.828 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-30T08:06:16.960 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pygments. 2024-01-30T08:06:16.977 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-30T08:06:17.018 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-30T08:06:17.131 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-30T08:06:17.405 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-30T08:06:17.456 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-30T08:06:17.471 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-30T08:06:17.506 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-30T08:06:17.715 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-30T08:06:17.816 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-toml. 2024-01-30T08:06:17.833 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-30T08:06:17.875 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-30T08:06:18.084 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-30T08:06:18.178 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2024-01-30T08:06:18.194 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-30T08:06:18.236 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-30T08:06:18.344 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-30T08:06:18.581 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2024-01-30T08:06:18.594 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-30T08:06:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-30T08:06:18.631 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-30T08:06:18.879 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-30T08:06:18.884 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-30T08:06:18.900 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-30T08:06:18.942 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-30T08:06:19.130 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-30T08:06:19.390 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-30T08:06:19.712 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2024-01-30T08:06:19.727 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../122-radosgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:19.771 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:19.816 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-30T08:06:20.067 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:20.335 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-30T08:06:20.357 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2024-01-30T08:06:20.372 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-30T08:06:20.440 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:20.460 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-30T08:06:20.595 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-30T08:06:20.744 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-30T08:06:20.863 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-30T08:06:20.989 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-30T08:06:21.248 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-30T08:06:21.254 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-30T08:06:21.380 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-30T08:06:21.636 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-30T08:06:21.662 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-30T08:06:21.689 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-30T08:06:21.718 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-30T08:06:21.877 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-30T08:06:22.086 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-30T08:06:22.245 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-30T08:06:22.356 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-30T08:06:22.633 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-30T08:06:22.665 INFO:teuthology.orchestra.run.smithi050.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-30T08:06:22.714 INFO:teuthology.orchestra.run.smithi050.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-30T08:06:22.756 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:22.925 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-30T08:06:23.251 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up zip (3.0-12build2) ... 2024-01-30T08:06:23.377 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-30T08:06:23.402 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2024-01-30T08:06:23.554 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-30T08:06:23.872 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-30T08:06:24.079 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-30T08:06:24.115 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-30T08:06:24.216 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-30T08:06:24.347 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-30T08:06:24.481 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-30T08:06:24.575 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-30T08:06:24.607 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-30T08:06:24.877 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-30T08:06:24.917 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-30T08:06:25.002 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-30T08:06:25.301 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-30T08:06:25.330 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-30T08:06:25.561 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-30T08:06:25.731 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-30T08:06:25.945 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-30T08:06:25.982 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-30T08:06:26.238 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-30T08:06:26.259 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-30T08:06:26.552 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-30T08:06:26.565 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-30T08:06:26.803 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-30T08:06:26.916 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-30T08:06:27.071 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-30T08:06:27.175 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-30T08:06:27.284 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:27.347 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-30T08:06:27.569 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-idna (3.3-1) ... 2024-01-30T08:06:27.598 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:27.849 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-30T08:06:27.912 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-30T08:06:27.975 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-30T08:06:28.101 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-30T08:06:28.371 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-30T08:06:28.495 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-30T08:06:28.763 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-30T08:06:29.110 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-30T08:06:29.157 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-30T08:06:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-30T08:06:29.266 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-30T08:06:29.344 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:06:29.392 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-30T08:06:29.454 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-30T08:06:29.713 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-30T08:06:29.777 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-30T08:06:29.872 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-30T08:06:29.903 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-30T08:06:29.998 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-30T08:06:30.203 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-30T08:06:30.300 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-30T08:06:30.480 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-30T08:06:30.559 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-30T08:06:30.802 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:06:30.806 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up zip (3.0-12build2) ... 2024-01-30T08:06:30.903 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-30T08:06:30.907 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-30T08:06:31.204 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-30T08:06:31.472 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-30T08:06:31.642 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-30T08:06:31.748 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-30T08:06:31.918 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-30T08:06:32.016 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-30T08:06:32.078 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-30T08:06:32.204 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-30T08:06:32.275 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-30T08:06:32.530 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-30T08:06:32.534 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-30T08:06:32.644 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-30T08:06:32.912 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-30T08:06:32.939 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-30T08:06:33.037 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-30T08:06:33.190 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-30T08:06:33.347 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-30T08:06:33.575 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-30T08:06:33.665 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-30T08:06:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-30T08:06:33.933 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-30T08:06:34.058 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-30T08:06:34.184 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-30T08:06:34.211 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-30T08:06:34.264 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-30T08:06:34.511 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-30T08:06:34.570 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-30T08:06:34.637 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-30T08:06:34.847 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-30T08:06:34.972 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:35.030 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-30T08:06:35.282 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-idna (3.3-1) ... 2024-01-30T08:06:35.298 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-30T08:06:35.424 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-30T08:06:35.625 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-30T08:06:35.683 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:06:35.809 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-30T08:06:36.144 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-30T08:06:36.436 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-30T08:06:36.704 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-30T08:06:36.915 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-30T08:06:36.924 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-30T08:06:37.141 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:06:37.200 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-30T08:06:37.284 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-30T08:06:37.493 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-30T08:06:37.594 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-30T08:06:37.719 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-30T08:06:37.753 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-30T08:06:37.845 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-30T08:06:38.146 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-30T08:06:38.154 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-30T08:06:38.414 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-30T08:06:38.423 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-30T08:06:38.665 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:06:38.767 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-30T08:06:38.783 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-30T08:06:38.893 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:39.019 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:39.118 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-30T08:06:39.162 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-30T08:06:39.386 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-30T08:06:39.456 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:39.582 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:39.678 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-30T08:06:39.708 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-30T08:06:39.971 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-30T08:06:40.001 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:40.127 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:40.230 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-30T08:06:40.253 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:40.478 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-30T08:06:40.478 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-30T08:06:40.506 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-30T08:06:40.607 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-30T08:06:40.900 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-30T08:06:41.026 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-30T08:06:41.163 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:41.273 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:41.328 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-30T08:06:41.398 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:41.541 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-30T08:06:41.667 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-30T08:06:41.913 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-30T08:06:42.022 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-30T08:06:42.123 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-30T08:06:42.195 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-30T08:06:42.442 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-30T08:06:42.568 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-30T08:06:42.929 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:42.994 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-30T08:06:43.030 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:43.131 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:43.257 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-30T08:06:43.383 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-30T08:06:43.509 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:43.689 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-30T08:06:43.790 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-30T08:06:44.045 INFO:teuthology.orchestra.run.smithi125.stdout:Adding group ceph....done 2024-01-30T08:06:44.099 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-30T08:06:44.396 INFO:teuthology.orchestra.run.smithi125.stdout:Adding system user ceph....done 2024-01-30T08:06:44.434 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-30T08:06:44.582 INFO:teuthology.orchestra.run.smithi125.stdout:Setting system user ceph properties....done 2024-01-30T08:06:44.599 INFO:teuthology.orchestra.run.smithi125.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-30T08:06:44.740 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-30T08:06:44.743 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-30T08:06:44.955 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-30T08:06:45.121 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-30T08:06:45.214 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-30T08:06:45.474 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-30T08:06:45.742 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-30T08:06:45.835 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:46.028 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-30T08:06:46.028 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-30T08:06:46.152 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-30T08:06:46.454 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-30T08:06:46.653 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:46.779 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:46.839 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-30T08:06:46.940 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:47.066 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:47.218 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-30T08:06:47.298 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-30T08:06:47.298 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-30T08:06:47.562 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:47.688 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:47.814 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-30T08:06:48.116 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:48.122 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:48.241 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:48.368 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:48.466 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-30T08:06:48.584 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-30T08:06:48.584 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-30T08:06:49.107 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:49.219 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:49.338 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-30T08:06:49.338 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-30T08:06:49.345 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:49.471 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:49.597 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-30T08:06:49.976 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:50.187 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-30T08:06:50.187 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-30T08:06:50.818 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.010 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.129 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-30T08:06:51.129 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-30T08:06:51.169 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.295 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.421 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.539 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.639 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.728 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.863 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:51.980 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:52.181 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-30T08:06:52.181 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-30T08:06:52.202 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2024-01-30T08:06:52.595 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2024-01-30T08:06:52.739 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2024-01-30T08:06:52.761 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-30T08:06:52.773 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:52.912 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-30T08:06:52.916 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:53.102 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:53.244 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:53.337 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-30T08:06:53.605 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-30T08:06:53.706 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-30T08:06:53.841 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-30T08:06:53.966 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:54.190 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-30T08:06:54.190 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-30T08:06:54.785 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:54.911 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:54.984 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-30T08:06:55.442 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-30T08:06:55.443 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-30T08:06:55.686 INFO:teuthology.orchestra.run.smithi125.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-30T08:06:55.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-30T08:06:55.764 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2024-01-30T08:06:55.929 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2024-01-30T08:06:55.929 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2024-01-30T08:06:56.021 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:56.080 INFO:teuthology.orchestra.run.smithi125.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-30T08:06:56.080 INFO:teuthology.orchestra.run.smithi125.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-30T08:06:56.080 INFO:teuthology.orchestra.run.smithi125.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-30T08:06:56.080 INFO:teuthology.orchestra.run.smithi125.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages were automatically installed and are no longer required: 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-30T08:06:56.081 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-30T08:06:56.082 INFO:teuthology.orchestra.run.smithi125.stdout:The following additional packages will be installed: 2024-01-30T08:06:56.082 INFO:teuthology.orchestra.run.smithi125.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-30T08:06:56.082 INFO:teuthology.orchestra.run.smithi125.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-30T08:06:56.082 INFO:teuthology.orchestra.run.smithi125.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-30T08:06:56.082 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-30T08:06:56.082 INFO:teuthology.orchestra.run.smithi125.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-30T08:06:56.083 INFO:teuthology.orchestra.run.smithi125.stdout:Suggested packages: 2024-01-30T08:06:56.083 INFO:teuthology.orchestra.run.smithi125.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-30T08:06:56.083 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-30T08:06:56.083 INFO:teuthology.orchestra.run.smithi125.stdout: libengine-pkcs11-openssl 2024-01-30T08:06:56.130 INFO:teuthology.orchestra.run.smithi125.stdout:The following NEW packages will be installed: 2024-01-30T08:06:56.131 INFO:teuthology.orchestra.run.smithi125.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-30T08:06:56.131 INFO:teuthology.orchestra.run.smithi125.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-30T08:06:56.131 INFO:teuthology.orchestra.run.smithi125.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-30T08:06:56.131 INFO:teuthology.orchestra.run.smithi125.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-30T08:06:56.131 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-30T08:06:56.131 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-30T08:06:56.131 INFO:teuthology.orchestra.run.smithi125.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-30T08:06:56.132 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages will be upgraded: 2024-01-30T08:06:56.132 INFO:teuthology.orchestra.run.smithi125.stdout: libssl3 2024-01-30T08:06:56.317 INFO:teuthology.orchestra.run.smithi125.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-30T08:06:56.317 INFO:teuthology.orchestra.run.smithi125.stdout:Need to get 54.6 MB of archives. 2024-01-30T08:06:56.317 INFO:teuthology.orchestra.run.smithi125.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-30T08:06:56.317 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-30T08:06:56.385 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-30T08:06:56.818 INFO:teuthology.orchestra.run.smithi125.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.13 [1,902 kB] 2024-01-30T08:06:57.076 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-30T08:06:57.110 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-30T08:06:57.112 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-30T08:06:57.117 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-30T08:06:57.120 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-30T08:06:57.121 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-30T08:06:57.124 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-30T08:06:57.126 INFO:teuthology.orchestra.run.smithi125.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-30T08:06:57.291 INFO:teuthology.orchestra.run.smithi125.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-30T08:06:57.291 INFO:teuthology.orchestra.run.smithi125.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-30T08:06:57.478 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:57.542 INFO:teuthology.orchestra.run.smithi125.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-30T08:06:57.724 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-30T08:06:57.724 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-30T08:06:58.338 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:58.550 INFO:teuthology.orchestra.run.smithi125.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-30T08:06:58.558 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-30T08:06:58.558 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-30T08:06:58.576 INFO:teuthology.orchestra.run.smithi125.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-30T08:06:58.576 INFO:teuthology.orchestra.run.smithi125.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-30T08:06:58.579 INFO:teuthology.orchestra.run.smithi125.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-30T08:06:58.579 INFO:teuthology.orchestra.run.smithi125.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-30T08:06:58.584 INFO:teuthology.orchestra.run.smithi125.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-30T08:06:58.585 INFO:teuthology.orchestra.run.smithi125.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-30T08:06:58.614 INFO:teuthology.orchestra.run.smithi125.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-30T08:06:58.778 INFO:teuthology.orchestra.run.smithi125.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.13 [2,374 kB] 2024-01-30T08:06:59.189 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:06:59.485 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-30T08:06:59.485 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-30T08:06:59.517 INFO:teuthology.orchestra.run.smithi125.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-30T08:06:59.518 INFO:teuthology.orchestra.run.smithi125.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-30T08:06:59.544 INFO:teuthology.orchestra.run.smithi125.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-30T08:06:59.622 INFO:teuthology.orchestra.run.smithi125.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-30T08:06:59.629 INFO:teuthology.orchestra.run.smithi125.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-30T08:06:59.631 INFO:teuthology.orchestra.run.smithi125.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-30T08:06:59.632 INFO:teuthology.orchestra.run.smithi125.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-30T08:06:59.632 INFO:teuthology.orchestra.run.smithi125.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-30T08:06:59.660 INFO:teuthology.orchestra.run.smithi125.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-30T08:06:59.663 INFO:teuthology.orchestra.run.smithi125.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-30T08:07:00.108 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:07:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:07:00.288 INFO:teuthology.orchestra.run.smithi125.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-30T08:07:00.372 INFO:teuthology.orchestra.run.smithi125.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-30T08:07:00.372 INFO:teuthology.orchestra.run.smithi125.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-30T08:07:00.372 INFO:teuthology.orchestra.run.smithi125.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-30T08:07:00.378 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:07:00.461 INFO:teuthology.orchestra.run.smithi125.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-30T08:07:00.467 INFO:teuthology.orchestra.run.smithi125.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-30T08:07:00.594 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-30T08:07:00.595 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-30T08:07:00.930 INFO:teuthology.orchestra.run.smithi125.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-30T08:07:00.931 INFO:teuthology.orchestra.run.smithi125.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-30T08:07:01.280 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:07:01.312 INFO:teuthology.orchestra.run.smithi125.stdout:Preconfiguring packages ... 2024-01-30T08:07:01.414 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:07:01.465 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2024-01-30T08:07:01.515 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:07:01.608 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package flex. 2024-01-30T08:07:01.679 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140578 files and directories currently installed.) 2024-01-30T08:07:01.683 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-30T08:07:01.683 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-30T08:07:01.723 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-30T08:07:02.061 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-30T08:07:02.170 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-30T08:07:02.301 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-30T08:07:02.305 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-30T08:07:02.471 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.13) over (3.0.2-0ubuntu1.7) ... 2024-01-30T08:07:02.860 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-30T08:07:03.457 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-30T08:07:03.472 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package bison. 2024-01-30T08:07:03.542 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140651 files and directories currently installed.) 2024-01-30T08:07:03.546 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-30T08:07:03.600 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-30T08:07:04.001 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-30T08:07:04.015 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-30T08:07:04.059 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-30T08:07:04.224 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-30T08:07:04.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-30T08:07:04.304 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-01-30T08:07:04.403 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package dump. 2024-01-30T08:07:04.418 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-30T08:07:04.462 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking dump (0.4b47-3) ... 2024-01-30T08:07:04.474 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-01-30T08:07:04.475 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-01-30T08:07:04.633 INFO:teuthology.orchestra.run.smithi050.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-30T08:07:04.633 INFO:teuthology.orchestra.run.smithi050.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-30T08:07:04.634 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-30T08:07:04.635 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-01-30T08:07:04.635 INFO:teuthology.orchestra.run.smithi050.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-30T08:07:04.635 INFO:teuthology.orchestra.run.smithi050.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-30T08:07:04.635 INFO:teuthology.orchestra.run.smithi050.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-30T08:07:04.636 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-30T08:07:04.636 INFO:teuthology.orchestra.run.smithi050.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-30T08:07:04.636 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-01-30T08:07:04.636 INFO:teuthology.orchestra.run.smithi050.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-30T08:07:04.636 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-30T08:07:04.636 INFO:teuthology.orchestra.run.smithi050.stdout: libengine-pkcs11-openssl 2024-01-30T08:07:04.686 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-01-30T08:07:04.687 INFO:teuthology.orchestra.run.smithi050.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-30T08:07:04.687 INFO:teuthology.orchestra.run.smithi050.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-30T08:07:04.687 INFO:teuthology.orchestra.run.smithi050.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-30T08:07:04.687 INFO:teuthology.orchestra.run.smithi050.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-30T08:07:04.687 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-30T08:07:04.687 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-30T08:07:04.687 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-30T08:07:04.688 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-01-30T08:07:04.689 INFO:teuthology.orchestra.run.smithi050.stdout: libssl3 2024-01-30T08:07:04.748 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package indent. 2024-01-30T08:07:04.750 INFO:teuthology.orchestra.run.smithi050.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-30T08:07:04.750 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 54.6 MB of archives. 2024-01-30T08:07:04.750 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-30T08:07:04.750 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-30T08:07:04.763 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:04.798 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-30T08:07:04.908 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.13 [1,902 kB] 2024-01-30T08:07:05.034 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-30T08:07:05.050 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-30T08:07:05.070 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-30T08:07:05.092 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-30T08:07:05.110 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-30T08:07:05.112 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-30T08:07:05.116 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-30T08:07:05.118 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-30T08:07:05.119 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-30T08:07:05.126 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-30T08:07:05.129 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-30T08:07:05.130 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-30T08:07:05.130 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-30T08:07:05.151 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-30T08:07:05.430 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-30T08:07:05.445 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-30T08:07:05.476 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-30T08:07:05.479 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-30T08:07:05.479 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-30T08:07:05.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-30T08:07:05.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-30T08:07:05.486 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-30T08:07:05.487 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-30T08:07:05.488 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-30T08:07:05.495 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-30T08:07:05.495 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.13 [2,374 kB] 2024-01-30T08:07:05.517 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-30T08:07:05.517 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-30T08:07:05.528 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-30T08:07:05.551 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-30T08:07:05.555 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-30T08:07:05.555 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-30T08:07:05.556 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-30T08:07:05.556 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-30T08:07:05.568 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-30T08:07:05.572 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-30T08:07:05.757 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-30T08:07:05.772 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-30T08:07:05.815 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-30T08:07:05.824 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-30T08:07:05.824 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-30T08:07:05.824 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-30T08:07:05.824 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-30T08:07:05.825 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-30T08:07:05.825 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-30T08:07:05.838 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-30T08:07:05.838 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-30T08:07:06.135 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-30T08:07:06.151 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-30T08:07:06.193 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:06.231 INFO:teuthology.orchestra.run.smithi050.stdout:Preconfiguring packages ... 2024-01-30T08:07:06.390 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 54.6 MB in 1s (47.8 MB/s) 2024-01-30T08:07:06.446 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-30T08:07:06.461 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-30T08:07:06.504 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:06.564 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package flex. 2024-01-30T08:07:06.638 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140578 files and directories currently installed.) 2024-01-30T08:07:06.641 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-30T08:07:06.688 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-30T08:07:06.740 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjson-perl. 2024-01-30T08:07:06.755 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-30T08:07:06.798 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-30T08:07:07.335 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-30T08:07:07.350 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-30T08:07:07.358 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-30T08:07:07.393 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-30T08:07:07.561 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.13) over (3.0.2-0ubuntu1.7) ... 2024-01-30T08:07:08.003 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-30T08:07:08.563 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package bison. 2024-01-30T08:07:08.636 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140651 files and directories currently installed.) 2024-01-30T08:07:08.640 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-30T08:07:08.690 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-30T08:07:08.823 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-30T08:07:08.838 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-30T08:07:08.881 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:09.124 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-30T08:07:09.139 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-30T08:07:09.150 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-30T08:07:09.165 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-30T08:07:09.182 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-30T08:07:09.208 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:09.486 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-30T08:07:09.494 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package dump. 2024-01-30T08:07:09.501 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-30T08:07:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-30T08:07:09.535 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:09.544 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking dump (0.4b47-3) ... 2024-01-30T08:07:09.806 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package indent. 2024-01-30T08:07:09.822 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:09.864 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-30T08:07:09.922 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-30T08:07:09.937 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-30T08:07:09.980 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-30T08:07:10.117 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-30T08:07:10.133 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-30T08:07:10.191 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-30T08:07:10.300 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-30T08:07:10.315 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-30T08:07:10.357 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-30T08:07:10.529 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-30T08:07:10.545 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-30T08:07:10.587 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-30T08:07:10.677 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-30T08:07:10.692 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:10.726 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:10.806 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-30T08:07:10.823 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-30T08:07:10.856 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-30T08:07:11.071 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-30T08:07:11.087 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:11.138 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:11.184 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-30T08:07:11.201 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-30T08:07:11.259 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:11.416 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-30T08:07:11.431 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:11.474 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:11.521 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-30T08:07:11.537 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-30T08:07:11.596 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:11.718 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-30T08:07:11.733 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-30T08:07:11.776 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-30T08:07:11.815 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjson-perl. 2024-01-30T08:07:11.831 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-30T08:07:11.865 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-30T08:07:12.151 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-30T08:07:12.168 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-30T08:07:12.210 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-30T08:07:12.287 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-30T08:07:12.302 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-30T08:07:12.345 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-30T08:07:12.699 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package modemmanager. 2024-01-30T08:07:12.714 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-30T08:07:12.757 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:13.546 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-30T08:07:13.562 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-30T08:07:13.604 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:13.615 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package network-manager. 2024-01-30T08:07:13.631 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-30T08:07:13.682 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-30T08:07:13.865 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-30T08:07:13.881 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-30T08:07:13.923 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:14.193 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-30T08:07:14.209 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-30T08:07:14.243 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:14.247 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ppp. 2024-01-30T08:07:14.263 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-30T08:07:14.587 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-30T08:07:14.604 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-30T08:07:14.619 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-30T08:07:14.645 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-30T08:07:14.918 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package pptp-linux. 2024-01-30T08:07:14.933 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-30T08:07:14.965 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-30T08:07:14.976 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-30T08:07:14.982 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-30T08:07:15.023 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-30T08:07:15.229 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-30T08:07:15.243 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-30T08:07:15.287 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-30T08:07:15.326 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-30T08:07:15.342 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:15.376 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:15.576 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-30T08:07:15.590 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-30T08:07:15.626 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-client-common (238) ... 2024-01-30T08:07:15.746 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-30T08:07:15.762 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:15.804 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:15.929 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-30T08:07:15.943 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:15.987 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:16.090 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-30T08:07:16.106 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:16.148 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:16.375 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-30T08:07:16.392 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-30T08:07:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-30T08:07:16.665 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-common. 2024-01-30T08:07:16.680 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-30T08:07:16.735 INFO:teuthology.orchestra.run.smithi125.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-30T08:07:16.765 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-common (238) ... 2024-01-30T08:07:16.962 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-30T08:07:16.979 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-30T08:07:17.020 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-30T08:07:17.182 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-14. 2024-01-30T08:07:17.197 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:17.243 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:17.374 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package modemmanager. 2024-01-30T08:07:17.390 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-30T08:07:17.431 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:18.055 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager. 2024-01-30T08:07:18.071 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-30T08:07:18.121 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-30T08:07:18.393 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql. 2024-01-30T08:07:18.408 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-30T08:07:18.451 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql (14+238) ... 2024-01-30T08:07:18.779 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ppp. 2024-01-30T08:07:18.796 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-30T08:07:19.062 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-client. 2024-01-30T08:07:19.077 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-30T08:07:19.132 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-30T08:07:19.138 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-client (14+238) ... 2024-01-30T08:07:19.339 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-30T08:07:19.354 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-30T08:07:19.397 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-30T08:07:19.442 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pptp-linux. 2024-01-30T08:07:19.457 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-30T08:07:19.500 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-30T08:07:19.700 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package tcl8.6. 2024-01-30T08:07:19.715 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-30T08:07:19.758 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-30T08:07:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-30T08:07:19.801 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-30T08:07:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-30T08:07:20.044 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package tcl. 2024-01-30T08:07:20.059 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-30T08:07:20.106 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-30T08:07:20.107 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-30T08:07:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-30T08:07:20.156 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-common (238) ... 2024-01-30T08:07:20.438 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package wpasupplicant. 2024-01-30T08:07:20.454 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-30T08:07:20.460 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-30T08:07:20.476 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:20.488 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-30T08:07:20.518 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:20.851 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-30T08:07:20.867 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-30T08:07:20.909 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-30T08:07:21.090 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-common. 2024-01-30T08:07:21.106 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-30T08:07:21.167 INFO:teuthology.orchestra.run.smithi050.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-30T08:07:21.197 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-common (238) ... 2024-01-30T08:07:21.287 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-30T08:07:21.302 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-30T08:07:21.353 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-30T08:07:21.671 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-client-common (238) ... 2024-01-30T08:07:21.689 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-14. 2024-01-30T08:07:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-30T08:07:21.750 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:21.884 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-30T08:07:22.010 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-30T08:07:22.136 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:22.245 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-30T08:07:22.346 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-30T08:07:22.455 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:22.884 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql. 2024-01-30T08:07:22.900 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-30T08:07:22.942 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql (14+238) ... 2024-01-30T08:07:23.153 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client. 2024-01-30T08:07:23.168 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-30T08:07:23.203 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client (14+238) ... 2024-01-30T08:07:23.410 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-30T08:07:23.447 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-30T08:07:23.463 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-30T08:07:23.505 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-30T08:07:23.510 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-30T08:07:23.825 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package tcl8.6. 2024-01-30T08:07:23.841 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-30T08:07:23.847 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-30T08:07:23.847 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-30T08:07:23.883 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-30T08:07:24.186 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package tcl. 2024-01-30T08:07:24.202 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-30T08:07:24.249 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-30T08:07:24.539 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-30T08:07:24.622 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package wpasupplicant. 2024-01-30T08:07:24.639 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-30T08:07:24.664 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-30T08:07:24.680 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-30T08:07:24.790 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-30T08:07:24.942 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-30T08:07:25.043 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-30T08:07:25.060 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-30T08:07:25.067 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:25.101 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-30T08:07:25.193 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-30T08:07:25.319 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-30T08:07:25.488 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-30T08:07:25.505 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-30T08:07:25.555 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-30T08:07:25.832 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-common (238) ... 2024-01-30T08:07:25.908 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-30T08:07:26.034 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up dump (0.4b47-3) ... 2024-01-30T08:07:26.053 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-30T08:07:26.145 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-30T08:07:26.153 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-30T08:07:26.210 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:26.271 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:26.336 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-30T08:07:26.397 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-30T08:07:26.445 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-30T08:07:26.524 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-30T08:07:26.546 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-30T08:07:26.647 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-30T08:07:26.649 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:26.737 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-30T08:07:26.807 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-30T08:07:26.942 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-30T08:07:27.134 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-30T08:07:27.294 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:27.420 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-30T08:07:27.563 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-client (14+238) ... 2024-01-30T08:07:27.620 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-30T08:07:27.663 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-30T08:07:27.722 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-30T08:07:28.157 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-30T08:07:28.157 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-30T08:07:28.234 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:28.235 INFO:teuthology.orchestra.run.smithi125.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-30T08:07:28.235 INFO:teuthology.orchestra.run.smithi125.stdout:which means they are currently configured by ifupdown: 2024-01-30T08:07:28.235 INFO:teuthology.orchestra.run.smithi125.stdout:- enp3s0f1 2024-01-30T08:07:28.235 INFO:teuthology.orchestra.run.smithi125.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-30T08:07:28.235 INFO:teuthology.orchestra.run.smithi125.stdout:remove their configuration from /etc/network/interfaces. 2024-01-30T08:07:28.235 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:28.366 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-30T08:07:28.744 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-30T08:07:28.848 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-30T08:07:29.001 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-30T08:07:29.152 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-30T08:07:29.161 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-30T08:07:29.320 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-30T08:07:29.455 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:29.589 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-30T08:07:29.740 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-30T08:07:29.858 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:30.001 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:30.127 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-30T08:07:30.253 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-common (238) ... 2024-01-30T08:07:30.471 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-30T08:07:30.597 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up dump (0.4b47-3) ... 2024-01-30T08:07:30.692 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-30T08:07:30.757 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:30.892 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-30T08:07:31.018 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-30T08:07:31.143 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-30T08:07:31.159 INFO:teuthology.orchestra.run.smithi125.stdout:Adding user postgres to group ssl-cert 2024-01-30T08:07:31.244 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-30T08:07:31.343 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-30T08:07:31.404 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-30T08:07:31.407 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:31.407 INFO:teuthology.orchestra.run.smithi125.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-30T08:07:31.539 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-30T08:07:31.666 INFO:teuthology.orchestra.run.smithi125.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-30T08:07:31.666 INFO:teuthology.orchestra.run.smithi125.stdout:Removing obsolete dictionary files: 2024-01-30T08:07:31.741 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-30T08:07:31.891 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:32.026 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-30T08:07:32.219 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client (14+238) ... 2024-01-30T08:07:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-30T08:07:32.409 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-30T08:07:32.870 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:33.036 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:33.036 INFO:teuthology.orchestra.run.smithi050.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-30T08:07:33.037 INFO:teuthology.orchestra.run.smithi050.stdout:which means they are currently configured by ifupdown: 2024-01-30T08:07:33.037 INFO:teuthology.orchestra.run.smithi050.stdout:- ens1f0 2024-01-30T08:07:33.037 INFO:teuthology.orchestra.run.smithi050.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-30T08:07:33.037 INFO:teuthology.orchestra.run.smithi050.stdout:remove their configuration from /etc/network/interfaces. 2024-01-30T08:07:33.037 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:33.176 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-30T08:07:33.219 INFO:teuthology.orchestra.run.smithi125.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-30T08:07:33.238 INFO:teuthology.orchestra.run.smithi125.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout:This user must also own the server process. 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout:The database cluster will be initialized with locale "en_US". 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout:The default text search configuration will be set to "english". 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout:Data page checksums are disabled. 2024-01-30T08:07:33.291 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:33.292 INFO:teuthology.orchestra.run.smithi125.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-30T08:07:33.292 INFO:teuthology.orchestra.run.smithi125.stdout:creating subdirectories ... ok 2024-01-30T08:07:33.292 INFO:teuthology.orchestra.run.smithi125.stdout:selecting dynamic shared memory implementation ... posix 2024-01-30T08:07:33.316 INFO:teuthology.orchestra.run.smithi125.stdout:selecting default max_connections ... 100 2024-01-30T08:07:33.349 INFO:teuthology.orchestra.run.smithi125.stdout:selecting default shared_buffers ... 128MB 2024-01-30T08:07:33.363 INFO:teuthology.orchestra.run.smithi125.stdout:selecting default time zone ... Etc/UTC 2024-01-30T08:07:33.364 INFO:teuthology.orchestra.run.smithi125.stdout:creating configuration files ... ok 2024-01-30T08:07:33.528 INFO:teuthology.orchestra.run.smithi125.stdout:running bootstrap script ... ok 2024-01-30T08:07:33.593 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-30T08:07:34.006 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-30T08:07:34.129 INFO:teuthology.orchestra.run.smithi125.stdout:performing post-bootstrap initialization ... ok 2024-01-30T08:07:34.711 INFO:teuthology.orchestra.run.smithi125.stdout:syncing data to disk ... ok 2024-01-30T08:07:34.740 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-30T08:07:34.883 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-30T08:07:35.018 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-30T08:07:35.144 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-common (238) ... 2024-01-30T08:07:35.242 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-30T08:07:36.214 INFO:teuthology.orchestra.run.smithi050.stdout:Adding user postgres to group ssl-cert 2024-01-30T08:07:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:36.469 INFO:teuthology.orchestra.run.smithi050.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-30T08:07:36.736 INFO:teuthology.orchestra.run.smithi050.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-30T08:07:36.736 INFO:teuthology.orchestra.run.smithi050.stdout:Removing obsolete dictionary files: 2024-01-30T08:07:37.445 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-30T08:07:37.871 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-30T08:07:38.177 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:38.229 INFO:teuthology.orchestra.run.smithi050.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-30T08:07:38.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-30T08:07:38.301 INFO:teuthology.orchestra.run.smithi050.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-30T08:07:38.301 INFO:teuthology.orchestra.run.smithi050.stdout:This user must also own the server process. 2024-01-30T08:07:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:38.301 INFO:teuthology.orchestra.run.smithi050.stdout:The database cluster will be initialized with locale "en_US". 2024-01-30T08:07:38.301 INFO:teuthology.orchestra.run.smithi050.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-30T08:07:38.301 INFO:teuthology.orchestra.run.smithi050.stdout:The default text search configuration will be set to "english". 2024-01-30T08:07:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:38.302 INFO:teuthology.orchestra.run.smithi050.stdout:Data page checksums are disabled. 2024-01-30T08:07:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:38.302 INFO:teuthology.orchestra.run.smithi050.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-30T08:07:38.302 INFO:teuthology.orchestra.run.smithi050.stdout:creating subdirectories ... ok 2024-01-30T08:07:38.302 INFO:teuthology.orchestra.run.smithi050.stdout:selecting dynamic shared memory implementation ... posix 2024-01-30T08:07:38.303 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-30T08:07:38.326 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default max_connections ... 100 2024-01-30T08:07:38.360 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default shared_buffers ... 128MB 2024-01-30T08:07:38.375 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default time zone ... Etc/UTC 2024-01-30T08:07:38.376 INFO:teuthology.orchestra.run.smithi050.stdout:creating configuration files ... ok 2024-01-30T08:07:38.421 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql (14+238) ... 2024-01-30T08:07:38.522 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:38.548 INFO:teuthology.orchestra.run.smithi050.stdout:running bootstrap script ... ok 2024-01-30T08:07:38.623 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:38.873 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-30T08:07:38.873 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-30T08:07:39.185 INFO:teuthology.orchestra.run.smithi050.stdout:performing post-bootstrap initialization ... ok 2024-01-30T08:07:39.566 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-30T08:07:39.713 INFO:teuthology.orchestra.run.smithi050.stdout:syncing data to disk ... ok 2024-01-30T08:07:39.869 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-30T08:07:40.012 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-30T08:07:40.224 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-30T08:07:41.413 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-30T08:07:41.531 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-30T08:07:42.054 INFO:teuthology.orchestra.run.smithi125.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-30T08:07:42.061 DEBUG:teuthology.parallel:result is None 2024-01-30T08:07:43.588 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:43.713 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-30T08:07:43.865 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql (14+238) ... 2024-01-30T08:07:44.024 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-30T08:07:44.150 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-30T08:07:44.435 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-30T08:07:44.436 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-30T08:07:45.186 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-30T08:07:45.480 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-30T08:07:45.648 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-30T08:07:47.252 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-30T08:07:47.360 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-30T08:07:47.902 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-30T08:07:47.908 DEBUG:teuthology.parallel:result is None 2024-01-30T08:07:47.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-30T08:07:48.138 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2024-01-30T08:07:48.160 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-885-g661946e7-1jammy 2024-01-30T08:07:48.161 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885-g661946e7-1jammy 2024-01-30T08:07:48.161 INFO:teuthology.task.install:The correct ceph version 19.0.0-885-g661946e7-1jammy is installed. 2024-01-30T08:07:48.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-30T08:07:48.395 DEBUG:teuthology.orchestra.run.smithi125:> dpkg-query -W -f '${Version}' ceph 2024-01-30T08:07:48.419 INFO:teuthology.orchestra.run.smithi125.stdout:19.0.0-885-g661946e7-1jammy 2024-01-30T08:07:48.419 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885-g661946e7-1jammy 2024-01-30T08:07:48.419 INFO:teuthology.task.install:The correct ceph version 19.0.0-885-g661946e7-1jammy is installed. 2024-01-30T08:07:48.421 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-30T08:07:48.421 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:48.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-30T08:07:48.442 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:48.442 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-30T08:07:48.481 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-30T08:07:48.481 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:48.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-01-30T08:07:48.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-30T08:07:48.566 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:48.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2024-01-30T08:07:48.587 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-30T08:07:48.651 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-30T08:07:48.651 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:48.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-30T08:07:48.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-30T08:07:48.738 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:48.738 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-30T08:07:48.758 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-30T08:07:48.823 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-30T08:07:48.823 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:48.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-01-30T08:07:48.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-30T08:07:48.906 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:48.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2024-01-30T08:07:48.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-30T08:07:48.991 INFO:teuthology.run_tasks:Running task ceph... 2024-01-30T08:07:49.080 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-30T08:07:49.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-01-30T08:07:49.084 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /var/log/ceph 2024-01-30T08:07:49.103 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-30T08:07:49.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-30T08:07:49.150 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-30T08:07:49.169 INFO:tasks.ceph:Creating extra log directories... 2024-01-30T08:07:49.169 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-30T08:07:49.210 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-30T08:07:49.238 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-30T08:07:49.238 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-30T08:07:49.238 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-30T08:07:49.239 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:49.239 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-30T08:07:49.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-30T08:07:49.375 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:49.376 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-30T08:07:49.384 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-30T08:07:49.480 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-30T08:07:49.480 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-30T08:07:49.480 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527', 'branch': 'wip-vshankar-testing-20240125.044502', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7537527', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240125.044502'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240125.044502', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 9619, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'sleep_before_teardown': 0, 'subset': '293/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240125.044502', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '661946e7044723130c03627323f6a879a9848cb5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhcXTz47Q+zkZzTIXI2j0hmxu83s4Q995ZrafznMRDBN9wT/6b91rIdjaURyGLi/T//ffQ16Huu2EBCf5xKBRY=', 'smithi125.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBISYSxzPJZxz2tLlA24jtu5bAFrYxWA3NZeD2gUlridovHbk4HybnS7vBAPs6U45ldUaxhJDNwBpxu2lt13Gv/g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6128cc3ecb49b7d62475e3595041c19b5326ca7c', 'timestamp': '2024-01-30_07:34:06', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-30T08:07:49.481 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-30T08:07:49.484 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-30T08:07:49.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-01-30T08:07:49.534 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/run/ceph 2024-01-30T08:07:49.554 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:49.554 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-01-30T08:07:49.607 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-30T08:07:49.608 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-01-30 08:01:23.026661992 +0000 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-01-30 08:01:22.758664386 +0000 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-01-30 08:01:22.758664386 +0000 2024-01-30T08:07:49.660 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-01-30 08:01:22.758664386 +0000 2024-01-30T08:07:49.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-30T08:07:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-01-30T08:07:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-01-30T08:07:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00024762 s, 2.1 MB/s 2024-01-30T08:07:49.723 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-30T08:07:49.777 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-01-30T08:07:49.827 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-30T08:07:49.827 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:49.828 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-01-30T08:07:49.828 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:49.828 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-01-30 08:01:23.526657526 +0000 2024-01-30T08:07:49.828 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-01-30 08:01:23.266659849 +0000 2024-01-30T08:07:49.828 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-01-30 08:01:23.266659849 +0000 2024-01-30T08:07:49.828 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-01-30 08:01:23.266659849 +0000 2024-01-30T08:07:49.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-30T08:07:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-01-30T08:07:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-01-30T08:07:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000247144 s, 2.1 MB/s 2024-01-30T08:07:49.891 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-30T08:07:49.945 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-01-30T08:07:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-30T08:07:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:49.996 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-01-30T08:07:49.996 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:49.996 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-01-30 08:01:24.034652989 +0000 2024-01-30T08:07:49.996 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-01-30 08:01:23.758655454 +0000 2024-01-30T08:07:49.996 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-01-30 08:01:23.758655454 +0000 2024-01-30T08:07:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-01-30 08:01:23.758655454 +0000 2024-01-30T08:07:49.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-30T08:07:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-01-30T08:07:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-01-30T08:07:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00024359 s, 2.1 MB/s 2024-01-30T08:07:50.058 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-30T08:07:50.109 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-01-30T08:07:50.159 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-30T08:07:50.160 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:50.160 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 950 Links: 1 2024-01-30T08:07:50.160 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:50.160 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-01-30 08:01:24.550648381 +0000 2024-01-30T08:07:50.160 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-01-30 08:01:24.294650667 +0000 2024-01-30T08:07:50.160 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-01-30 08:01:24.294650667 +0000 2024-01-30T08:07:50.160 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-01-30 08:01:24.294650667 +0000 2024-01-30T08:07:50.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-30T08:07:50.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-01-30T08:07:50.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-01-30T08:07:50.221 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000235987 s, 2.2 MB/s 2024-01-30T08:07:50.223 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-30T08:07:50.280 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-30T08:07:50.281 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:50.281 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2024-01-30T08:07:50.290 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-30T08:07:50.290 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2024-01-30T08:07:50.340 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-30T08:07:50.340 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:50.340 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-01-30T08:07:50.340 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:50.340 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-01-30 08:01:23.042688933 +0000 2024-01-30T08:07:50.340 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-01-30 08:01:22.750691540 +0000 2024-01-30T08:07:50.341 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-01-30 08:01:22.750691540 +0000 2024-01-30T08:07:50.341 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-01-30 08:01:22.750691540 +0000 2024-01-30T08:07:50.341 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-30T08:07:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-01-30T08:07:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-01-30T08:07:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000371478 s, 1.4 MB/s 2024-01-30T08:07:50.403 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-30T08:07:50.453 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2024-01-30T08:07:50.503 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-30T08:07:50.503 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:50.503 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-01-30T08:07:50.504 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:50.504 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-01-30 08:01:23.550684395 +0000 2024-01-30T08:07:50.504 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-01-30 08:01:23.290686718 +0000 2024-01-30T08:07:50.504 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-01-30 08:01:23.290686718 +0000 2024-01-30T08:07:50.504 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-01-30 08:01:23.290686718 +0000 2024-01-30T08:07:50.504 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-30T08:07:50.565 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-01-30T08:07:50.565 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-01-30T08:07:50.565 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000628366 s, 815 kB/s 2024-01-30T08:07:50.567 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-30T08:07:50.617 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2024-01-30T08:07:50.667 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-30T08:07:50.667 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:50.668 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-01-30T08:07:50.668 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:50.668 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-01-30 08:01:24.102679465 +0000 2024-01-30T08:07:50.668 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-01-30 08:01:23.830681894 +0000 2024-01-30T08:07:50.668 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-01-30 08:01:23.830681894 +0000 2024-01-30T08:07:50.668 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-01-30 08:01:23.830681894 +0000 2024-01-30T08:07:50.668 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-30T08:07:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-01-30T08:07:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-01-30T08:07:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000347112 s, 1.5 MB/s 2024-01-30T08:07:50.731 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-30T08:07:50.781 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2024-01-30T08:07:50.831 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-30T08:07:50.831 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-30T08:07:50.831 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 950 Links: 1 2024-01-30T08:07:50.831 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-30T08:07:50.831 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-01-30 08:01:24.662674462 +0000 2024-01-30T08:07:50.831 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-01-30 08:01:24.390676891 +0000 2024-01-30T08:07:50.831 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-01-30 08:01:24.390676891 +0000 2024-01-30T08:07:50.832 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-01-30 08:01:24.390676891 +0000 2024-01-30T08:07:50.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-30T08:07:50.888 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-01-30T08:07:50.888 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-01-30T08:07:50.888 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000341848 s, 1.5 MB/s 2024-01-30T08:07:50.890 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-30T08:07:50.941 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-30T08:07:50.941 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-30T08:07:50.941 INFO:tasks.ceph:Generating config... 2024-01-30T08:07:50.942 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-30T08:07:50.943 INFO:tasks.ceph:[client] debug client = 20 2024-01-30T08:07:50.943 INFO:tasks.ceph:[client] debug ms = 1 2024-01-30T08:07:50.943 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-30T08:07:50.943 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-30T08:07:50.943 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-30T08:07:50.943 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-30T08:07:50.944 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-30T08:07:50.944 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-30T08:07:50.944 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-30T08:07:50.944 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-30T08:07:50.944 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-30T08:07:50.944 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-30T08:07:50.944 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-30T08:07:50.945 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-30T08:07:50.945 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-30T08:07:50.945 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-30T08:07:50.945 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-30T08:07:50.945 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-30T08:07:50.945 INFO:tasks.ceph:Setting up mon.a... 2024-01-30T08:07:50.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-30T08:07:50.993 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2024-01-30T08:07:51.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-30T08:07:51.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-30T08:07:51.088 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.125'), ('mon.c', '[v2:172.21.15.125:3301,v1:172.21.15.125:6790]')] 2024-01-30T08:07:51.089 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-30T08:07:51.090 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:51.090 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-30T08:07:51.139 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.125 --addv c '[v2:172.21.15.125:3301,v1:172.21.15.125:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid d5419c7a-21ba-491f-86e9-4d6001549d1c 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:fsid d5419c7a-21ba-491f-86e9-4d6001549d1c 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2024-01-30T08:07:51.235257+0000 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-01-30T08:07:51.235257+0000 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 17 (quincy) 2024-01-30T08:07:51.232 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2024-01-30T08:07:51.233 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-01-30T08:07:51.233 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon.b 2024-01-30T08:07:51.233 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] mon.c 2024-01-30T08:07:51.233 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-30T08:07:51.235 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-30T08:07:51.244 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d5419c7a-21ba-491f-86e9-4d6001549d1c... 2024-01-30T08:07:51.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-30T08:07:51.290 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-30T08:07:51.330 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-01-30T08:07:51.330 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-01-30T08:07:51.330 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-30T08:07:51.331 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-01-30T08:07:51.332 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-01-30T08:07:51.333 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]" 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = d5419c7a-21ba-491f-86e9-4d6001549d1c 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-01-30T08:07:51.334 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.335 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore compression mode = aggressive 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-01-30T08:07:51.336 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-01-30T08:07:51.337 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-30T08:07:51.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-01-30T08:07:51.339 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-01-30T08:07:51.340 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-01-30T08:07:51.341 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-01-30T08:07:51.341 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-01-30T08:07:51.341 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2024-01-30T08:07:51.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-01-30T08:07:51.341 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-01-30T08:07:51.341 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-01-30T08:07:51.341 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.342 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2024-01-30T08:07:51.343 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: mon_allow_pool_size_one = true 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.50,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]" 2024-01-30T08:07:51.344 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on skipped message = False 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = d5419c7a-21ba-491f-86e9-4d6001549d1c 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd mclock profile = high_recovery_ops 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2024-01-30T08:07:51.345 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug trim objects = true 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2024-01-30T08:07:51.346 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore compression mode = aggressive 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2024-01-30T08:07:51.347 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2024-01-30T08:07:51.348 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: # 1m isn't quite enough 2024-01-30T08:07:51.349 INFO:teuthology.orchestra.run.smithi125.stdout: mon_down_mkfs_grace = 2m 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_filestore_osds = false 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2024-01-30T08:07:51.350 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds balancer = 20 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2024-01-30T08:07:51.351 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2024-01-30T08:07:51.353 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-30T08:07:51.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-30T08:07:51.453 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-30T08:07:51.453 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:51.453 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-30T08:07:51.462 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:51.462 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-30T08:07:51.515 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:07:51.515 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:51.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-30T08:07:51.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-30T08:07:51.587 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:07:51.587 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:07:51.639 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:07:51.639 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:51.639 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-30T08:07:51.639 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-30T08:07:51.671 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:07:51.671 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:07:51.719 INFO:tasks.ceph:Setting up mon nodes... 2024-01-30T08:07:51.720 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-30T08:07:51.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-30T08:07:51.776 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-30T08:07:51.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-30T08:07:51.837 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-30T08:07:51.856 INFO:tasks.ceph:Setting up mds nodes... 2024-01-30T08:07:51.856 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-30T08:07:51.913 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-30T08:07:51.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-30T08:07:51.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-30T08:07:52.039 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-30T08:07:52.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-30T08:07:52.064 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-30T08:07:52.119 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-30T08:07:52.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-30T08:07:52.142 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-30T08:07:52.237 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-30T08:07:52.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-30T08:07:52.261 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-30T08:07:52.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-30T08:07:52.305 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-30T08:07:52.323 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-30T08:07:52.365 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-30T08:07:52.382 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-30T08:07:52.383 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-30T08:07:52.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-30T08:07:52.403 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-30T08:07:52.403 INFO:tasks.ceph:role: osd.0 2024-01-30T08:07:52.403 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:07:52.403 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-30T08:07:52.466 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:07:52.466 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:07:52.466 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:07:52.466 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:07:52.466 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:07:52.466 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:07:52.467 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:07:52.467 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:07:52.467 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:07:52.467 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:07:52.491 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-01-30T08:07:52.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-01-30T08:07:52.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-30T08:07:52.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-30T08:07:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:07:52.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:07:52.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-30T08:07:52.686 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-30T08:07:52.686 INFO:tasks.ceph:role: osd.1 2024-01-30T08:07:52.686 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:07:52.686 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-30T08:07:52.750 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:07:52.750 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:07:52.750 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:07:52.750 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:07:52.751 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:07:52.751 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:07:52.751 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:07:52.751 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:07:52.751 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:07:52.751 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:07:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-01-30T08:07:52.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-01-30T08:07:52.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-30T08:07:52.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-30T08:07:52.910 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:07:52.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:07:52.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-30T08:07:52.974 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-30T08:07:52.974 INFO:tasks.ceph:role: osd.2 2024-01-30T08:07:52.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:07:52.974 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-30T08:07:53.037 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:07:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:07:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:07:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:07:53.038 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:07:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:07:53.038 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:07:53.038 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:07:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:07:53.038 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:07:53.061 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-01-30T08:07:53.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-01-30T08:07:53.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-30T08:07:53.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-30T08:07:53.190 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:07:53.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:07:53.192 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-30T08:07:53.258 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-30T08:07:53.258 INFO:tasks.ceph:role: osd.3 2024-01-30T08:07:53.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:07:53.258 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-30T08:07:53.317 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:07:53.318 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:07:53.342 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-01-30T08:07:53.345 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-01-30T08:07:53.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-30T08:07:53.411 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-30T08:07:53.470 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:07:53.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:07:53.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:07:53.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:53.598+0000 7f74182b27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-30T08:07:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:53.598+0000 7f74182b27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-30T08:07:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:53.598+0000 7f74182b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-30T08:07:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:53.598+0000 7f74182b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-30T08:07:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:53.598+0000 7f74182b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-30T08:07:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:53.602+0000 7f74182b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-30T08:07:56.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-30T08:07:56.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:07:56.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:56.682+0000 7f40b27317c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-30T08:07:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:56.682+0000 7f40b27317c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-30T08:07:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:56.682+0000 7f40b27317c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-30T08:07:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:56.682+0000 7f40b27317c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-30T08:07:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:56.682+0000 7f40b27317c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-30T08:07:56.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:56.682+0000 7f40b27317c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-30T08:07:59.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-30T08:07:59.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:07:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:59.778+0000 7fa9551b67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-30T08:07:59.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:59.778+0000 7fa9551b67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-30T08:07:59.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:59.778+0000 7fa9551b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-30T08:07:59.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:59.778+0000 7fa9551b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-30T08:07:59.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:59.778+0000 7fa9551b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-30T08:07:59.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:07:59.782+0000 7fa9551b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-30T08:08:02.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-30T08:08:02.779 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:08:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:02.882+0000 7fa1195137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-30T08:08:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:02.886+0000 7fa1195137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-30T08:08:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:02.886+0000 7fa1195137c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-30T08:08:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:02.886+0000 7fa1195137c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-30T08:08:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:02.886+0000 7fa1195137c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-30T08:08:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:02.886+0000 7fa1195137c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-30T08:08:05.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-30T08:08:05.881 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-30T08:08:05.903 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-30T08:08:05.904 INFO:tasks.ceph:role: osd.4 2024-01-30T08:08:05.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:08:05.904 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:08:05.976 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:08:05.977 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:08:05.977 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:08:06.440 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2024-01-30T08:08:06.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2024-01-30T08:08:06.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-30T08:08:06.564 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-30T08:08:06.582 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:08:06.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:08:06.583 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-30T08:08:06.648 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-30T08:08:06.648 INFO:tasks.ceph:role: osd.5 2024-01-30T08:08:06.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:08:06.649 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-30T08:08:06.723 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:08:06.724 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:08:07.218 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2024-01-30T08:08:07.221 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2024-01-30T08:08:07.221 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-30T08:08:07.367 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-30T08:08:07.384 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:08:07.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:08:07.385 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-30T08:08:07.447 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-30T08:08:07.447 INFO:tasks.ceph:role: osd.6 2024-01-30T08:08:07.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:08:07.448 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:08:07.520 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:08:07.984 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2024-01-30T08:08:07.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2024-01-30T08:08:07.987 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-30T08:08:08.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-30T08:08:08.143 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:08:08.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:08:08.145 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-30T08:08:08.208 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-30T08:08:08.208 INFO:tasks.ceph:role: osd.7 2024-01-30T08:08:08.208 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:08:08.208 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-30T08:08:08.279 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-30T08:08:08.750 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2024-01-30T08:08:08.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2024-01-30T08:08:08.753 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-30T08:08:08.881 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-30T08:08:08.898 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2024-01-30T08:08:08.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:08:08.900 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:08:09.024 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:09.024+0000 7fe2e33577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-30T08:08:09.026 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:09.024+0000 7fe2e33577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-30T08:08:09.026 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:09.024+0000 7fe2e33577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-30T08:08:09.026 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:09.024+0000 7fe2e33577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-30T08:08:09.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:09.024+0000 7fe2e33577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-30T08:08:09.031 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:09.028+0000 7fe2e33577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-30T08:08:12.007 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-30T08:08:12.028 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:08:12.126 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:12.124+0000 7f263202f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-30T08:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:12.124+0000 7f263202f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-30T08:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:12.124+0000 7f263202f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-30T08:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:12.124+0000 7f263202f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-30T08:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:12.124+0000 7f263202f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-30T08:08:12.128 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:12.128+0000 7f263202f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-30T08:08:15.121 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-30T08:08:15.141 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:08:15.238 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:15.236+0000 7fc59522c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-30T08:08:15.239 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:15.236+0000 7fc59522c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-30T08:08:15.239 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:15.236+0000 7fc59522c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-30T08:08:15.239 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:15.236+0000 7fc59522c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-30T08:08:15.239 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:15.236+0000 7fc59522c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-30T08:08:15.241 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:15.240+0000 7fc59522c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-30T08:08:18.211 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-30T08:08:18.233 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:08:18.330 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:18.328+0000 7fce211887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-30T08:08:18.331 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:18.328+0000 7fce211887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-30T08:08:18.331 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:18.328+0000 7fce211887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-30T08:08:18.331 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:18.328+0000 7fce211887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-30T08:08:18.331 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:18.328+0000 7fce211887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-30T08:08:18.332 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:18.332+0000 7fce211887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-30T08:08:19.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:08:19.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:08:21.301 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-30T08:08:21.321 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-30T08:08:21.322 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:21.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-30T08:08:21.344 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:21.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-30T08:08:21.408 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:21.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-30T08:08:21.472 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:21.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-30T08:08:21.536 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:21.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-30T08:08:21.600 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:21.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-30T08:08:21.664 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:21.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-30T08:08:21.727 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:21.727 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-30T08:08:21.747 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:21.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-30T08:08:21.810 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:21.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-30T08:08:21.871 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:21.871 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-30T08:08:21.930 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:21.930 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-30T08:08:21.990 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:21.990 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-30T08:08:22.050 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:22.050 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-30T08:08:22.110 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:22.110 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-30T08:08:22.120 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:22.120 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-30T08:08:22.160 INFO:tasks.ceph:Adding keys to all mons... 2024-01-30T08:08:22.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-30T08:08:22.166 DEBUG:teuthology.orchestra.run.smithi125:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-30T08:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-01-30T08:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBXrrhlaYB7LhAAtEmx+7QKPUsk/+5vCS9Rlg== 2024-01-30T08:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-01-30T08:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBXrrhlkD2hNhAAXYjZ0QTFYxTp9mLj1em8xw== 2024-01-30T08:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-01-30T08:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYrrhltxaIAhAAtqFHdt4nNxZanICnrpJsgg== 2024-01-30T08:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBZrrhlBRfTIxAAhoX4TrCAMjM38ixfwCQU9g== 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBcrrhlNGfAKBAA+6sIKe698qA8lpC8moXgig== 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBfrrhlcRSaLhAAZubT5hOgmX63JCH35fbe/Q== 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBirrhl+PTdNBAAaWMvlhD8RGUud1klkK6Crg== 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBXrrhljUoUMhAAVP+4udwrDtDiiXGasLeH6Q== 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYrrhlkO1ABxAAed/OWn44FKEIdesiCI4rrg== 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYrrhlyltVDhAA7WyzABIZFBpChkvMguYCvQ== 2024-01-30T08:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBprrhlbU6bARAAcl/ip+3EywM/iZQ5kkZSIA== 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBsrrhlriiwBxAAe9zGIoOijrys4oBRqhFUhA== 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBvrrhlEdRsDhAAjz108AFZ63EPh0xntikGcg== 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQByrrhlIAbWExAAa9qGiE5/A7ryFoK1ipPySA== 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYrrhlySttEhAA25eE5QwNAjdOZsKcoh9Fhw== 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2024-01-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYrrhlwkDyFRAAgm1JuVaCD1chL8w929N1hQ== 2024-01-30T08:08:22.220 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.y] 2024-01-30T08:08:22.220 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBXrrhlaYB7LhAAtEmx+7QKPUsk/+5vCS9Rlg== 2024-01-30T08:08:22.220 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2024-01-30T08:08:22.220 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBXrrhlkD2hNhAAXYjZ0QTFYxTp9mLj1em8xw== 2024-01-30T08:08:22.220 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2024-01-30T08:08:22.220 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBYrrhltxaIAhAAtqFHdt4nNxZanICnrpJsgg== 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.0] 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBZrrhlBRfTIxAAhoX4TrCAMjM38ixfwCQU9g== 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.1] 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBcrrhlNGfAKBAA+6sIKe698qA8lpC8moXgig== 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.2] 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBfrrhlcRSaLhAAZubT5hOgmX63JCH35fbe/Q== 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.3] 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBirrhl+PTdNBAAaWMvlhD8RGUud1klkK6Crg== 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.x] 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBXrrhljUoUMhAAVP+4udwrDtDiiXGasLeH6Q== 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBYrrhlkO1ABxAAed/OWn44FKEIdesiCI4rrg== 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2024-01-30T08:08:22.221 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBYrrhlyltVDhAA7WyzABIZFBpChkvMguYCvQ== 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.4] 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBprrhlbU6bARAAcl/ip+3EywM/iZQ5kkZSIA== 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.5] 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBsrrhlriiwBxAAe9zGIoOijrys4oBRqhFUhA== 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.6] 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBvrrhlEdRsDhAAjz108AFZ63EPh0xntikGcg== 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.7] 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQByrrhlIAbWExAAa9qGiE5/A7ryFoK1ipPySA== 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout:[client.0] 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBYrrhlySttEhAA25eE5QwNAjdOZsKcoh9Fhw== 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout:[client.1] 2024-01-30T08:08:22.222 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBYrrhlwkDyFRAAgm1JuVaCD1chL8w929N1hQ== 2024-01-30T08:08:22.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-30T08:08:22.253 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-30T08:08:22.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.320 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.380 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.497 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.553 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.610 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-30T08:08:22.666 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-30T08:08:22.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.723 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.779 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-30T08:08:22.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.899 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:22.956 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:23.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:23.012 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-30T08:08:23.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-30T08:08:23.070 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-30T08:08:23.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-30T08:08:23.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-30T08:08:23.186 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-30T08:08:23.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-30T08:08:23.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-30T08:08:23.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-30T08:08:23.338 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-30T08:08:23.358 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-30T08:08:23.465 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-30T08:08:23.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-30T08:08:23.546 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-30T08:08:23.654 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-30T08:08:23.674 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:08:23.677 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-30T08:08:23.727 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-30T08:08:23.727 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-30T08:08:23.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-30T08:08:23.730 INFO:tasks.ceph.mon.a:Started 2024-01-30T08:08:23.730 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-30T08:08:23.730 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-30T08:08:23.774 INFO:tasks.ceph.mon.b:Started 2024-01-30T08:08:23.774 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-30T08:08:23.775 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-30T08:08:23.777 INFO:tasks.ceph.mon.c:Started 2024-01-30T08:08:23.778 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-30T08:08:23.778 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-30T08:08:23.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-30T08:08:23.781 INFO:tasks.ceph.mgr.y:Started 2024-01-30T08:08:23.781 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-30T08:08:23.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-30T08:08:23.784 INFO:tasks.ceph.mgr.x:Started 2024-01-30T08:08:23.784 INFO:tasks.ceph:Setting crush tunables to default 2024-01-30T08:08:23.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2024-01-30T08:08:23.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.925+0000 7f0aee600640 1 Processor -- start 2024-01-30T08:08:23.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0aee600640 1 -- start start 2024-01-30T08:08:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0aee600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 0x7f0ae80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0aee600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 0x7f0ae806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0aee600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae8158b70 con 0x7f0ae80c1200 2024-01-30T08:08:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0aee600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae8157f60 con 0x7f0ae8155500 2024-01-30T08:08:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0aee600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae8158240 con 0x7f0ae806f240 2024-01-30T08:08:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 0x7f0ae80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 0x7f0ae80c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37492/0 (socket says 172.21.15.50:37492) 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae7400640 1 -- 172.21.15.50:0/2385930891 learned_addr learned my addr 172.21.15.50:0/2385930891 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae7400640 1 -- 172.21.15.50:0/2385930891 >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 msgr2=0x7f0ae80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae7400640 1 -- 172.21.15.50:0/2385930891 >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 msgr2=0x7f0ae80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae7400640 1 --2- 172.21.15.50:0/2385930891 >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 0x7f0ae80c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae6a00640 1 --2- 172.21.15.50:0/2385930891 >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 0x7f0ae806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae7400640 1 --2- 172.21.15.50:0/2385930891 >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 0x7f0ae80c85e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae6a00640 1 -- 172.21.15.50:0/2385930891 >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 msgr2=0x7f0ae806f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae6a00640 1 -- 172.21.15.50:0/2385930891 >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 msgr2=0x7f0ae806f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae6a00640 1 --2- 172.21.15.50:0/2385930891 >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 0x7f0ae806f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-30T08:08:23.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:23.929+0000 7f0ae6a00640 1 --2- 172.21.15.50:0/2385930891 >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 0x7f0ae806f6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-30T08:08:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581528918 0 0) 0x7f0ae8158b70 con 0x7f0ae80c1200 2024-01-30T08:08:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac8003530 con 0x7f0ae80c1200 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028559335 0 0) 0x7f0ac8003530 con 0x7f0ae80c1200 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 msgr2=0x7f0ae806f6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 --2- 172.21.15.50:0/2385930891 >> v2:172.21.15.125:3300/0 conn(0x7f0ae806f240 0x7f0ae806f6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 msgr2=0x7f0ae80c85e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 --2- 172.21.15.50:0/2385930891 >> v2:172.21.15.50:3300/0 conn(0x7f0ae8155500 0x7f0ae80c85e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8158520 con 0x7f0ae80c1200 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f0ae0001a00 con 0x7f0ae80c1200 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 >> v1:172.21.15.50:6789/0 conn(0x7f0ae80c1200 legacy=0x7f0ae80c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ac80039d0 0x7f0ac8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80047d0 0x7f0ac8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae7400640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ac80039d0 0x7f0ac8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac80052b0 0x7f0ac800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8157f60 con 0x7f0ac80052b0 2024-01-30T08:08:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8158240 con 0x7f0ac80047d0 2024-01-30T08:08:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac800c200 con 0x7f0ac80039d0 2024-01-30T08:08:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae7e00640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac80052b0 0x7f0ac800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.077+0000 7f0ae6a00640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80047d0 0x7f0ac8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.081+0000 7f0ae7400640 1 -- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80047d0 msgr2=0x7f0ac8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.081+0000 7f0ae7400640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80047d0 0x7f0ac8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.081+0000 7f0ae7400640 1 -- 172.21.15.50:0/2385930891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac80052b0 msgr2=0x7f0ac800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.081+0000 7f0ae7400640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac80052b0 0x7f0ac800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.081+0000 7f0ae7400640 1 -- 172.21.15.50:0/2385930891 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8003530 con 0x7f0ac80039d0 2024-01-30T08:08:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.081+0000 7f0ae7e00640 1 -- 172.21.15.50:0/2385930891 reap_dead start 2024-01-30T08:08:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.081+0000 7f0ae7400640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ac80039d0 0x7f0ac8003df0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009890 tx=0x7f0ad801c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f47dd08b1063b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.085+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80aa640 con 0x7f0ac80039d0 2024-01-30T08:08:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.085+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad80aa7a0 con 0x7f0ac80039d0 2024-01-30T08:08:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.085+0000 7f0ae6000640 1 -- 172.21.15.50:0/2385930891 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80aab50 con 0x7f0ac80039d0 2024-01-30T08:08:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 -- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ac80039d0 msgr2=0x7f0ac8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ac80039d0 0x7f0ac8003df0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009890 tx=0x7f0ad801c5a0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 -- 172.21.15.50:0/2385930891 shutdown_connections 2024-01-30T08:08:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 --2- 172.21.15.50:0/2385930891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ac80039d0 0x7f0ac8003df0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 -- 172.21.15.50:0/2385930891 >> 172.21.15.50:0/2385930891 conn(0x7f0ae80727c0 msgr2=0x7f0ae806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 -- 172.21.15.50:0/2385930891 shutdown_connections 2024-01-30T08:08:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 -- 172.21.15.50:0/2385930891 wait complete. 2024-01-30T08:08:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 Processor -- start 2024-01-30T08:08:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.089+0000 7f0aee600640 1 -- start start 2024-01-30T08:08:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80039d0 0x7f0ae8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ae81e49d0 0x7f0ae80c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae81ed8d0 0x7f0ae81edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8152d40 con 0x7f0ae81e49d0 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae81ee290 con 0x7f0ac80039d0 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8152520 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80039d0 0x7f0ae8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ae81e49d0 0x7f0ae80c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae81ed8d0 0x7f0ae81edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80039d0 0x7f0ae8152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45558/0 (socket says 172.21.15.50:45558) 2024-01-30T08:08:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7400640 1 -- 172.21.15.50:0/729930668 learned_addr learned my addr 172.21.15.50:0/729930668 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7e00640 1 -- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80039d0 msgr2=0x7f0ae8152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7e00640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80039d0 0x7f0ae8152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7e00640 1 -- 172.21.15.50:0/729930668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ae81e49d0 msgr2=0x7f0ae80c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7e00640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ae81e49d0 0x7f0ae80c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7e00640 1 -- 172.21.15.50:0/729930668 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae81dff80 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7400640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80039d0 0x7f0ae8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae6a00640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ae81e49d0 0x7f0ae80c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0ae7e00640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae81ed8d0 0x7f0ae81edd50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80c7f20 tx=0x7f0ae000ff00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0adf400640 1 -- 172.21.15.50:0/729930668 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0006e30 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0adf400640 1 -- 172.21.15.50:0/729930668 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0003980 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0adf400640 1 -- 172.21.15.50:0/729930668 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0003d30 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae81e0260 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae81ed340 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0adf400640 1 -- 172.21.15.50:0/729930668 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0ae0005110 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0adf400640 1 -- 172.21.15.50:0/729930668 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0ae000dd10 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.093+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae8074a20 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.105+0000 7f0adf400640 1 -- 172.21.15.50:0/729930668 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f0ae001a070 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.169+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0ae80aa8d0 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.177+0000 7f0adf400640 1 -- 172.21.15.50:0/729930668 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0ae000d740 con 0x7f0ae81ed8d0 2024-01-30T08:08:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae81ed8d0 msgr2=0x7f0ae81edd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae81ed8d0 0x7f0ae81edd50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80c7f20 tx=0x7f0ae000ff00 comp rx=0 tx=0).stop 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 shutdown_connections 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae81ed8d0 0x7f0ae81edd50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ae81e49d0 0x7f0ae80c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 --2- 172.21.15.50:0/729930668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ac80039d0 0x7f0ae8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 >> 172.21.15.50:0/729930668 conn(0x7f0ae80727c0 msgr2=0x7f0ae806cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 shutdown_connections 2024-01-30T08:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:24.181+0000 7f0aee600640 1 -- 172.21.15.50:0/729930668 wait complete. 2024-01-30T08:08:24.198 INFO:tasks.ceph:check_enable_crimson: False 2024-01-30T08:08:24.198 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-30T08:08:24.198 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:24.199 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-30T08:08:24.219 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:24.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-30T08:08:24.282 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:24.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-30T08:08:24.305 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:24.305+0000 7f9c17e6c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-30T08:08:24.311 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:24.307+0000 7f98e2447180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-30T08:08:24.325 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:24.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-30T08:08:24.386 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:24.386 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-30T08:08:24.406 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:24.406 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-30T08:08:24.467 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:24.467 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-30T08:08:24.527 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:08:24.527 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-30T08:08:24.590 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 7704d7b5-acb4-42fd-a6f8-9dd35a4f109b 0 2024-01-30T08:08:24.766 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020fa00640 1 Processor -- start 2024-01-30T08:08:24.766 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020fa00640 1 -- start start 2024-01-30T08:08:24.767 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020fa00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02080c50d0 0x7f0208156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c5c90 0x7f02081566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020fa00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02080c8a50 con 0x7f02080c7ae0 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020fa00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080c7070 con 0x7f02080c50d0 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02080c8d30 con 0x7f02080c5c90 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020d000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02080c50d0 0x7f0208156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020da00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c5c90 0x7f02081566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020d000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02080c50d0 0x7f0208156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39678/0 (socket says 172.21.15.125:39678) 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020d000640 1 -- 172.21.15.125:0/1584878815 learned_addr learned my addr 172.21.15.125:0/1584878815 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:24.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020da00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c5c90 0x7f02081566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58448/0 (socket says 172.21.15.125:58448) 2024-01-30T08:08:24.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020d000640 1 -- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c5c90 msgr2=0x7f02081566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:24.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020d000640 1 --2- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c5c90 0x7f02081566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020d000640 1 -- 172.21.15.125:0/1584878815 >> v1:172.21.15.50:6789/0 conn(0x7f02080c7ae0 legacy=0x7f02080c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020d000640 1 -- 172.21.15.125:0/1584878815 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080c66d0 con 0x7f02080c50d0 2024-01-30T08:08:24.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.763+0000 7f020da00640 1 --2- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c5c90 0x7f02081566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:24.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f020d000640 1 --2- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c50d0 0x7f0208156190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009870 tx=0x7f01f801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f420618da34b67f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:24.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f0207400640 1 -- 172.21.15.125:0/1584878815 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80ab5f0 con 0x7f02080c50d0 2024-01-30T08:08:24.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f0207400640 1 -- 172.21.15.125:0/1584878815 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80ab750 con 0x7f02080c50d0 2024-01-30T08:08:24.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f0207400640 1 -- 172.21.15.125:0/1584878815 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80abae0 con 0x7f02080c50d0 2024-01-30T08:08:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f020fa00640 1 -- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c50d0 msgr2=0x7f0208156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f020fa00640 1 --2- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c50d0 0x7f0208156190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009870 tx=0x7f01f801c3f0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f020fa00640 1 -- 172.21.15.125:0/1584878815 shutdown_connections 2024-01-30T08:08:24.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f020fa00640 1 --2- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c5c90 0x7f02081566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.773 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f020fa00640 1 --2- 172.21.15.125:0/1584878815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c50d0 0x7f0208156190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.773 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.767+0000 7f020fa00640 1 -- 172.21.15.125:0/1584878815 >> 172.21.15.125:0/1584878815 conn(0x7f02080727c0 msgr2=0x7f020806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:24.773 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 -- 172.21.15.125:0/1584878815 shutdown_connections 2024-01-30T08:08:24.773 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 -- 172.21.15.125:0/1584878815 wait complete. 2024-01-30T08:08:24.774 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 Processor -- start 2024-01-30T08:08:24.774 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 -- start start 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c50d0 0x7f0208148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c5c90 0x7f02080abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02080c7ae0 0x7f02080aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02081ed520 con 0x7f02080c7ae0 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020806d450 con 0x7f02080c5c90 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208147f80 con 0x7f02080c50d0 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f0207e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c5c90 0x7f02080abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020d000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c50d0 0x7f0208148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020d000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c50d0 0x7f0208148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58458/0 (socket says 172.21.15.125:58458) 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020d000640 1 -- 172.21.15.125:0/789963005 learned_addr learned my addr 172.21.15.125:0/789963005 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020da00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02080c7ae0 0x7f02080aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:24.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f0207e00640 1 -- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c50d0 msgr2=0x7f0208148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.777 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f0207e00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c50d0 0x7f0208148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.777 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f0207e00640 1 -- 172.21.15.125:0/789963005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02080c7ae0 msgr2=0x7f02080aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.777 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f0207e00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02080c7ae0 0x7f02080aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.777 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f0207e00640 1 -- 172.21.15.125:0/789963005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200009a70 con 0x7f02080c5c90 2024-01-30T08:08:24.777 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f020d000640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c50d0 0x7f0208148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:24.777 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.771+0000 7f0207e00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c5c90 0x7f02080abf10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000f70 tx=0x7f01f000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f0204c00640 1 -- 172.21.15.125:0/789963005 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f00052d0 con 0x7f02080c5c90 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f0204c00640 1 -- 172.21.15.125:0/789963005 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0005430 con 0x7f02080c5c90 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f0204c00640 1 -- 172.21.15.125:0/789963005 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0003840 con 0x7f02080c5c90 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f80094d0 con 0x7f02080c5c90 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02081eda80 con 0x7f02080c5c90 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f0204c00640 1 -- 172.21.15.125:0/789963005 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f01f00039a0 con 0x7f02080c5c90 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f0204c00640 1 -- 172.21.15.125:0/789963005 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f01f001c780 con 0x7f02080c5c90 2024-01-30T08:08:24.778 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.775+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0208067cc0 con 0x7f02080c5c90 2024-01-30T08:08:24.780 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.779+0000 7f0204c00640 1 -- 172.21.15.125:0/789963005 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f01f0017070 con 0x7f02080c5c90 2024-01-30T08:08:24.822 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:24.819+0000 7f98e2447180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-30T08:08:24.846 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:24.845+0000 7f9c17e6c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-30T08:08:24.848 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.843+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7704d7b5-acb4-42fd-a6f8-9dd35a4f109b", "id": 0} v 0) v1 -- 0x7f0208074a20 con 0x7f02080c5c90 2024-01-30T08:08:24.854 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f0204c00640 1 -- 172.21.15.125:0/789963005 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7704d7b5-acb4-42fd-a6f8-9dd35a4f109b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f01f0003e30 con 0x7f02080c5c90 2024-01-30T08:08:24.855 INFO:teuthology.orchestra.run.smithi125.stdout:0 2024-01-30T08:08:24.856 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c5c90 msgr2=0x7f02080abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:24.856 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f020fa00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c5c90 0x7f02080abf10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000f70 tx=0x7f01f000c760 comp rx=0 tx=0).stop 2024-01-30T08:08:24.856 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 shutdown_connections 2024-01-30T08:08:24.856 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f020fa00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02080c5c90 0x7f02080abf10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.856 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f020fa00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02080c7ae0 0x7f02080aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.856 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f020fa00640 1 --2- 172.21.15.125:0/789963005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02080c50d0 0x7f0208148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:24.856 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.851+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 >> 172.21.15.125:0/789963005 conn(0x7f02080727c0 msgr2=0x7f0208155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:24.857 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.855+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 shutdown_connections 2024-01-30T08:08:24.857 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:24.855+0000 7f020fa00640 1 -- 172.21.15.125:0/789963005 wait complete. 2024-01-30T08:08:24.875 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new c429378a-e521-47f6-b8ab-13e57215f8e3 1 2024-01-30T08:08:25.009 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6060c00640 1 Processor -- start 2024-01-30T08:08:25.010 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6060c00640 1 -- start start 2024-01-30T08:08:25.011 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6060c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c14fb50 0x7f605c152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.011 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6060c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f605c06a740 0x7f605c0a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.011 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6060c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c152ab0 con 0x7f605c0a6260 2024-01-30T08:08:25.011 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6060c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c0c21e0 con 0x7f605c06a740 2024-01-30T08:08:25.011 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6060c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c152d90 con 0x7f605c14fb50 2024-01-30T08:08:25.011 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f605c06a740 0x7f605c0a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.012 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c14fb50 0x7f605c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.012 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f605c06a740 0x7f605c0a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39700/0 (socket says 172.21.15.125:39700) 2024-01-30T08:08:25.012 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059400640 1 -- 172.21.15.125:0/1629996328 learned_addr learned my addr 172.21.15.125:0/1629996328 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.012 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059e00640 1 -- 172.21.15.125:0/1629996328 >> v2:172.21.15.125:3300/0 conn(0x7f605c06a740 msgr2=0x7f605c0a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:25.012 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059e00640 1 --2- 172.21.15.125:0/1629996328 >> v2:172.21.15.125:3300/0 conn(0x7f605c06a740 0x7f605c0a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.012 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059e00640 1 -- 172.21.15.125:0/1629996328 >> v1:172.21.15.50:6789/0 conn(0x7f605c0a6260 legacy=0x7f605c071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.012 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.007+0000 7f6059e00640 1 -- 172.21.15.125:0/1629996328 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c153070 con 0x7f605c14fb50 2024-01-30T08:08:25.014 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6059e00640 1 --2- 172.21.15.125:0/1629996328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c14fb50 0x7f605c152460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f604c0097a0 tx=0x7f604c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83285a6b0ff13602 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.014 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6058a00640 1 -- 172.21.15.125:0/1629996328 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c0ad660 con 0x7f605c14fb50 2024-01-30T08:08:25.014 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6058a00640 1 -- 172.21.15.125:0/1629996328 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c0ad7c0 con 0x7f605c14fb50 2024-01-30T08:08:25.014 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6058a00640 1 -- 172.21.15.125:0/1629996328 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c0adb50 con 0x7f605c14fb50 2024-01-30T08:08:25.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 -- 172.21.15.125:0/1629996328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c14fb50 msgr2=0x7f605c152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 --2- 172.21.15.125:0/1629996328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c14fb50 0x7f605c152460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f604c0097a0 tx=0x7f604c01c3a0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 -- 172.21.15.125:0/1629996328 shutdown_connections 2024-01-30T08:08:25.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 --2- 172.21.15.125:0/1629996328 >> v2:172.21.15.125:3300/0 conn(0x7f605c06a740 0x7f605c0a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 --2- 172.21.15.125:0/1629996328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c14fb50 0x7f605c152460 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 -- 172.21.15.125:0/1629996328 >> 172.21.15.125:0/1629996328 conn(0x7f605c0c3750 msgr2=0x7f605c0c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.016 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 -- 172.21.15.125:0/1629996328 shutdown_connections 2024-01-30T08:08:25.016 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.011+0000 7f6060c00640 1 -- 172.21.15.125:0/1629996328 wait complete. 2024-01-30T08:08:25.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 Processor -- start 2024-01-30T08:08:25.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 -- start start 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c06a740 0x7f605c1f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f605c0a6260 0x7f605c0a8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c14fb50 0x7f605c1ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c14c5d0 con 0x7f605c14fb50 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1f0380 con 0x7f605c0a6260 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1f0660 con 0x7f605c06a740 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c06a740 0x7f605c1f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f605c0a6260 0x7f605c0a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c06a740 0x7f605c1f0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58480/0 (socket says 172.21.15.125:58480) 2024-01-30T08:08:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 -- 172.21.15.125:0/433359471 learned_addr learned my addr 172.21.15.125:0/433359471 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f605a800640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c14fb50 0x7f605c1ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 -- 172.21.15.125:0/433359471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f605c0a6260 msgr2=0x7f605c0a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f605c0a6260 0x7f605c0a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 -- 172.21.15.125:0/433359471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c14fb50 msgr2=0x7f605c1ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c14fb50 0x7f605c1ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.020 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 -- 172.21.15.125:0/433359471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c0093b0 con 0x7f605c06a740 2024-01-30T08:08:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6059e00640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c06a740 0x7f605c1f0e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f604c0b0040 tx=0x7f604c01abe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6052000640 1 -- 172.21.15.125:0/433359471 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c0059a0 con 0x7f605c06a740 2024-01-30T08:08:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6052000640 1 -- 172.21.15.125:0/433359471 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c005b20 con 0x7f605c06a740 2024-01-30T08:08:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6052000640 1 -- 172.21.15.125:0/433359471 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c006020 con 0x7f605c06a740 2024-01-30T08:08:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c1f0940 con 0x7f605c06a740 2024-01-30T08:08:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.015+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c0aca70 con 0x7f605c06a740 2024-01-30T08:08:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.019+0000 7f6052000640 1 -- 172.21.15.125:0/433359471 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f604c006180 con 0x7f605c06a740 2024-01-30T08:08:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.019+0000 7f6052000640 1 -- 172.21.15.125:0/433359471 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f604c0b9d00 con 0x7f605c06a740 2024-01-30T08:08:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.019+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c0c3c60 con 0x7f605c06a740 2024-01-30T08:08:25.025 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.023+0000 7f6052000640 1 -- 172.21.15.125:0/433359471 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f604c0bd030 con 0x7f605c06a740 2024-01-30T08:08:25.061 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:25.059+0000 7f98e2447180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-30T08:08:25.065 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:25.065+0000 7f9c17e6c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-30T08:08:25.094 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.091+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c429378a-e521-47f6-b8ab-13e57215f8e3", "id": 1} v 0) v1 -- 0x7f605c0742d0 con 0x7f605c06a740 2024-01-30T08:08:25.098 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6052000640 1 -- 172.21.15.125:0/433359471 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c429378a-e521-47f6-b8ab-13e57215f8e3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f604c0b2070 con 0x7f605c06a740 2024-01-30T08:08:25.099 INFO:teuthology.orchestra.run.smithi125.stdout:1 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c06a740 msgr2=0x7f605c1f0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c06a740 0x7f605c1f0e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f604c0b0040 tx=0x7f604c01abe0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 shutdown_connections 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f605c0a6260 0x7f605c0a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c14fb50 0x7f605c1ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 --2- 172.21.15.125:0/433359471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f605c06a740 0x7f605c1f0e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 >> 172.21.15.125:0/433359471 conn(0x7f605c0c3750 msgr2=0x7f605c14e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 shutdown_connections 2024-01-30T08:08:25.100 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.095+0000 7f6060c00640 1 -- 172.21.15.125:0/433359471 wait complete. 2024-01-30T08:08:25.118 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 352c0520-b9ee-41ea-b931-fa6ba5c8faea 2 2024-01-30T08:08:25.253 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4cd2e00640 1 Processor -- start 2024-01-30T08:08:25.253 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4cd2e00640 1 -- start start 2024-01-30T08:08:25.254 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4cd2e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ccc0a6480 0x7f4ccc072870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.254 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4cd2e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc06a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.254 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4cd2e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ccc0c0a20 con 0x7f4ccc06ac80 2024-01-30T08:08:25.254 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4cd2e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ccc0716f0 con 0x7f4ccc0a6480 2024-01-30T08:08:25.254 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4cd2e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0c0c70 con 0x7f4ccc06f060 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccb400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc06a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccb400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc06a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58484/0 (socket says 172.21.15.125:58484) 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccb400640 1 -- 172.21.15.125:0/1255857972 learned_addr learned my addr 172.21.15.125:0/1255857972 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccbe00640 1 --2- 172.21.15.125:0/1255857972 >> v2:172.21.15.50:3300/0 conn(0x7f4ccc0a6480 0x7f4ccc072870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccb400640 1 -- 172.21.15.125:0/1255857972 >> v2:172.21.15.50:3300/0 conn(0x7f4ccc0a6480 msgr2=0x7f4ccc072870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccb400640 1 --2- 172.21.15.125:0/1255857972 >> v2:172.21.15.50:3300/0 conn(0x7f4ccc0a6480 0x7f4ccc072870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccb400640 1 -- 172.21.15.125:0/1255857972 >> v1:172.21.15.50:6789/0 conn(0x7f4ccc06ac80 legacy=0x7f4ccc071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.251+0000 7f4ccb400640 1 -- 172.21.15.125:0/1255857972 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc0c0f50 con 0x7f4ccc06f060 2024-01-30T08:08:25.260 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.255+0000 7f4ccb400640 1 --2- 172.21.15.125:0/1255857972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc06a740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009870 tx=0x7f4cb401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad3867866f4a7f40 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.260 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.255+0000 7f4ccaa00640 1 -- 172.21.15.125:0/1255857972 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40aa650 con 0x7f4ccc06f060 2024-01-30T08:08:25.260 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.255+0000 7f4ccaa00640 1 -- 172.21.15.125:0/1255857972 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb40aa7b0 con 0x7f4ccc06f060 2024-01-30T08:08:25.260 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.255+0000 7f4ccaa00640 1 -- 172.21.15.125:0/1255857972 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40aab40 con 0x7f4ccc06f060 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- 172.21.15.125:0/1255857972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 msgr2=0x7f4ccc06a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 --2- 172.21.15.125:0/1255857972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc06a740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009870 tx=0x7f4cb401c510 comp rx=0 tx=0).stop 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- 172.21.15.125:0/1255857972 shutdown_connections 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 --2- 172.21.15.125:0/1255857972 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc06a740 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 --2- 172.21.15.125:0/1255857972 >> v2:172.21.15.50:3300/0 conn(0x7f4ccc0a6480 0x7f4ccc072870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- 172.21.15.125:0/1255857972 >> 172.21.15.125:0/1255857972 conn(0x7f4ccc0c6c60 msgr2=0x7f4ccc0c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- 172.21.15.125:0/1255857972 shutdown_connections 2024-01-30T08:08:25.261 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- 172.21.15.125:0/1255857972 wait complete. 2024-01-30T08:08:25.262 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 Processor -- start 2024-01-30T08:08:25.262 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- start start 2024-01-30T08:08:25.265 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc06ac80 0x7f4ccc149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.265 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc0a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.265 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ccc0a6480 0x7f4ccc157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.265 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc155280 con 0x7f4ccc0a6480 2024-01-30T08:08:25.265 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0ab2a0 con 0x7f4ccc06ac80 2024-01-30T08:08:25.265 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd2e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0aa650 con 0x7f4ccc06f060 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc06ac80 0x7f4ccc149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4ccb400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc0a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc06ac80 0x7f4ccc149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39716/0 (socket says 172.21.15.125:39716) 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4ccb400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc0a7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58498/0 (socket says 172.21.15.125:58498) 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4ccbe00640 1 -- 172.21.15.125:0/4259169933 learned_addr learned my addr 172.21.15.125:0/4259169933 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.259+0000 7f4cd0e00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ccc0a6480 0x7f4ccc157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4ccbe00640 1 -- 172.21.15.125:0/4259169933 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 msgr2=0x7f4ccc0a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4ccbe00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc0a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4ccbe00640 1 -- 172.21.15.125:0/4259169933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ccc0a6480 msgr2=0x7f4ccc157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4ccbe00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ccc0a6480 0x7f4ccc157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4ccbe00640 1 -- 172.21.15.125:0/4259169933 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb40094d0 con 0x7f4ccc06ac80 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cd0e00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ccc0a6480 0x7f4ccc157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4ccbe00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc06ac80 0x7f4ccc149210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00e930 tx=0x7f4cbc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cc3e00640 1 -- 172.21.15.125:0/4259169933 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc009690 con 0x7f4ccc06ac80 2024-01-30T08:08:25.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cc3e00640 1 -- 172.21.15.125:0/4259169933 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc00ca00 con 0x7f4ccc06ac80 2024-01-30T08:08:25.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc0aa930 con 0x7f4ccc06ac80 2024-01-30T08:08:25.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cc3e00640 1 -- 172.21.15.125:0/4259169933 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00cd70 con 0x7f4ccc06ac80 2024-01-30T08:08:25.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc0aaf30 con 0x7f4ccc06ac80 2024-01-30T08:08:25.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cc3e00640 1 -- 172.21.15.125:0/4259169933 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4cbc0059a0 con 0x7f4ccc06ac80 2024-01-30T08:08:25.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cc3e00640 1 -- 172.21.15.125:0/4259169933 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4cbc006440 con 0x7f4ccc06ac80 2024-01-30T08:08:25.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.263+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc0c2aa0 con 0x7f4ccc06ac80 2024-01-30T08:08:25.268 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.267+0000 7f4cc3e00640 1 -- 172.21.15.125:0/4259169933 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f4cbc021060 con 0x7f4ccc06ac80 2024-01-30T08:08:25.335 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.331+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "352c0520-b9ee-41ea-b931-fa6ba5c8faea", "id": 2} v 0) v1 -- 0x7f4ccc067cc0 con 0x7f4ccc06ac80 2024-01-30T08:08:25.338 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.335+0000 7f4cc3e00640 1 -- 172.21.15.125:0/4259169933 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "352c0520-b9ee-41ea-b931-fa6ba5c8faea", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4cbc029020 con 0x7f4ccc06ac80 2024-01-30T08:08:25.339 INFO:teuthology.orchestra.run.smithi125.stdout:2 2024-01-30T08:08:25.340 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.335+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc06ac80 msgr2=0x7f4ccc149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.340 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.335+0000 7f4cd2e00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc06ac80 0x7f4ccc149210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00e930 tx=0x7f4cbc00edf0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.341 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.339+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 shutdown_connections 2024-01-30T08:08:25.341 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.339+0000 7f4cd2e00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ccc0a6480 0x7f4ccc157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.341 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.339+0000 7f4cd2e00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ccc06f060 0x7f4ccc0a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.341 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.339+0000 7f4cd2e00640 1 --2- 172.21.15.125:0/4259169933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ccc06ac80 0x7f4ccc149210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.341 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.339+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 >> 172.21.15.125:0/4259169933 conn(0x7f4ccc0c6c60 msgr2=0x7f4ccc15e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.341 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.339+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 shutdown_connections 2024-01-30T08:08:25.341 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.339+0000 7f4cd2e00640 1 -- 172.21.15.125:0/4259169933 wait complete. 2024-01-30T08:08:25.359 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 0a2aedc7-85af-45ec-b308-d82dc6f7d1b7 3 2024-01-30T08:08:25.495 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.491+0000 7f72c5400640 1 Processor -- start 2024-01-30T08:08:25.495 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.491+0000 7f72c5400640 1 -- start start 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.491+0000 7f72c5400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72c00c50d0 0x7f72c0156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.491+0000 7f72c5400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c01566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.491+0000 7f72c5400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00c8a50 con 0x7f72c00c7ae0 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.491+0000 7f72c5400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c00c7070 con 0x7f72c00c50d0 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.491+0000 7f72c5400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c8d30 con 0x7f72c00c5c90 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72c00c50d0 0x7f72c0156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72c00c50d0 0x7f72c0156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39732/0 (socket says 172.21.15.125:39732) 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 -- 172.21.15.125:0/4212195321 learned_addr learned my addr 172.21.15.125:0/4212195321 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72bf200640 1 --2- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c01566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 -- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 msgr2=0x7f72c01566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:25.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 --2- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c01566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 -- 172.21.15.125:0/4212195321 >> v1:172.21.15.125:6789/0 conn(0x7f72c00c7ae0 legacy=0x7f72c00c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 -- 172.21.15.125:0/4212195321 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00c66d0 con 0x7f72c00c50d0 2024-01-30T08:08:25.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72be800640 1 --2- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c0156190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009870 tx=0x7f72b001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af5c2aca5a8cbf1a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72bd400640 1 -- 172.21.15.125:0/4212195321 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00ab5f0 con 0x7f72c00c50d0 2024-01-30T08:08:25.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72bd400640 1 -- 172.21.15.125:0/4212195321 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b00ab750 con 0x7f72c00c50d0 2024-01-30T08:08:25.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.495+0000 7f72bd400640 1 -- 172.21.15.125:0/4212195321 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00abae0 con 0x7f72c00c50d0 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 msgr2=0x7f72c0156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 --2- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c0156190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009870 tx=0x7f72b001c3f0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- 172.21.15.125:0/4212195321 shutdown_connections 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 --2- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c01566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 --2- 172.21.15.125:0/4212195321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c0156190 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- 172.21.15.125:0/4212195321 >> 172.21.15.125:0/4212195321 conn(0x7f72c00727c0 msgr2=0x7f72c006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- 172.21.15.125:0/4212195321 shutdown_connections 2024-01-30T08:08:25.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- 172.21.15.125:0/4212195321 wait complete. 2024-01-30T08:08:25.503 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 Processor -- start 2024-01-30T08:08:25.503 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- start start 2024-01-30T08:08:25.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c01ef040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c00c7ae0 0x7f72c00ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0152220 con 0x7f72c00c7ae0 2024-01-30T08:08:25.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01ef580 con 0x7f72c00c50d0 2024-01-30T08:08:25.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72c5400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01445b0 con 0x7f72c00c5c90 2024-01-30T08:08:25.505 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72bde00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.505 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72bde00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c014ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58512/0 (socket says 172.21.15.125:58512) 2024-01-30T08:08:25.505 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.499+0000 7f72bde00640 1 -- 172.21.15.125:0/871449824 learned_addr learned my addr 172.21.15.125:0/871449824 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.505 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72be800640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c01ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.506 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72bde00640 1 -- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 msgr2=0x7f72c01ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.506 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72bde00640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c01ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.506 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72bde00640 1 -- 172.21.15.125:0/871449824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c00c7ae0 msgr2=0x7f72c00ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.506 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72bde00640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c00c7ae0 0x7f72c00ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.506 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72bde00640 1 -- 172.21.15.125:0/871449824 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00094d0 con 0x7f72c00c5c90 2024-01-30T08:08:25.506 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72be800640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c01ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:25.506 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72bde00640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c014ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f72a800c400 tx=0x7f72a800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72b6a00640 1 -- 172.21.15.125:0/871449824 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80052d0 con 0x7f72c00c5c90 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72b6a00640 1 -- 172.21.15.125:0/871449824 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8005430 con 0x7f72c00c5c90 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c0143ff0 con 0x7f72c00c5c90 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72b6a00640 1 -- 172.21.15.125:0/871449824 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8003840 con 0x7f72c00c5c90 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00aac20 con 0x7f72c00c5c90 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72b6a00640 1 -- 172.21.15.125:0/871449824 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f72a80039a0 con 0x7f72c00c5c90 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72b6a00640 1 -- 172.21.15.125:0/871449824 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f72a80128b0 con 0x7f72c00c5c90 2024-01-30T08:08:25.507 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.503+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c0067cc0 con 0x7f72c00c5c90 2024-01-30T08:08:25.509 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.507+0000 7f72b6a00640 1 -- 172.21.15.125:0/871449824 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f72a8017070 con 0x7f72c00c5c90 2024-01-30T08:08:25.575 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.571+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0a2aedc7-85af-45ec-b308-d82dc6f7d1b7", "id": 3} v 0) v1 -- 0x7f72c0074a20 con 0x7f72c00c5c90 2024-01-30T08:08:25.580 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.575+0000 7f72b6a00640 1 -- 172.21.15.125:0/871449824 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a2aedc7-85af-45ec-b308-d82dc6f7d1b7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72a8001130 con 0x7f72c00c5c90 2024-01-30T08:08:25.580 INFO:teuthology.orchestra.run.smithi125.stdout:3 2024-01-30T08:08:25.581 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 msgr2=0x7f72c014ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c014ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f72a800c400 tx=0x7f72a800c8c0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 shutdown_connections 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c00c7ae0 0x7f72c00ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c00c5c90 0x7f72c014ac80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 --2- 172.21.15.125:0/871449824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c00c50d0 0x7f72c01ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 >> 172.21.15.125:0/871449824 conn(0x7f72c00727c0 msgr2=0x7f72c0152360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 shutdown_connections 2024-01-30T08:08:25.582 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.579+0000 7f72c5400640 1 -- 172.21.15.125:0/871449824 wait complete. 2024-01-30T08:08:25.600 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 51da0b6b-27de-4642-a142-8ce77861f79b 4 2024-01-30T08:08:25.695 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:25.691+0000 7f98e2447180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-30T08:08:25.701 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:25.701+0000 7f9c17e6c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-30T08:08:25.735 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.731+0000 7f95ec000640 1 Processor -- start 2024-01-30T08:08:25.735 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.731+0000 7f95ec000640 1 -- start start 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.731+0000 7f95ec000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95e40c50d0 0x7f95e4156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.731+0000 7f95ec000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c7ae0 0x7f95e41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.731+0000 7f95ec000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e40c8a50 con 0x7f95e40c5c90 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.731+0000 7f95ec000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40c7070 con 0x7f95e40c50d0 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.731+0000 7f95ec000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40c8d30 con 0x7f95e40c7ae0 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c7ae0 0x7f95e41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95ea000640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f95e40c5c90 0x7f95e40c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45866/0 (socket says 172.21.15.125:45866) 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95ea000640 1 -- 172.21.15.125:0/1974637603 learned_addr learned my addr 172.21.15.125:0/1974637603 (peer_addr_for_me v1:172.21.15.125:0/0) 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e9600640 1 --2- 172.21.15.125:0/1974637603 >> v2:172.21.15.50:3300/0 conn(0x7f95e40c50d0 0x7f95e4156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e8c00640 1 -- 172.21.15.125:0/1974637603 >> v2:172.21.15.50:3300/0 conn(0x7f95e40c50d0 msgr2=0x7f95e4156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e8c00640 1 --2- 172.21.15.125:0/1974637603 >> v2:172.21.15.50:3300/0 conn(0x7f95e40c50d0 0x7f95e4156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.737 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e8c00640 1 -- 172.21.15.125:0/1974637603 >> v1:172.21.15.125:6789/0 conn(0x7f95e40c5c90 legacy=0x7f95e40c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.738 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e8c00640 1 -- 172.21.15.125:0/1974637603 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40c66d0 con 0x7f95e40c7ae0 2024-01-30T08:08:25.738 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e3e00640 1 -- 172.21.15.125:0/1974637603 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514665759 0 0) 0x7f95e40c8a50 con 0x7f95e40c5c90 2024-01-30T08:08:25.740 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e8c00640 1 --2- 172.21.15.125:0/1974637603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c7ae0 0x7f95e41566d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0097c0 tx=0x7f95cc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ca507d21acf712 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.740 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e3e00640 1 -- 172.21.15.125:0/1974637603 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0ac620 con 0x7f95e40c7ae0 2024-01-30T08:08:25.740 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e3e00640 1 -- 172.21.15.125:0/1974637603 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc0ac780 con 0x7f95e40c7ae0 2024-01-30T08:08:25.740 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.735+0000 7f95e3e00640 1 -- 172.21.15.125:0/1974637603 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0acb10 con 0x7f95e40c7ae0 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- 172.21.15.125:0/1974637603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c7ae0 msgr2=0x7f95e41566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 --2- 172.21.15.125:0/1974637603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c7ae0 0x7f95e41566d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0097c0 tx=0x7f95cc01c3c0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- 172.21.15.125:0/1974637603 shutdown_connections 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 --2- 172.21.15.125:0/1974637603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c7ae0 0x7f95e41566d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 --2- 172.21.15.125:0/1974637603 >> v2:172.21.15.50:3300/0 conn(0x7f95e40c50d0 0x7f95e4156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- 172.21.15.125:0/1974637603 >> 172.21.15.125:0/1974637603 conn(0x7f95e40727c0 msgr2=0x7f95e406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- 172.21.15.125:0/1974637603 shutdown_connections 2024-01-30T08:08:25.741 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- 172.21.15.125:0/1974637603 wait complete. 2024-01-30T08:08:25.743 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 Processor -- start 2024-01-30T08:08:25.743 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- start start 2024-01-30T08:08:25.744 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c50d0 0x7f95e406c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.744 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40c5c90 0x7f95e40c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e40c7ae0 0x7f95e41f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41ecd60 con 0x7f95e40c7ae0 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4151da0 con 0x7f95e40c5c90 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ec000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e406ce10 con 0x7f95e40c50d0 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95e8c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40c5c90 0x7f95e40c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95e9600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c50d0 0x7f95e406c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95e8c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40c5c90 0x7f95e40c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39756/0 (socket says 172.21.15.125:39756) 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95e9600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c50d0 0x7f95e406c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58530/0 (socket says 172.21.15.125:58530) 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95e8c00640 1 -- 172.21.15.125:0/3601737869 learned_addr learned my addr 172.21.15.125:0/3601737869 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.739+0000 7f95ea000640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e40c7ae0 0x7f95e41f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e8c00640 1 -- 172.21.15.125:0/3601737869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c50d0 msgr2=0x7f95e406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e8c00640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c50d0 0x7f95e406c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.745 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e8c00640 1 -- 172.21.15.125:0/3601737869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e40c7ae0 msgr2=0x7f95e41f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.746 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e8c00640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e40c7ae0 0x7f95e41f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.746 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e8c00640 1 -- 172.21.15.125:0/3601737869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc009420 con 0x7f95e40c5c90 2024-01-30T08:08:25.746 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e8c00640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40c5c90 0x7f95e40c1360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f95cc019ff0 tx=0x7f95cc019160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e1600640 1 -- 172.21.15.125:0/3601737869 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0b5400 con 0x7f95e40c5c90 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e1600640 1 -- 172.21.15.125:0/3601737869 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc0b5580 con 0x7f95e40c5c90 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e1600640 1 -- 172.21.15.125:0/3601737869 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0b5930 con 0x7f95e40c5c90 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e41ecf50 con 0x7f95e40c5c90 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e41ed510 con 0x7f95e40c5c90 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e1600640 1 -- 172.21.15.125:0/3601737869 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f95cc0b3040 con 0x7f95e40c5c90 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95e1600640 1 -- 172.21.15.125:0/3601737869 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f95cc0c1400 con 0x7f95e40c5c90 2024-01-30T08:08:25.747 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.743+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e4067cc0 con 0x7f95e40c5c90 2024-01-30T08:08:25.748 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.747+0000 7f95e1600640 1 -- 172.21.15.125:0/3601737869 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f95cc0dfdb0 con 0x7f95e40c5c90 2024-01-30T08:08:25.761 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:25.759+0000 7f98e2447180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-30T08:08:25.766 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:25.765+0000 7f9c17e6c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-30T08:08:25.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.811+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "51da0b6b-27de-4642-a142-8ce77861f79b", "id": 4} v 0) v1 -- 0x7f95e41ed700 con 0x7f95e40c5c90 2024-01-30T08:08:25.819 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.815+0000 7f95e1600640 1 -- 172.21.15.125:0/3601737869 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51da0b6b-27de-4642-a142-8ce77861f79b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95cc0ce030 con 0x7f95e40c5c90 2024-01-30T08:08:25.819 INFO:teuthology.orchestra.run.smithi125.stdout:4 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.815+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40c5c90 msgr2=0x7f95e40c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.815+0000 7f95ec000640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40c5c90 0x7f95e40c1360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f95cc019ff0 tx=0x7f95cc019160 comp rx=0 tx=0).stop 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 shutdown_connections 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f95ec000640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40c5c90 0x7f95e40c1360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f95ec000640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95e40c7ae0 0x7f95e41f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f95ec000640 1 --2- 172.21.15.125:0/3601737869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95e40c50d0 0x7f95e406c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 >> 172.21.15.125:0/3601737869 conn(0x7f95e40727c0 msgr2=0x7f95e4153120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 shutdown_connections 2024-01-30T08:08:25.821 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f95ec000640 1 -- 172.21.15.125:0/3601737869 wait complete. 2024-01-30T08:08:25.824 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:25.819+0000 7f98e2447180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-30T08:08:25.831 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:25.829+0000 7f9c17e6c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-30T08:08:25.839 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 43c69935-7f50-41fa-a0af-4170c25981c6 5 2024-01-30T08:08:25.915 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:25.911+0000 7f98e2447180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-30T08:08:25.924 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:25.925+0000 7f9c17e6c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-30T08:08:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8dee00640 1 Processor -- start 2024-01-30T08:08:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8dee00640 1 -- start start 2024-01-30T08:08:25.976 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8dee00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8d80c6240 0x7fa8d806e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8dee00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8d80c2470 0x7fa8d8153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8dee00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d80c4f90 con 0x7fa8d80c53a0 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8dee00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d80c16f0 con 0x7fa8d80c2470 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8dee00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d80c1990 con 0x7fa8d80c6240 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8d7e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8d80c6240 0x7fa8d806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8d7e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8d80c6240 0x7fa8d806e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39760/0 (socket says 172.21.15.125:39760) 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.971+0000 7fa8d7e00640 1 -- 172.21.15.125:0/2314778386 learned_addr learned my addr 172.21.15.125:0/2314778386 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8dce00640 1 --2- 172.21.15.125:0/2314778386 >> v2:172.21.15.50:3300/0 conn(0x7fa8d80c2470 0x7fa8d8153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d7e00640 1 -- 172.21.15.125:0/2314778386 >> v2:172.21.15.50:3300/0 conn(0x7fa8d80c2470 msgr2=0x7fa8d8153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d7e00640 1 --2- 172.21.15.125:0/2314778386 >> v2:172.21.15.50:3300/0 conn(0x7fa8d80c2470 0x7fa8d8153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d7e00640 1 -- 172.21.15.125:0/2314778386 >> v1:172.21.15.125:6789/0 conn(0x7fa8d80c53a0 legacy=0x7fa8d80710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d7e00640 1 -- 172.21.15.125:0/2314778386 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d80c1c70 con 0x7fa8d80c6240 2024-01-30T08:08:25.979 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:25.975+0000 7f98e2447180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-30T08:08:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d7e00640 1 --2- 172.21.15.125:0/2314778386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c6240 0x7fa8d806e160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80c7cb0 tx=0x7fa8c801ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6b75d1d45e4959 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d6a00640 1 -- 172.21.15.125:0/2314778386 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80aa5f0 con 0x7fa8d80c6240 2024-01-30T08:08:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d6a00640 1 -- 172.21.15.125:0/2314778386 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80aa750 con 0x7fa8d80c6240 2024-01-30T08:08:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.975+0000 7fa8d6a00640 1 -- 172.21.15.125:0/2314778386 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80aaae0 con 0x7fa8d80c6240 2024-01-30T08:08:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 -- 172.21.15.125:0/2314778386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c6240 msgr2=0x7fa8d806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 --2- 172.21.15.125:0/2314778386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c6240 0x7fa8d806e160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80c7cb0 tx=0x7fa8c801ced0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 -- 172.21.15.125:0/2314778386 shutdown_connections 2024-01-30T08:08:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 --2- 172.21.15.125:0/2314778386 >> v2:172.21.15.50:3300/0 conn(0x7fa8d80c2470 0x7fa8d8153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 --2- 172.21.15.125:0/2314778386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c6240 0x7fa8d806e160 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 -- 172.21.15.125:0/2314778386 >> 172.21.15.125:0/2314778386 conn(0x7fa8d80c3750 msgr2=0x7fa8d80c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 -- 172.21.15.125:0/2314778386 shutdown_connections 2024-01-30T08:08:25.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 -- 172.21.15.125:0/2314778386 wait complete. 2024-01-30T08:08:25.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 Processor -- start 2024-01-30T08:08:25.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.979+0000 7fa8dee00640 1 -- start start 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8d80c2470 0x7fa8d81eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c53a0 0x7fa8d81eb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d80c6240 0x7fa8d814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81ebe30 con 0x7fa8d80c6240 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8071e30 con 0x7fa8d80c53a0 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8072110 con 0x7fa8d80c2470 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8d80c2470 0x7fa8d81eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.986 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c53a0 0x7fa8d81eb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8d80c2470 0x7fa8d81eeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58538/0 (socket says 172.21.15.125:58538) 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7e00640 1 -- 172.21.15.125:0/1304759031 learned_addr learned my addr 172.21.15.125:0/1304759031 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c53a0 0x7fa8d81eb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39764/0 (socket says 172.21.15.125:39764) 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dce00640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d80c6240 0x7fa8d814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 -- 172.21.15.125:0/1304759031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8d80c2470 msgr2=0x7fa8d81eeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8d80c2470 0x7fa8d81eeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 -- 172.21.15.125:0/1304759031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d80c6240 msgr2=0x7fa8d814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d80c6240 0x7fa8d814e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:25.987 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 -- 172.21.15.125:0/1304759031 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009480 con 0x7fa8d80c53a0 2024-01-30T08:08:25.988 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:25.989+0000 7f9c17e6c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8d7400640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c53a0 0x7fa8d81eb8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c3c0 tx=0x7fa8c000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8cfe00640 1 -- 172.21.15.125:0/1304759031 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00052d0 con 0x7fa8d80c53a0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8cfe00640 1 -- 172.21.15.125:0/1304759031 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c0005430 con 0x7fa8d80c53a0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8cfe00640 1 -- 172.21.15.125:0/1304759031 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0007260 con 0x7fa8d80c53a0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d81ee3e0 con 0x7fa8d80c53a0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d81ee9a0 con 0x7fa8d80c53a0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8cfe00640 1 -- 172.21.15.125:0/1304759031 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa8c00073c0 con 0x7fa8d80c53a0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8cfe00640 1 -- 172.21.15.125:0/1304759031 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa8c0007670 con 0x7fa8d80c53a0 2024-01-30T08:08:25.989 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.983+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d80c5180 con 0x7fa8d80c53a0 2024-01-30T08:08:25.990 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:25.987+0000 7fa8cfe00640 1 -- 172.21.15.125:0/1304759031 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa8c0020060 con 0x7fa8d80c53a0 2024-01-30T08:08:26.056 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.055+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43c69935-7f50-41fa-a0af-4170c25981c6", "id": 5} v 0) v1 -- 0x7fa8d80a76a0 con 0x7fa8d80c53a0 2024-01-30T08:08:26.060 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.055+0000 7fa8cfe00640 1 -- 172.21.15.125:0/1304759031 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43c69935-7f50-41fa-a0af-4170c25981c6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8c0003920 con 0x7fa8d80c53a0 2024-01-30T08:08:26.060 INFO:teuthology.orchestra.run.smithi125.stdout:5 2024-01-30T08:08:26.061 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c53a0 msgr2=0x7fa8d81eb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.061 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c53a0 0x7fa8d81eb8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c3c0 tx=0x7fa8c000c880 comp rx=0 tx=0).stop 2024-01-30T08:08:26.062 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 shutdown_connections 2024-01-30T08:08:26.062 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8d80c53a0 0x7fa8d81eb8f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.062 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d80c6240 0x7fa8d814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.062 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 --2- 172.21.15.125:0/1304759031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8d80c2470 0x7fa8d81eeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.062 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 >> 172.21.15.125:0/1304759031 conn(0x7fa8d80c3750 msgr2=0x7fa8d815b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:26.062 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 shutdown_connections 2024-01-30T08:08:26.062 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.059+0000 7fa8dee00640 1 -- 172.21.15.125:0/1304759031 wait complete. 2024-01-30T08:08:26.073 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:26.071+0000 7f98e2447180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-30T08:08:26.081 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:26.081+0000 7f9c17e6c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-30T08:08:26.082 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c 6 2024-01-30T08:08:26.136 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:26.131+0000 7f98e2447180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-30T08:08:26.144 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:26.145+0000 7f9c17e6c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-30T08:08:26.217 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa65ac00640 1 Processor -- start 2024-01-30T08:08:26.217 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa65ac00640 1 -- start start 2024-01-30T08:08:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa65ac00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6540c4af0 0x7fa654151750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa65ac00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6540c7e10 0x7fa654151c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa65ac00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa654155360 con 0x7fa6540bd5a0 2024-01-30T08:08:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa65ac00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa654154750 con 0x7fa6540c4af0 2024-01-30T08:08:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa65ac00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa654154a30 con 0x7fa6540c7e10 2024-01-30T08:08:26.219 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa658c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6540c7e10 0x7fa654151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa658c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6540c7e10 0x7fa654151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39770/0 (socket says 172.21.15.125:39770) 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa658c00640 1 -- 172.21.15.125:0/357653833 learned_addr learned my addr 172.21.15.125:0/357653833 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa653e00640 1 --2- 172.21.15.125:0/357653833 >> v2:172.21.15.50:3300/0 conn(0x7fa6540c4af0 0x7fa654151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa658c00640 1 -- 172.21.15.125:0/357653833 >> v2:172.21.15.50:3300/0 conn(0x7fa6540c4af0 msgr2=0x7fa654151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa658c00640 1 --2- 172.21.15.125:0/357653833 >> v2:172.21.15.50:3300/0 conn(0x7fa6540c4af0 0x7fa654151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa658c00640 1 -- 172.21.15.125:0/357653833 >> v1:172.21.15.125:6789/0 conn(0x7fa6540bd5a0 legacy=0x7fa65406b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa658c00640 1 -- 172.21.15.125:0/357653833 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654154d10 con 0x7fa6540c7e10 2024-01-30T08:08:26.220 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.215+0000 7fa653e00640 1 --2- 172.21.15.125:0/357653833 >> v2:172.21.15.50:3300/0 conn(0x7fa6540c4af0 0x7fa654151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa658c00640 1 --2- 172.21.15.125:0/357653833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540c7e10 0x7fa654151c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa6540c54a0 tx=0x7fa64c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a936c507f2d2b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa652a00640 1 -- 172.21.15.125:0/357653833 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0a57f0 con 0x7fa6540c7e10 2024-01-30T08:08:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa652a00640 1 -- 172.21.15.125:0/357653833 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c0a5950 con 0x7fa6540c7e10 2024-01-30T08:08:26.222 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa652a00640 1 -- 172.21.15.125:0/357653833 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0a5ce0 con 0x7fa6540c7e10 2024-01-30T08:08:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 -- 172.21.15.125:0/357653833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540c7e10 msgr2=0x7fa654151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 --2- 172.21.15.125:0/357653833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540c7e10 0x7fa654151c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa6540c54a0 tx=0x7fa64c01c910 comp rx=0 tx=0).stop 2024-01-30T08:08:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 -- 172.21.15.125:0/357653833 shutdown_connections 2024-01-30T08:08:26.223 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 --2- 172.21.15.125:0/357653833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540c7e10 0x7fa654151c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 --2- 172.21.15.125:0/357653833 >> v2:172.21.15.50:3300/0 conn(0x7fa6540c4af0 0x7fa654151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 -- 172.21.15.125:0/357653833 >> 172.21.15.125:0/357653833 conn(0x7fa6540abac0 msgr2=0x7fa6540abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 -- 172.21.15.125:0/357653833 shutdown_connections 2024-01-30T08:08:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.219+0000 7fa65ac00640 1 -- 172.21.15.125:0/357653833 wait complete. 2024-01-30T08:08:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 Processor -- start 2024-01-30T08:08:26.225 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 -- start start 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540bd5a0 0x7fa65414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6540c4af0 0x7fa6541451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6540c7e10 0x7fa654145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654150680 con 0x7fa6540c4af0 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654149870 con 0x7fa6540bd5a0 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa654149b30 con 0x7fa6540c7e10 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6540c7e10 0x7fa654145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa653e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540bd5a0 0x7fa65414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6540c7e10 0x7fa654145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58544/0 (socket says 172.21.15.125:58544) 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 -- 172.21.15.125:0/348322685 learned_addr learned my addr 172.21.15.125:0/348322685 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa653400640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6540c4af0 0x7fa6541451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 -- 172.21.15.125:0/348322685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540bd5a0 msgr2=0x7fa65414b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540bd5a0 0x7fa65414b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 -- 172.21.15.125:0/348322685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6540c4af0 msgr2=0x7fa6541451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6540c4af0 0x7fa6541451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 -- 172.21.15.125:0/348322685 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c009b30 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa658c00640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6540c7e10 0x7fa654145710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0af040 tx=0x7fa64c0196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa64be00640 1 -- 172.21.15.125:0/348322685 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0b8670 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa64be00640 1 -- 172.21.15.125:0/348322685 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c0b87d0 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa64be00640 1 -- 172.21.15.125:0/348322685 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0b8b60 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa654153e30 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6541543f0 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa64be00640 1 -- 172.21.15.125:0/348322685 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa64c0c1790 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.223+0000 7fa64be00640 1 -- 172.21.15.125:0/348322685 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa64c0b6440 con 0x7fa6540c7e10 2024-01-30T08:08:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.227+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6541ecdf0 con 0x7fa6540c7e10 2024-01-30T08:08:26.230 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.227+0000 7fa64be00640 1 -- 172.21.15.125:0/348322685 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa64c0bc020 con 0x7fa6540c7e10 2024-01-30T08:08:26.296 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.295+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c", "id": 6} v 0) v1 -- 0x7fa654074a20 con 0x7fa6540c7e10 2024-01-30T08:08:26.298 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:26.295+0000 7f98e2447180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-30T08:08:26.300 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa64be00640 1 -- 172.21.15.125:0/348322685 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa64c0b8cc0 con 0x7fa6540c7e10 2024-01-30T08:08:26.300 INFO:teuthology.orchestra.run.smithi125.stdout:6 2024-01-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6540c7e10 msgr2=0x7fa654145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6540c7e10 0x7fa654145710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0af040 tx=0x7fa64c0196b0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 shutdown_connections 2024-01-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6540c7e10 0x7fa654145710 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6540c4af0 0x7fa6541451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 --2- 172.21.15.125:0/348322685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540bd5a0 0x7fa65414b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 >> 172.21.15.125:0/348322685 conn(0x7fa6540abac0 msgr2=0x7fa6540c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 shutdown_connections 2024-01-30T08:08:26.304 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.299+0000 7fa65ac00640 1 -- 172.21.15.125:0/348322685 wait complete. 2024-01-30T08:08:26.310 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:26.309+0000 7f9c17e6c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-30T08:08:26.321 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 7e9f93f3-551f-401a-bd6e-f33de84f619a 7 2024-01-30T08:08:26.371 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:26.367+0000 7f98e2447180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-30T08:08:26.382 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:26.381+0000 7f9c17e6c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-30T08:08:26.456 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.451+0000 7fdef7c00640 1 Processor -- start 2024-01-30T08:08:26.456 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.451+0000 7fdef7c00640 1 -- start start 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef7c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014faf0 0x7fdef00a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef7c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdef0156630 0x7fdef01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef7c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef00a77f0 con 0x7fdef014fed0 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef7c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef00a7510 con 0x7fdef0156630 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef7c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0155b50 con 0x7fdef014faf0 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef5200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014faf0 0x7fdef00a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdeefe00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdef014fed0 0x7fdef00c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45892/0 (socket says 172.21.15.125:45892) 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef5200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014faf0 0x7fdef00a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:58560/0 (socket says 172.21.15.125:58560) 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdeefe00640 1 -- 172.21.15.125:0/735608801 learned_addr learned my addr 172.21.15.125:0/735608801 (peer_addr_for_me v1:172.21.15.125:0/0) 2024-01-30T08:08:26.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef5c00640 1 --2- 172.21.15.125:0/735608801 >> v2:172.21.15.50:3300/0 conn(0x7fdef0156630 0x7fdef01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.460 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdeef400640 1 -- 172.21.15.125:0/735608801 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877830544 0 0) 0x7fdef00a77f0 con 0x7fdef014fed0 2024-01-30T08:08:26.460 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdeef400640 1 -- 172.21.15.125:0/735608801 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded0003530 con 0x7fdef014fed0 2024-01-30T08:08:26.460 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef5200640 1 -- 172.21.15.125:0/735608801 >> v2:172.21.15.50:3300/0 conn(0x7fdef0156630 msgr2=0x7fdef01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:26.460 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef5200640 1 --2- 172.21.15.125:0/735608801 >> v2:172.21.15.50:3300/0 conn(0x7fdef0156630 0x7fdef01524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.460 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef5200640 1 -- 172.21.15.125:0/735608801 >> v1:172.21.15.125:6789/0 conn(0x7fdef014fed0 legacy=0x7fdef00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.460 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.455+0000 7fdef5200640 1 -- 172.21.15.125:0/735608801 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0155e30 con 0x7fdef014faf0 2024-01-30T08:08:26.463 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdef5200640 1 --2- 172.21.15.125:0/735608801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014faf0 0x7fdef00a6cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097c0 tx=0x7fdee001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45fb5ac4da1c18ae server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:26.463 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdeef400640 1 -- 172.21.15.125:0/735608801 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a4ea0 con 0x7fdef014faf0 2024-01-30T08:08:26.463 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdeef400640 1 -- 172.21.15.125:0/735608801 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00a7050 con 0x7fdef014faf0 2024-01-30T08:08:26.463 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdeef400640 1 -- 172.21.15.125:0/735608801 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00ab820 con 0x7fdef014faf0 2024-01-30T08:08:26.464 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdef7c00640 1 -- 172.21.15.125:0/735608801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014faf0 msgr2=0x7fdef00a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.464 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdef7c00640 1 --2- 172.21.15.125:0/735608801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014faf0 0x7fdef00a6cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097c0 tx=0x7fdee001c360 comp rx=0 tx=0).stop 2024-01-30T08:08:26.464 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdef7c00640 1 -- 172.21.15.125:0/735608801 shutdown_connections 2024-01-30T08:08:26.464 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdef7c00640 1 --2- 172.21.15.125:0/735608801 >> v2:172.21.15.50:3300/0 conn(0x7fdef0156630 0x7fdef01524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.464 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdef7c00640 1 --2- 172.21.15.125:0/735608801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014faf0 0x7fdef00a6cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.465 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.459+0000 7fdef7c00640 1 -- 172.21.15.125:0/735608801 >> 172.21.15.125:0/735608801 conn(0x7fdef0072370 msgr2=0x7fdef0072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:26.465 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 -- 172.21.15.125:0/735608801 shutdown_connections 2024-01-30T08:08:26.465 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 -- 172.21.15.125:0/735608801 wait complete. 2024-01-30T08:08:26.466 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 Processor -- start 2024-01-30T08:08:26.466 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 -- start start 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef014faf0 0x7fdef00a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014fed0 0x7fdef014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef0156630 0x7fdef0148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef014c390 con 0x7fdef014faf0 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef01f1840 con 0x7fdef0156630 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef7c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0155310 con 0x7fdef014fed0 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef5c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef0156630 0x7fdef0148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdeefe00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014fed0 0x7fdef014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef5c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef0156630 0x7fdef0148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39782/0 (socket says 172.21.15.125:39782) 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef5c00640 1 -- 172.21.15.125:0/1096575106 learned_addr learned my addr 172.21.15.125:0/1096575106 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef5200640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef014faf0 0x7fdef00a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdeefe00640 1 -- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef0156630 msgr2=0x7fdef0148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdeefe00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef0156630 0x7fdef0148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdeefe00640 1 -- 172.21.15.125:0/1096575106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef014faf0 msgr2=0x7fdef00a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdeefe00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef014faf0 0x7fdef00a8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdeefe00640 1 -- 172.21.15.125:0/1096575106 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0009420 con 0x7fdef014fed0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdef5c00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef0156630 0x7fdef0148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.463+0000 7fdeefe00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014fed0 0x7fdef014a720 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdef01502f0 tx=0x7fded8001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdeecc00640 1 -- 172.21.15.125:0/1096575106 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8005cf0 con 0x7fdef014fed0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdeecc00640 1 -- 172.21.15.125:0/1096575106 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8005e50 con 0x7fdef014fed0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef01555f0 con 0x7fdef014fed0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdeecc00640 1 -- 172.21.15.125:0/1096575106 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80072f0 con 0x7fdef014fed0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef0152700 con 0x7fdef014fed0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdeecc00640 1 -- 172.21.15.125:0/1096575106 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fded8007450 con 0x7fdef014fed0 2024-01-30T08:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdeecc00640 1 -- 172.21.15.125:0/1096575106 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fded8007700 con 0x7fdef014fed0 2024-01-30T08:08:26.471 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef00c4e30 con 0x7fdef014fed0 2024-01-30T08:08:26.472 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.467+0000 7fdeecc00640 1 -- 172.21.15.125:0/1096575106 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fded8017070 con 0x7fdef014fed0 2024-01-30T08:08:26.538 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.535+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7e9f93f3-551f-401a-bd6e-f33de84f619a", "id": 7} v 0) v1 -- 0x7fdef0153680 con 0x7fdef014fed0 2024-01-30T08:08:26.544 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdeecc00640 1 -- 172.21.15.125:0/1096575106 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e9f93f3-551f-401a-bd6e-f33de84f619a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fded801c510 con 0x7fdef014fed0 2024-01-30T08:08:26.544 INFO:teuthology.orchestra.run.smithi125.stdout:7 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014fed0 msgr2=0x7fdef014a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014fed0 0x7fdef014a720 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdef01502f0 tx=0x7fded8001e80 comp rx=0 tx=0).stop 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 shutdown_connections 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdef0156630 0x7fdef0148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdef014fed0 0x7fdef014a720 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 --2- 172.21.15.125:0/1096575106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef014faf0 0x7fdef00a8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 >> 172.21.15.125:0/1096575106 conn(0x7fdef0072370 msgr2=0x7fdef014e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 shutdown_connections 2024-01-30T08:08:26.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-01-30T08:08:26.543+0000 7fdef7c00640 1 -- 172.21.15.125:0/1096575106 wait complete. 2024-01-30T08:08:26.564 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-30T08:08:26.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-30T08:08:26.568 INFO:tasks.ceph.osd.0:Started 2024-01-30T08:08:26.568 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-30T08:08:26.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-30T08:08:26.571 INFO:tasks.ceph.osd.1:Started 2024-01-30T08:08:26.572 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-30T08:08:26.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-30T08:08:26.575 INFO:tasks.ceph.osd.2:Started 2024-01-30T08:08:26.575 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-30T08:08:26.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-30T08:08:26.579 INFO:tasks.ceph.osd.3:Started 2024-01-30T08:08:26.579 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-30T08:08:26.579 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-30T08:08:26.582 INFO:tasks.ceph.osd.4:Started 2024-01-30T08:08:26.582 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-30T08:08:26.583 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-30T08:08:26.585 INFO:tasks.ceph.osd.5:Started 2024-01-30T08:08:26.586 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-30T08:08:26.586 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-30T08:08:26.588 INFO:tasks.ceph.osd.6:Started 2024-01-30T08:08:26.589 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-30T08:08:26.589 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-30T08:08:26.594 INFO:tasks.ceph.osd.7:Started 2024-01-30T08:08:26.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.801+0000 7fe84c000640 1 Processor -- start 2024-01-30T08:08:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.801+0000 7fe84c000640 1 -- start start 2024-01-30T08:08:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe84c000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8440ab010 0x7fe84406dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe84c000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440c01f0 0x7fe84406e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe84c000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe844155160 con 0x7fe8440aac30 2024-01-30T08:08:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe84c000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe844066760 con 0x7fe8440ab010 2024-01-30T08:08:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe84c000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe844155690 con 0x7fe8440c01f0 2024-01-30T08:08:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8440ab010 0x7fe84406dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8440ab010 0x7fe84406dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37568/0 (socket says 172.21.15.50:37568) 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 -- 172.21.15.50:0/580427202 learned_addr learned my addr 172.21.15.50:0/580427202 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe849600640 1 --1- 172.21.15.50:0/580427202 >> v1:172.21.15.50:6789/0 conn(0x7fe8440aac30 0x7fe8440c34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51478/0 (socket says 172.21.15.50:51478) 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe84a000640 1 --2- 172.21.15.50:0/580427202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440c01f0 0x7fe84406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 -- 172.21.15.50:0/580427202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440c01f0 msgr2=0x7fe84406e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 --2- 172.21.15.50:0/580427202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440c01f0 0x7fe84406e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 -- 172.21.15.50:0/580427202 >> v1:172.21.15.50:6789/0 conn(0x7fe8440aac30 legacy=0x7fe8440c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe843e00640 1 -- 172.21.15.50:0/580427202 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313975211 0 0) 0x7fe844155160 con 0x7fe8440aac30 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 -- 172.21.15.50:0/580427202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440c10d0 con 0x7fe8440ab010 2024-01-30T08:08:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe84a000640 1 --2- 172.21.15.50:0/580427202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440c01f0 0x7fe84406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.805+0000 7fe848c00640 1 --2- 172.21.15.50:0/580427202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440ab010 0x7fe84406dbe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009870 tx=0x7fe82c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725000477b4668ab server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe843e00640 1 -- 172.21.15.50:0/580427202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0ab5f0 con 0x7fe8440ab010 2024-01-30T08:08:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe843e00640 1 -- 172.21.15.50:0/580427202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c0ab750 con 0x7fe8440ab010 2024-01-30T08:08:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe843e00640 1 -- 172.21.15.50:0/580427202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0abae0 con 0x7fe8440ab010 2024-01-30T08:08:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- 172.21.15.50:0/580427202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440ab010 msgr2=0x7fe84406dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 --2- 172.21.15.50:0/580427202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440ab010 0x7fe84406dbe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009870 tx=0x7fe82c01c3f0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- 172.21.15.50:0/580427202 shutdown_connections 2024-01-30T08:08:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 --2- 172.21.15.50:0/580427202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440c01f0 0x7fe84406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 --2- 172.21.15.50:0/580427202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440ab010 0x7fe84406dbe0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- 172.21.15.50:0/580427202 >> 172.21.15.50:0/580427202 conn(0x7fe8440a8840 msgr2=0x7fe8440a8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- 172.21.15.50:0/580427202 shutdown_connections 2024-01-30T08:08:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- 172.21.15.50:0/580427202 wait complete. 2024-01-30T08:08:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 Processor -- start 2024-01-30T08:08:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- start start 2024-01-30T08:08:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440aac30 0x7fe844158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8440ab010 0x7fe8441ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440c01f0 0x7fe8441ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440c4190 con 0x7fe8440c01f0 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844158960 con 0x7fe8440ab010 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.809+0000 7fe84c000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440c4680 con 0x7fe8440aac30 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440c01f0 0x7fe8441ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440c01f0 0x7fe8441ef9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37584/0 (socket says 172.21.15.50:37584) 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 -- 172.21.15.50:0/2434194124 learned_addr learned my addr 172.21.15.50:0/2434194124 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe849600640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440aac30 0x7fe844158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe848c00640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8440ab010 0x7fe8441ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 -- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440aac30 msgr2=0x7fe844158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440aac30 0x7fe844158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 -- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8440ab010 msgr2=0x7fe8441ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8440ab010 0x7fe8441ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 -- 172.21.15.50:0/2434194124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0094d0 con 0x7fe8440c01f0 2024-01-30T08:08:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84a000640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440c01f0 0x7fe8441ef9b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe83c007ef0 tx=0x7fe83c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe841600640 1 -- 172.21.15.50:0/2434194124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c003ba0 con 0x7fe8440c01f0 2024-01-30T08:08:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe841600640 1 -- 172.21.15.50:0/2434194124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00f040 con 0x7fe8440c01f0 2024-01-30T08:08:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8440c43a0 con 0x7fe8440c01f0 2024-01-30T08:08:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe841600640 1 -- 172.21.15.50:0/2434194124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00de80 con 0x7fe8440c01f0 2024-01-30T08:08:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe844152fa0 con 0x7fe8440c01f0 2024-01-30T08:08:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe841600640 1 -- 172.21.15.50:0/2434194124 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe83c004030 con 0x7fe8440c01f0 2024-01-30T08:08:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe841600640 1 -- 172.21.15.50:0/2434194124 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe83c01ea80 con 0x7fe8440c01f0 2024-01-30T08:08:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.813+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe844156330 con 0x7fe8440c01f0 2024-01-30T08:08:26.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.825+0000 7fe841600640 1 -- 172.21.15.50:0/2434194124 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fe844156330 con 0x7fe8440c01f0 2024-01-30T08:08:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.881+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe844074a20 con 0x7fe8440c01f0 2024-01-30T08:08:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.881+0000 7fe841600640 1 -- 172.21.15.50:0/2434194124 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe83c024060 con 0x7fe8440c01f0 2024-01-30T08:08:26.883 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:26.883 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:26.542577+0000","last_up_change":"0.000000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440c01f0 msgr2=0x7fe8441ef9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440c01f0 0x7fe8441ef9b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe83c007ef0 tx=0x7fe83c00d4a0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 shutdown_connections 2024-01-30T08:08:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8440ab010 0x7fe8441ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8440c01f0 0x7fe8441ef9b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 --2- 172.21.15.50:0/2434194124 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8440aac30 0x7fe844158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 >> 172.21.15.50:0/2434194124 conn(0x7fe8440a8840 msgr2=0x7fe844070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 shutdown_connections 2024-01-30T08:08:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:26.885+0000 7fe84c000640 1 -- 172.21.15.50:0/2434194124 wait complete. 2024-01-30T08:08:26.903 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-30T08:08:26.903 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-30T08:08:27.021 INFO:tasks.ceph.mgr.y.smithi050.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-30T08:08:27.021 INFO:tasks.ceph.mgr.y.smithi050.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-30T08:08:27.021 INFO:tasks.ceph.mgr.y.smithi050.stderr: from numpy import show_config as show_numpy_config 2024-01-30T08:08:27.030 INFO:tasks.ceph.mgr.x.smithi125.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-30T08:08:27.030 INFO:tasks.ceph.mgr.x.smithi125.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-30T08:08:27.030 INFO:tasks.ceph.mgr.x.smithi125.stderr: from numpy import show_config as show_numpy_config 2024-01-30T08:08:27.062 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:27.059+0000 7f98e2447180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-30T08:08:27.068 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:27.069+0000 7f9c17e6c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-30T08:08:27.198 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:27.195+0000 7f98e2447180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-30T08:08:27.211 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:27.213+0000 7f9c17e6c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-30T08:08:27.216 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-01-30T08:08:27.217+0000 7f857902b7c0 -1 Falling back to public interface 2024-01-30T08:08:27.220 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-01-30T08:08:27.221+0000 7fe8aaa807c0 -1 Falling back to public interface 2024-01-30T08:08:27.225 INFO:tasks.ceph.osd.5.smithi125.stderr:2024-01-30T08:08:27.223+0000 7f08d15a47c0 -1 Falling back to public interface 2024-01-30T08:08:27.246 INFO:tasks.ceph.osd.6.smithi125.stderr:2024-01-30T08:08:27.243+0000 7fd1112dc7c0 -1 Falling back to public interface 2024-01-30T08:08:27.246 INFO:tasks.ceph.osd.7.smithi125.stderr:2024-01-30T08:08:27.243+0000 7f4e071d37c0 -1 Falling back to public interface 2024-01-30T08:08:27.247 INFO:tasks.ceph.osd.6.smithi125.stderr:2024-01-30T08:08:27.243+0000 7fd10fe00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-01-30T08:08:27.252 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-01-30T08:08:27.253+0000 7fc880b6e7c0 -1 Falling back to public interface 2024-01-30T08:08:27.258 INFO:tasks.ceph.osd.4.smithi125.stderr:2024-01-30T08:08:27.255+0000 7f5f96dda7c0 -1 Falling back to public interface 2024-01-30T08:08:27.265 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-01-30T08:08:27.265+0000 7f32e11867c0 -1 Falling back to public interface 2024-01-30T08:08:27.381 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:27.379+0000 7f98e2447180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-30T08:08:27.406 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:27.405+0000 7f9c17e6c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-30T08:08:27.453 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:27.451+0000 7f98e2447180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-30T08:08:27.482 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:27.481+0000 7f9c17e6c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-30T08:08:27.593 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:27.591+0000 7f98e2447180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-30T08:08:27.630 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:27.629+0000 7f9c17e6c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-30T08:08:27.708 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:27.840 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9fa00640 1 Processor -- start 2024-01-30T08:08:27.840 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9fa00640 1 -- start start 2024-01-30T08:08:27.841 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98158460 0x7faf98160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:27.841 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9fa00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980c25d0 con 0x7faf98151f60 2024-01-30T08:08:27.841 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9fa00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980c2ce0 con 0x7faf980c7900 2024-01-30T08:08:27.841 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980c3470 con 0x7faf98158460 2024-01-30T08:08:27.841 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9d000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faf98151f60 0x7faf980c1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51480/0 (socket says 172.21.15.50:51480) 2024-01-30T08:08:27.841 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9d000640 1 -- 172.21.15.50:0/2935951806 learned_addr learned my addr 172.21.15.50:0/2935951806 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:27.841 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9da00640 1 --2- 172.21.15.50:0/2935951806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98158460 0x7faf98160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:27.842 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf97400640 1 -- 172.21.15.50:0/2935951806 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470773444 0 0) 0x7faf980c25d0 con 0x7faf98151f60 2024-01-30T08:08:27.842 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf97400640 1 -- 172.21.15.50:0/2935951806 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf78003530 con 0x7faf98151f60 2024-01-30T08:08:27.842 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf97400640 1 -- 172.21.15.50:0/2935951806 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761735477 0 0) 0x7faf980c2ce0 con 0x7faf980c7900 2024-01-30T08:08:27.842 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9da00640 1 -- 172.21.15.50:0/2935951806 >> v1:172.21.15.125:6789/0 conn(0x7faf980c7900 legacy=0x7faf98157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:27.843 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9da00640 1 -- 172.21.15.50:0/2935951806 >> v1:172.21.15.50:6789/0 conn(0x7faf98151f60 legacy=0x7faf980c1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:27.843 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.841+0000 7faf9da00640 1 -- 172.21.15.50:0/2935951806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98070700 con 0x7faf98158460 2024-01-30T08:08:27.845 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9da00640 1 --2- 172.21.15.50:0/2935951806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98158460 0x7faf98160090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf90009dc0 tx=0x7faf9001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930856efc4e853bd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:27.845 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf97400640 1 -- 172.21.15.50:0/2935951806 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900a58d0 con 0x7faf98158460 2024-01-30T08:08:27.845 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf97400640 1 -- 172.21.15.50:0/2935951806 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf900a5a30 con 0x7faf98158460 2024-01-30T08:08:27.845 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf97400640 1 -- 172.21.15.50:0/2935951806 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900a5dc0 con 0x7faf98158460 2024-01-30T08:08:27.846 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9fa00640 1 -- 172.21.15.50:0/2935951806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98158460 msgr2=0x7faf98160090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:27.846 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9fa00640 1 --2- 172.21.15.50:0/2935951806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98158460 0x7faf98160090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf90009dc0 tx=0x7faf9001c850 comp rx=0 tx=0).stop 2024-01-30T08:08:27.846 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9fa00640 1 -- 172.21.15.50:0/2935951806 shutdown_connections 2024-01-30T08:08:27.846 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9fa00640 1 --2- 172.21.15.50:0/2935951806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98158460 0x7faf98160090 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:27.846 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9fa00640 1 -- 172.21.15.50:0/2935951806 >> 172.21.15.50:0/2935951806 conn(0x7faf980a9cd0 msgr2=0x7faf980aa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:27.846 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9fa00640 1 -- 172.21.15.50:0/2935951806 shutdown_connections 2024-01-30T08:08:27.846 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.845+0000 7faf9fa00640 1 -- 172.21.15.50:0/2935951806 wait complete. 2024-01-30T08:08:27.847 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 Processor -- start 2024-01-30T08:08:27.848 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 -- start start 2024-01-30T08:08:27.849 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf980c7900 0x7faf98154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:27.849 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98151f60 0x7faf981551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:27.849 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf98158460 0x7faf9814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf98152fe0 con 0x7faf98158460 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf98153510 con 0x7faf980c7900 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf981ed750 con 0x7faf98151f60 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf98158460 0x7faf9814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf98158460 0x7faf9814a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37598/0 (socket says 172.21.15.50:37598) 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 -- 172.21.15.50:0/2742072719 learned_addr learned my addr 172.21.15.50:0/2742072719 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf97e00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98151f60 0x7faf981551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9d000640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf980c7900 0x7faf98154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 -- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98151f60 msgr2=0x7faf981551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98151f60 0x7faf981551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 -- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf980c7900 msgr2=0x7faf98154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:27.850 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf980c7900 0x7faf98154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:27.851 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 -- 172.21.15.50:0/2742072719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90009a70 con 0x7faf98158460 2024-01-30T08:08:27.851 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9da00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf98158460 0x7faf9814a770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf900b0040 tx=0x7faf900195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf94c00640 1 -- 172.21.15.50:0/2742072719 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900ad850 con 0x7faf98158460 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf94c00640 1 -- 172.21.15.50:0/2742072719 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf900ad9b0 con 0x7faf98158460 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf94c00640 1 -- 172.21.15.50:0/2742072719 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900add60 con 0x7faf98158460 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf98153230 con 0x7faf98158460 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9814c600 con 0x7faf98158460 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf94c00640 1 -- 172.21.15.50:0/2742072719 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7faf900b4050 con 0x7faf98158460 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf94c00640 1 -- 172.21.15.50:0/2742072719 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7faf900b7ae0 con 0x7faf98158460 2024-01-30T08:08:27.852 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.849+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9814a490 con 0x7faf98158460 2024-01-30T08:08:27.853 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.853+0000 7faf94c00640 1 -- 172.21.15.50:0/2742072719 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7faf9814a490 con 0x7faf98158460 2024-01-30T08:08:27.913 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf9814b470 con 0x7faf98158460 2024-01-30T08:08:27.913 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf94c00640 1 -- 172.21.15.50:0/2742072719 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7faf900c7060 con 0x7faf98158460 2024-01-30T08:08:27.913 INFO:teuthology.misc.health.smithi050.stdout: 2024-01-30T08:08:27.913 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:26.542577+0000","last_up_change":"0.000000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf98158460 msgr2=0x7faf9814a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf98158460 0x7faf9814a770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf900b0040 tx=0x7faf900195f0 comp rx=0 tx=0).stop 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 shutdown_connections 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf98158460 0x7faf9814a770 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf98151f60 0x7faf981551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 --2- 172.21.15.50:0/2742072719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf980c7900 0x7faf98154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 >> 172.21.15.50:0/2742072719 conn(0x7faf980a9cd0 msgr2=0x7faf980c1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 shutdown_connections 2024-01-30T08:08:27.915 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:27.913+0000 7faf9fa00640 1 -- 172.21.15.50:0/2742072719 wait complete. 2024-01-30T08:08:27.933 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-30T08:08:28.272 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:28.271+0000 7f98e2447180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-30T08:08:28.353 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:28.353+0000 7f9c17e6c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-30T08:08:28.358 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:28.355+0000 7f98e2447180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-30T08:08:28.444 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:28.445+0000 7f9c17e6c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-30T08:08:28.550 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:28.547+0000 7f98e2447180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-30T08:08:28.634 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:28.631+0000 7f98e2447180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-30T08:08:28.646 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:28.645+0000 7f9c17e6c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-30T08:08:28.735 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:28.737+0000 7f9c17e6c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-30T08:08:28.961 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:28.959+0000 7f98e2447180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-30T08:08:29.031 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:29.027+0000 7f98e2447180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-30T08:08:29.089 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:29.089+0000 7f9c17e6c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-30T08:08:29.164 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-01-30T08:08:29.165+0000 7f9c17e6c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-30T08:08:30.054 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:30.051+0000 7f9887e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-30T08:08:30.055 INFO:tasks.ceph.mgr.x.smithi125.stderr:2024-01-30T08:08:30.051+0000 7f9887e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-30T08:08:30.961 INFO:tasks.ceph.osd.5.smithi125.stderr:2024-01-30T08:08:30.959+0000 7f08d15a47c0 -1 osd.5 0 log_to_monitors true 2024-01-30T08:08:31.007 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-01-30T08:08:31.005+0000 7fe8aaa807c0 -1 osd.0 0 log_to_monitors true 2024-01-30T08:08:31.074 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-01-30T08:08:31.073+0000 7f857902b7c0 -1 osd.1 0 log_to_monitors true 2024-01-30T08:08:31.094 INFO:tasks.ceph.osd.6.smithi125.stderr:2024-01-30T08:08:31.091+0000 7fd1112dc7c0 -1 osd.6 0 log_to_monitors true 2024-01-30T08:08:31.148 INFO:tasks.ceph.osd.4.smithi125.stderr:2024-01-30T08:08:31.143+0000 7f5f96dda7c0 -1 osd.4 0 log_to_monitors true 2024-01-30T08:08:31.177 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-01-30T08:08:31.177+0000 7fc880b6e7c0 -1 osd.2 0 log_to_monitors true 2024-01-30T08:08:31.185 INFO:tasks.ceph.osd.7.smithi125.stderr:2024-01-30T08:08:31.183+0000 7f4e071d37c0 -1 osd.7 0 log_to_monitors true 2024-01-30T08:08:31.189 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-01-30T08:08:31.189+0000 7f32e11867c0 -1 osd.3 0 log_to_monitors true 2024-01-30T08:08:32.853 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-01-30T08:08:32.853+0000 7fe8a5a00640 -1 osd.0 0 waiting for initial osdmap 2024-01-30T08:08:32.873 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-01-30T08:08:32.873+0000 7fe89ba00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:32.882 INFO:tasks.ceph.osd.5.smithi125.stderr:2024-01-30T08:08:32.879+0000 7f08cce00640 -1 osd.5 0 waiting for initial osdmap 2024-01-30T08:08:32.906 INFO:tasks.ceph.osd.5.smithi125.stderr:2024-01-30T08:08:32.903+0000 7f08c2400640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:34.272 INFO:tasks.ceph.osd.4.smithi125.stderr:2024-01-30T08:08:34.267+0000 7f5f91c00640 -1 osd.4 0 waiting for initial osdmap 2024-01-30T08:08:34.297 INFO:tasks.ceph.osd.6.smithi125.stderr:2024-01-30T08:08:34.291+0000 7fd10c200640 -1 osd.6 0 waiting for initial osdmap 2024-01-30T08:08:34.298 INFO:tasks.ceph.osd.4.smithi125.stderr:2024-01-30T08:08:34.295+0000 7f5f87c00640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:34.299 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-01-30T08:08:34.301+0000 7f32dca00640 -1 osd.3 0 waiting for initial osdmap 2024-01-30T08:08:34.318 INFO:tasks.ceph.osd.6.smithi125.stderr:2024-01-30T08:08:34.315+0000 7fd102200640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:34.334 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-01-30T08:08:34.333+0000 7f32d2000640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:34.337 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-01-30T08:08:34.337+0000 7f8573400640 -1 osd.1 0 waiting for initial osdmap 2024-01-30T08:08:34.343 INFO:tasks.ceph.osd.7.smithi125.stderr:2024-01-30T08:08:34.339+0000 7f4e02000640 -1 osd.7 0 waiting for initial osdmap 2024-01-30T08:08:34.365 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-01-30T08:08:34.365+0000 7fc87ba00640 -1 osd.2 0 waiting for initial osdmap 2024-01-30T08:08:34.369 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-01-30T08:08:34.369+0000 7f8569400640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:34.370 INFO:tasks.ceph.osd.7.smithi125.stderr:2024-01-30T08:08:34.367+0000 7f4df8000640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:34.389 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-01-30T08:08:34.389+0000 7fc871a00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-30T08:08:34.739 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:34.878 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.877+0000 7f2b6e800640 1 Processor -- start 2024-01-30T08:08:34.879 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.877+0000 7f2b6e800640 1 -- start start 2024-01-30T08:08:34.879 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.877+0000 7f2b6e800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b68157770 0x7f2b68157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:34.880 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b6e800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b680c6460 con 0x7f2b680a6c50 2024-01-30T08:08:34.880 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b6e800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b68157b50 con 0x7f2b680c6bd0 2024-01-30T08:08:34.880 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b6e800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b680c3fe0 con 0x7f2b68157770 2024-01-30T08:08:34.880 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b67400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b68157770 0x7f2b68157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:34.880 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b66a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2b680a6c50 0x7f2b680c3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35098/0 (socket says 172.21.15.50:35098) 2024-01-30T08:08:34.880 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b66a00640 1 -- 172.21.15.50:0/3815446845 learned_addr learned my addr 172.21.15.50:0/3815446845 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:34.880 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b67400640 1 -- 172.21.15.50:0/3815446845 >> v1:172.21.15.125:6789/0 conn(0x7f2b680c6bd0 legacy=0x7f2b680c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:34.881 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b67400640 1 -- 172.21.15.50:0/3815446845 >> v1:172.21.15.50:6789/0 conn(0x7f2b680a6c50 legacy=0x7f2b680c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:34.881 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b66000640 1 -- 172.21.15.50:0/3815446845 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988922210 0 0) 0x7f2b680c6460 con 0x7f2b680a6c50 2024-01-30T08:08:34.881 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b67400640 1 -- 172.21.15.50:0/3815446845 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b681582c0 con 0x7f2b68157770 2024-01-30T08:08:34.883 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b67400640 1 --2- 172.21.15.50:0/3815446845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b68157770 0x7f2b68157d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2b580097c0 tx=0x7f2b5801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955f764807216d93 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:34.883 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b66000640 1 -- 172.21.15.50:0/3815446845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b580ab650 con 0x7f2b68157770 2024-01-30T08:08:34.883 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b66000640 1 -- 172.21.15.50:0/3815446845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b580ab7b0 con 0x7f2b68157770 2024-01-30T08:08:34.884 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.881+0000 7f2b66000640 1 -- 172.21.15.50:0/3815446845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b580abb40 con 0x7f2b68157770 2024-01-30T08:08:34.884 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- 172.21.15.50:0/3815446845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b68157770 msgr2=0x7f2b68157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:34.884 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 --2- 172.21.15.50:0/3815446845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b68157770 0x7f2b68157d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2b580097c0 tx=0x7f2b5801c450 comp rx=0 tx=0).stop 2024-01-30T08:08:34.884 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- 172.21.15.50:0/3815446845 shutdown_connections 2024-01-30T08:08:34.885 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 --2- 172.21.15.50:0/3815446845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b68157770 0x7f2b68157d80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:34.885 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- 172.21.15.50:0/3815446845 >> 172.21.15.50:0/3815446845 conn(0x7f2b680c7e40 msgr2=0x7f2b680c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:34.885 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- 172.21.15.50:0/3815446845 shutdown_connections 2024-01-30T08:08:34.885 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- 172.21.15.50:0/3815446845 wait complete. 2024-01-30T08:08:34.886 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 Processor -- start 2024-01-30T08:08:34.886 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- start start 2024-01-30T08:08:34.888 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b680a6c50 0x7f2b680a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:34.888 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b680c6bd0 0x7f2b681f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:34.888 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b68157770 0x7f2b681f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b680a9510 con 0x7f2b680a6c50 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b681ed700 con 0x7f2b68157770 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b6e800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b680aa220 con 0x7f2b680c6bd0 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b67400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b680a6c50 0x7f2b680a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b67400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b680a6c50 0x7f2b680a79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48344/0 (socket says 172.21.15.50:48344) 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.885+0000 7f2b67400640 1 -- 172.21.15.50:0/1947818342 learned_addr learned my addr 172.21.15.50:0/1947818342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b67e00640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b68157770 0x7f2b681f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b66a00640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b680c6bd0 0x7f2b681f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b67400640 1 -- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b680c6bd0 msgr2=0x7f2b681f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b67400640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b680c6bd0 0x7f2b681f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b67400640 1 -- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b68157770 msgr2=0x7f2b681f0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b67400640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b68157770 0x7f2b681f0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b67400640 1 -- 172.21.15.50:0/1947818342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58009420 con 0x7f2b680a6c50 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b66a00640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b680c6bd0 0x7f2b681f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:08:34.889 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b67400640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b680a6c50 0x7f2b680a79d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2b580ad040 tx=0x7f2b5801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:34.890 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b5f400640 1 -- 172.21.15.50:0/1947818342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58004220 con 0x7f2b680a6c50 2024-01-30T08:08:34.890 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b5f400640 1 -- 172.21.15.50:0/1947818342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b580b9070 con 0x7f2b680a6c50 2024-01-30T08:08:34.890 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b680ac9c0 con 0x7f2b680a6c50 2024-01-30T08:08:34.890 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b5f400640 1 -- 172.21.15.50:0/1947818342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58003620 con 0x7f2b680a6c50 2024-01-30T08:08:34.890 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b680a9740 con 0x7f2b680a6c50 2024-01-30T08:08:34.890 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b68068b90 con 0x7f2b680a6c50 2024-01-30T08:08:34.890 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b5f400640 1 -- 172.21.15.50:0/1947818342 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7f2b58003780 con 0x7f2b680a6c50 2024-01-30T08:08:34.891 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b5f400640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2b400664a0 0x7f2b40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:34.891 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b5f400640 1 -- 172.21.15.50:0/1947818342 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2b580bb070 con 0x7f2b680a6c50 2024-01-30T08:08:34.891 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.889+0000 7f2b66a00640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2b400664a0 0x7f2b40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:34.892 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.893+0000 7f2b66a00640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2b400664a0 0x7f2b40068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2b6806da90 tx=0x7f2b50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:34.896 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:34.897+0000 7f2b5f400640 1 -- 172.21.15.50:0/1947818342 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2b580ebd00 con 0x7f2b680a6c50 2024-01-30T08:08:35.055 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.053+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b680c6240 con 0x7f2b680a6c50 2024-01-30T08:08:35.056 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b5f400640 1 -- 172.21.15.50:0/1947818342 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10955 (secure 0 0 0) 0x7f2b580c4070 con 0x7f2b680a6c50 2024-01-30T08:08:35.056 INFO:teuthology.misc.health.smithi050.stdout: 2024-01-30T08:08:35.057 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":14,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:34.840402+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2b400664a0 msgr2=0x7f2b40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2b400664a0 0x7f2b40068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2b6806da90 tx=0x7f2b50009040 comp rx=0 tx=0).stop 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b680a6c50 msgr2=0x7f2b680a79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b680a6c50 0x7f2b680a79d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2b580ad040 tx=0x7f2b5801ac90 comp rx=0 tx=0).stop 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 shutdown_connections 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b68157770 0x7f2b681f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2b400664a0 0x7f2b40068960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.059 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b680c6bd0 0x7f2b681f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.060 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 --2- 172.21.15.50:0/1947818342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b680a6c50 0x7f2b680a79d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.060 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 >> 172.21.15.50:0/1947818342 conn(0x7f2b680c7e40 msgr2=0x7f2b680c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:35.060 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 shutdown_connections 2024-01-30T08:08:35.060 INFO:teuthology.misc.health.smithi050.stderr:2024-01-30T08:08:35.057+0000 7f2b6e800640 1 -- 172.21.15.50:0/1947818342 wait complete. 2024-01-30T08:08:35.077 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-30T08:08:35.077 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-30T08:08:35.077 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-30T08:08:35.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-30T08:08:35.081 INFO:tasks.ceph.mds.a:Started 2024-01-30T08:08:35.081 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-30T08:08:35.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-30T08:08:35.084 INFO:tasks.ceph.mds.c:Started 2024-01-30T08:08:35.084 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-30T08:08:35.084 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-30T08:08:35.087 INFO:tasks.ceph.mds.b:Started 2024-01-30T08:08:35.088 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-30T08:08:35.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-30T08:08:35.091 INFO:tasks.ceph.mds.d:Started 2024-01-30T08:08:35.091 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-30T08:08:35.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:35.186 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-01-30T08:08:35.186 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-01-30T08:08:35.187 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2024-01-30T08:08:35.187 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2024-01-30T08:08:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e41800640 1 Processor -- start 2024-01-30T08:08:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e41800640 1 -- start start 2024-01-30T08:08:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e41800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6e3c0a7120 0x7f6e3c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e41800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e3c06e220 0x7f6e3c15f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e41800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3c0c7b40 con 0x7f6e3c06de40 2024-01-30T08:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e41800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c0a7770 con 0x7f6e3c06e220 2024-01-30T08:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e41800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c155310 con 0x7f6e3c0a7120 2024-01-30T08:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3b400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e3c06e220 0x7f6e3c15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3aa00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e3c06de40 0x7f6e3c157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35126/0 (socket says 172.21.15.50:35126) 2024-01-30T08:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3aa00640 1 -- 172.21.15.50:0/3802333 learned_addr learned my addr 172.21.15.50:0/3802333 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3a000640 1 --2- 172.21.15.50:0/3802333 >> v2:172.21.15.125:3300/0 conn(0x7f6e3c0a7120 0x7f6e3c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e39600640 1 -- 172.21.15.50:0/3802333 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051963206 0 0) 0x7f6e2c001120 con 0x7f6e3c06de40 2024-01-30T08:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e39600640 1 -- 172.21.15.50:0/3802333 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e1c003530 con 0x7f6e3c06de40 2024-01-30T08:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3a000640 1 -- 172.21.15.50:0/3802333 >> v2:172.21.15.50:3300/0 conn(0x7f6e3c06e220 msgr2=0x7f6e3c15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3a000640 1 --2- 172.21.15.50:0/3802333 >> v2:172.21.15.50:3300/0 conn(0x7f6e3c06e220 0x7f6e3c15f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3a000640 1 -- 172.21.15.50:0/3802333 >> v1:172.21.15.50:6789/0 conn(0x7f6e3c06de40 legacy=0x7f6e3c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3a000640 1 -- 172.21.15.50:0/3802333 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c155730 con 0x7f6e3c0a7120 2024-01-30T08:08:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.241+0000 7f6e3b400640 1 --2- 172.21.15.50:0/3802333 >> v2:172.21.15.50:3300/0 conn(0x7f6e3c06e220 0x7f6e3c15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e3a000640 1 --2- 172.21.15.50:0/3802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c0a7120 0x7f6e3c1584a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0aaaf0 tx=0x7f6e2401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6319af34cdaecf server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e39600640 1 -- 172.21.15.50:0/3802333 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240ab600 con 0x7f6e3c0a7120 2024-01-30T08:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e39600640 1 -- 172.21.15.50:0/3802333 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240a7050 con 0x7f6e3c0a7120 2024-01-30T08:08:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e39600640 1 -- 172.21.15.50:0/3802333 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240ab980 con 0x7f6e3c0a7120 2024-01-30T08:08:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e41800640 1 -- 172.21.15.50:0/3802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c0a7120 msgr2=0x7f6e3c1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e41800640 1 --2- 172.21.15.50:0/3802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c0a7120 0x7f6e3c1584a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0aaaf0 tx=0x7f6e2401c460 comp rx=0 tx=0).stop 2024-01-30T08:08:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e41800640 1 -- 172.21.15.50:0/3802333 shutdown_connections 2024-01-30T08:08:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e41800640 1 --2- 172.21.15.50:0/3802333 >> v2:172.21.15.50:3300/0 conn(0x7f6e3c06e220 0x7f6e3c15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e41800640 1 --2- 172.21.15.50:0/3802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c0a7120 0x7f6e3c1584a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.245+0000 7f6e41800640 1 -- 172.21.15.50:0/3802333 >> 172.21.15.50:0/3802333 conn(0x7f6e3c0c4830 msgr2=0x7f6e3c0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 -- 172.21.15.50:0/3802333 shutdown_connections 2024-01-30T08:08:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 -- 172.21.15.50:0/3802333 wait complete. 2024-01-30T08:08:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 Processor -- start 2024-01-30T08:08:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 -- start start 2024-01-30T08:08:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c06de40 0x7f6e3c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c06e220 0x7f6e3c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3c0a7120 0x7f6e3c146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c14c820 con 0x7f6e3c06e220 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0c1290 con 0x7f6e3c06de40 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c1f1020 con 0x7f6e3c0a7120 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c06e220 0x7f6e3c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c06e220 0x7f6e3c0c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48380/0 (socket says 172.21.15.50:48380) 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 -- 172.21.15.50:0/435113352 learned_addr learned my addr 172.21.15.50:0/435113352 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3b400640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3c0a7120 0x7f6e3c146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3aa00640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c06de40 0x7f6e3c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 -- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3c0a7120 msgr2=0x7f6e3c146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3c0a7120 0x7f6e3c146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 -- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c06de40 msgr2=0x7f6e3c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c06de40 0x7f6e3c0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 -- 172.21.15.50:0/435113352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34009a70 con 0x7f6e3c06e220 2024-01-30T08:08:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e3a000640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c06e220 0x7f6e3c0c5bb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e240ae040 tx=0x7f6e24019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e32a00640 1 -- 172.21.15.50:0/435113352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240b4840 con 0x7f6e3c06e220 2024-01-30T08:08:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e32a00640 1 -- 172.21.15.50:0/435113352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240b49c0 con 0x7f6e3c06e220 2024-01-30T08:08:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24009420 con 0x7f6e3c06e220 2024-01-30T08:08:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.249+0000 7f6e32a00640 1 -- 172.21.15.50:0/435113352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240b4d70 con 0x7f6e3c06e220 2024-01-30T08:08:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.253+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c14cda0 con 0x7f6e3c06e220 2024-01-30T08:08:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.253+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c074a20 con 0x7f6e3c06e220 2024-01-30T08:08:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.253+0000 7f6e32a00640 1 -- 172.21.15.50:0/435113352 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7f6e240b2040 con 0x7f6e3c06e220 2024-01-30T08:08:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.253+0000 7f6e32a00640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e140664a0 0x7f6e14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.253+0000 7f6e32a00640 1 -- 172.21.15.50:0/435113352 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f6e2411d8e0 con 0x7f6e3c06e220 2024-01-30T08:08:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.253+0000 7f6e3aa00640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e140664a0 0x7f6e14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.257+0000 7f6e3aa00640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e140664a0 0x7f6e14068960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005890 tx=0x7f6e2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.257+0000 7f6e32a00640 1 -- 172.21.15.50:0/435113352 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6e240eb120 con 0x7f6e3c06e220 2024-01-30T08:08:35.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.421+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e3c155730 con 0x7f6e3c06e220 2024-01-30T08:08:35.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.421+0000 7f6e32a00640 1 -- 172.21.15.50:0/435113352 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10955 (secure 0 0 0) 0x7f6e3c155730 con 0x7f6e3c06e220 2024-01-30T08:08:35.422 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:35.422 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:34.840402+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e140664a0 msgr2=0x7f6e14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e140664a0 0x7f6e14068960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005890 tx=0x7f6e2c009040 comp rx=0 tx=0).stop 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c06e220 msgr2=0x7f6e3c0c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c06e220 0x7f6e3c0c5bb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e240ae040 tx=0x7f6e24019200 comp rx=0 tx=0).stop 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 shutdown_connections 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e140664a0 0x7f6e14068960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3c0a7120 0x7f6e3c146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c06e220 0x7f6e3c0c5bb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 --2- 172.21.15.50:0/435113352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e3c06de40 0x7f6e3c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 >> 172.21.15.50:0/435113352 conn(0x7f6e3c0c4830 msgr2=0x7f6e3c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 shutdown_connections 2024-01-30T08:08:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.425+0000 7f6e41800640 1 -- 172.21.15.50:0/435113352 wait complete. 2024-01-30T08:08:35.443 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-01-30T08:08:35.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:08:35.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d7e200640 1 Processor -- start 2024-01-30T08:08:35.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d7e200640 1 -- start start 2024-01-30T08:08:35.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d7e200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d7806de40 0x7f0d7806e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d7e200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d780c4310 0x7f0d78155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d7e200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d78152f00 con 0x7f0d78153390 2024-01-30T08:08:35.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d7e200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d781525f0 con 0x7f0d7806de40 2024-01-30T08:08:35.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d7e200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780a7680 con 0x7f0d780c4310 2024-01-30T08:08:35.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d77400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d7806de40 0x7f0d7806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d76a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0d78153390 0x7f0d780a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35130/0 (socket says 172.21.15.50:35130) 2024-01-30T08:08:35.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d76a00640 1 -- 172.21.15.50:0/3169405176 learned_addr learned my addr 172.21.15.50:0/3169405176 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:35.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d77e00640 1 --2- 172.21.15.50:0/3169405176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d780c4310 0x7f0d78155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d76000640 1 -- 172.21.15.50:0/3169405176 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903678949 0 0) 0x7f0d78152f00 con 0x7f0d78153390 2024-01-30T08:08:35.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d76000640 1 -- 172.21.15.50:0/3169405176 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d58003530 con 0x7f0d78153390 2024-01-30T08:08:35.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d77400640 1 -- 172.21.15.50:0/3169405176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d780c4310 msgr2=0x7f0d78155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:35.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d77400640 1 --2- 172.21.15.50:0/3169405176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d780c4310 0x7f0d78155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d77400640 1 -- 172.21.15.50:0/3169405176 >> v1:172.21.15.50:6789/0 conn(0x7f0d78153390 legacy=0x7f0d780a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.585+0000 7f0d77400640 1 -- 172.21.15.50:0/3169405176 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d781528b0 con 0x7f0d7806de40 2024-01-30T08:08:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d77400640 1 --2- 172.21.15.50:0/3169405176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7806de40 0x7f0d7806e220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d680097c0 tx=0x7f0d6801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126836e2a6361981 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d76000640 1 -- 172.21.15.50:0/3169405176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680ab600 con 0x7f0d7806de40 2024-01-30T08:08:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d76000640 1 -- 172.21.15.50:0/3169405176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d680a7050 con 0x7f0d7806de40 2024-01-30T08:08:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d76000640 1 -- 172.21.15.50:0/3169405176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680ab960 con 0x7f0d7806de40 2024-01-30T08:08:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 -- 172.21.15.50:0/3169405176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7806de40 msgr2=0x7f0d7806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 --2- 172.21.15.50:0/3169405176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7806de40 0x7f0d7806e220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d680097c0 tx=0x7f0d6801c330 comp rx=0 tx=0).stop 2024-01-30T08:08:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 -- 172.21.15.50:0/3169405176 shutdown_connections 2024-01-30T08:08:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 --2- 172.21.15.50:0/3169405176 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d780c4310 0x7f0d78155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 --2- 172.21.15.50:0/3169405176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d7806de40 0x7f0d7806e220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 -- 172.21.15.50:0/3169405176 >> 172.21.15.50:0/3169405176 conn(0x7f0d780c4830 msgr2=0x7f0d780c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 -- 172.21.15.50:0/3169405176 shutdown_connections 2024-01-30T08:08:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.589+0000 7f0d7e200640 1 -- 172.21.15.50:0/3169405176 wait complete. 2024-01-30T08:08:35.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 Processor -- start 2024-01-30T08:08:35.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 -- start start 2024-01-30T08:08:35.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d7806de40 0x7f0d780aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d780c4310 0x7f0d7806b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78153390 0x7f0d7814c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7814eb20 con 0x7f0d78153390 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7814dd20 con 0x7f0d780c4310 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7814f100 con 0x7f0d7806de40 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78153390 0x7f0d7814c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78153390 0x7f0d7814c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48396/0 (socket says 172.21.15.50:48396) 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 -- 172.21.15.50:0/1827203984 learned_addr learned my addr 172.21.15.50:0/1827203984 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d76a00640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d780c4310 0x7f0d7806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77400640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d7806de40 0x7f0d780aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 -- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d7806de40 msgr2=0x7f0d780aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d7806de40 0x7f0d780aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 -- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d780c4310 msgr2=0x7f0d7806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d780c4310 0x7f0d7806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 -- 172.21.15.50:0/1827203984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68009420 con 0x7f0d78153390 2024-01-30T08:08:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77400640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d7806de40 0x7f0d780aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d77e00640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78153390 0x7f0d7814c100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009e30 tx=0x7f0d7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d6f400640 1 -- 172.21.15.50:0/1827203984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70009ca0 con 0x7f0d78153390 2024-01-30T08:08:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d6f400640 1 -- 172.21.15.50:0/1827203984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000f040 con 0x7f0d78153390 2024-01-30T08:08:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d6f400640 1 -- 172.21.15.50:0/1827203984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700146c0 con 0x7f0d78153390 2024-01-30T08:08:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7814fc60 con 0x7f0d78153390 2024-01-30T08:08:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.593+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7814f610 con 0x7f0d78153390 2024-01-30T08:08:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.597+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7814fdf0 con 0x7f0d78153390 2024-01-30T08:08:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.597+0000 7f0d6f400640 1 -- 172.21.15.50:0/1827203984 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7f0d70014820 con 0x7f0d78153390 2024-01-30T08:08:35.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.597+0000 7f0d6f400640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0d50066470 0x7f0d50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:35.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.597+0000 7f0d6f400640 1 -- 172.21.15.50:0/1827203984 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f0d700848d0 con 0x7f0d78153390 2024-01-30T08:08:35.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.597+0000 7f0d77400640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0d50066470 0x7f0d50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.597+0000 7f0d77400640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0d50066470 0x7f0d50068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d680ad000 tx=0x7f0d68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:35.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.601+0000 7f0d6f400640 1 -- 172.21.15.50:0/1827203984 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0d700520a0 con 0x7f0d78153390 2024-01-30T08:08:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.793+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d7806ec60 con 0x7f0d78153390 2024-01-30T08:08:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.793+0000 7f0d6f400640 1 -- 172.21.15.50:0/1827203984 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f0d70018540 con 0x7f0d78153390 2024-01-30T08:08:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:35.794 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-30T08:08:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2024-01-30T08:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0d50066470 msgr2=0x7f0d50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0d50066470 0x7f0d50068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d680ad000 tx=0x7f0d68008040 comp rx=0 tx=0).stop 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78153390 msgr2=0x7f0d7814c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78153390 0x7f0d7814c100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009e30 tx=0x7f0d7000c490 comp rx=0 tx=0).stop 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 shutdown_connections 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d780c4310 0x7f0d7806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0d50066470 0x7f0d50068930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78153390 0x7f0d7814c100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 --2- 172.21.15.50:0/1827203984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d7806de40 0x7f0d780aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 >> 172.21.15.50:0/1827203984 conn(0x7f0d780c4830 msgr2=0x7f0d780c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 shutdown_connections 2024-01-30T08:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:35.797+0000 7f0d7e200640 1 -- 172.21.15.50:0/1827203984 wait complete. 2024-01-30T08:08:37.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:08:37.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 Processor -- start 2024-01-30T08:08:37.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 -- start start 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b7414fbf0 0x7f7b741559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b740c0ee0 0x7f7b740a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b740c1de0 0x7f7b7406a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b740c3ed0 con 0x7f7b740c1de0 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7406bca0 con 0x7f7b7414fbf0 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b79400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7406bef0 con 0x7f7b740c0ee0 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b73200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b740c1de0 0x7f7b7406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b73200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b740c1de0 0x7f7b7406a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48404/0 (socket says 172.21.15.50:48404) 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b73200640 1 -- 172.21.15.50:0/3007527680 learned_addr learned my addr 172.21.15.50:0/3007527680 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b71e00640 1 --2- 172.21.15.50:0/3007527680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b740c0ee0 0x7f7b740a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.960+0000 7f7b72800640 1 --2- 172.21.15.50:0/3007527680 >> v2:172.21.15.125:3300/0 conn(0x7f7b7414fbf0 0x7f7b741559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b73200640 1 -- 172.21.15.50:0/3007527680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b740c0ee0 msgr2=0x7f7b740a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b73200640 1 --2- 172.21.15.50:0/3007527680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b740c0ee0 0x7f7b740a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b73200640 1 -- 172.21.15.50:0/3007527680 >> v2:172.21.15.125:3300/0 conn(0x7f7b7414fbf0 msgr2=0x7f7b741559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b73200640 1 --2- 172.21.15.50:0/3007527680 >> v2:172.21.15.125:3300/0 conn(0x7f7b7414fbf0 0x7f7b741559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b73200640 1 -- 172.21.15.50:0/3007527680 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b740c3b60 con 0x7f7b740c1de0 2024-01-30T08:08:37.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b73200640 1 --2- 172.21.15.50:0/3007527680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7406a740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b740c6c00 tx=0x7f7b6c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3c839d56d90836 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b71400640 1 -- 172.21.15.50:0/3007527680 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a5650 con 0x7f7b740c1de0 2024-01-30T08:08:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b71400640 1 -- 172.21.15.50:0/3007527680 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0a57b0 con 0x7f7b740c1de0 2024-01-30T08:08:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b71400640 1 -- 172.21.15.50:0/3007527680 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a5b40 con 0x7f7b740c1de0 2024-01-30T08:08:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b79400640 1 -- 172.21.15.50:0/3007527680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 msgr2=0x7f7b7406a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.964+0000 7f7b79400640 1 --2- 172.21.15.50:0/3007527680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7406a740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b740c6c00 tx=0x7f7b6c01c8b0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- 172.21.15.50:0/3007527680 shutdown_connections 2024-01-30T08:08:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 --2- 172.21.15.50:0/3007527680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7406a740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 --2- 172.21.15.50:0/3007527680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b740c0ee0 0x7f7b740a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 --2- 172.21.15.50:0/3007527680 >> v2:172.21.15.125:3300/0 conn(0x7f7b7414fbf0 0x7f7b741559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- 172.21.15.50:0/3007527680 >> 172.21.15.50:0/3007527680 conn(0x7f7b740c5b50 msgr2=0x7f7b740c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- 172.21.15.50:0/3007527680 shutdown_connections 2024-01-30T08:08:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- 172.21.15.50:0/3007527680 wait complete. 2024-01-30T08:08:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 Processor -- start 2024-01-30T08:08:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- start start 2024-01-30T08:08:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b740c0ee0 0x7f7b740c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b7414fbf0 0x7f7b7415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:37.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74071440 con 0x7f7b740c1de0 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b741ec910 con 0x7f7b740c0ee0 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b79400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b741ecbf0 con 0x7f7b7414fbf0 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b71e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b7414fbf0 0x7f7b7415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b71e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7415a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48420/0 (socket says 172.21.15.50:48420) 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b7414fbf0 0x7f7b7415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:59164/0 (socket says 172.21.15.50:59164) 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b71e00640 1 -- 172.21.15.50:0/741359141 learned_addr learned my addr 172.21.15.50:0/741359141 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b72800640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b740c0ee0 0x7f7b740c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 -- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b740c0ee0 msgr2=0x7f7b740c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b740c0ee0 0x7f7b740c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 -- 172.21.15.50:0/741359141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 msgr2=0x7f7b7415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 -- 172.21.15.50:0/741359141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c009b30 con 0x7f7b7414fbf0 2024-01-30T08:08:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b71e00640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:37.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.968+0000 7f7b73200640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b7414fbf0 0x7f7b7415ade0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0ab000 tx=0x7f7b7406e780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:37.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b6aa00640 1 -- 172.21.15.50:0/741359141 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a5650 con 0x7f7b7414fbf0 2024-01-30T08:08:37.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b6aa00640 1 -- 172.21.15.50:0/741359141 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0b55d0 con 0x7f7b7414fbf0 2024-01-30T08:08:37.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b6aa00640 1 -- 172.21.15.50:0/741359141 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0b59a0 con 0x7f7b7414fbf0 2024-01-30T08:08:37.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b741eced0 con 0x7f7b7414fbf0 2024-01-30T08:08:37.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b741ed490 con 0x7f7b7414fbf0 2024-01-30T08:08:37.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b741ed680 con 0x7f7b7414fbf0 2024-01-30T08:08:37.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b6aa00640 1 -- 172.21.15.50:0/741359141 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7f7b6c0bd070 con 0x7f7b7414fbf0 2024-01-30T08:08:37.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b6aa00640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b4c066470 0x7f7b4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:37.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b6aa00640 1 -- 172.21.15.50:0/741359141 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7b6c121640 con 0x7f7b7414fbf0 2024-01-30T08:08:37.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.972+0000 7f7b72800640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b4c066470 0x7f7b4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:37.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.976+0000 7f7b72800640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b4c066470 0x7f7b4c068930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b640099d0 tx=0x7f7b64008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:37.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:37.980+0000 7f7b6aa00640 1 -- 172.21.15.50:0/741359141 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7b6c0eedc0 con 0x7f7b7414fbf0 2024-01-30T08:08:38.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.168+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b74074a20 con 0x7f7b7414fbf0 2024-01-30T08:08:38.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b6aa00640 1 -- 172.21.15.50:0/741359141 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f7b6c0f23e0 con 0x7f7b7414fbf0 2024-01-30T08:08:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:38.173 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-30T08:08:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b4c066470 msgr2=0x7f7b4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b4c066470 0x7f7b4c068930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b640099d0 tx=0x7f7b64008040 comp rx=0 tx=0).stop 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b7414fbf0 msgr2=0x7f7b7415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b7414fbf0 0x7f7b7415ade0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0ab000 tx=0x7f7b7406e780 comp rx=0 tx=0).stop 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 shutdown_connections 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b4c066470 0x7f7b4c068930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b7414fbf0 0x7f7b7415ade0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b740c1de0 0x7f7b7415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 --2- 172.21.15.50:0/741359141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b740c0ee0 0x7f7b740c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 >> 172.21.15.50:0/741359141 conn(0x7f7b740c5b50 msgr2=0x7f7b7414f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 shutdown_connections 2024-01-30T08:08:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.172+0000 7f7b79400640 1 -- 172.21.15.50:0/741359141 wait complete. 2024-01-30T08:08:38.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe264800640 1 Processor -- start 2024-01-30T08:08:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe264800640 1 -- start start 2024-01-30T08:08:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe264800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe25c06fc60 0x7fe25c154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe264800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c158870 con 0x7fe25c0ac6e0 2024-01-30T08:08:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe264800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c1553a0 con 0x7fe25c151c80 2024-01-30T08:08:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe264800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c157c60 con 0x7fe25c06fc60 2024-01-30T08:08:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe261400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe25c0ac6e0 0x7fe25c154750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35132/0 (socket says 172.21.15.50:35132) 2024-01-30T08:08:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe261400640 1 -- 172.21.15.50:0/1673501594 learned_addr learned my addr 172.21.15.50:0/1673501594 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe263200640 1 --2- 172.21.15.50:0/1673501594 >> v2:172.21.15.125:3300/0 conn(0x7fe25c06fc60 0x7fe25c154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe260a00640 1 -- 172.21.15.50:0/1673501594 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784571738 0 0) 0x7fe25c1553a0 con 0x7fe25c151c80 2024-01-30T08:08:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe260a00640 1 -- 172.21.15.50:0/1673501594 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe23c003530 con 0x7fe25c151c80 2024-01-30T08:08:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe263200640 1 -- 172.21.15.50:0/1673501594 >> v1:172.21.15.125:6789/0 conn(0x7fe25c151c80 legacy=0x7fe25c0c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe263200640 1 -- 172.21.15.50:0/1673501594 >> v1:172.21.15.50:6789/0 conn(0x7fe25c0ac6e0 legacy=0x7fe25c154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.336+0000 7fe263200640 1 -- 172.21.15.50:0/1673501594 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c157f40 con 0x7fe25c06fc60 2024-01-30T08:08:38.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe263200640 1 --2- 172.21.15.50:0/1673501594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c06fc60 0x7fe25c154e60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe254009d90 tx=0x7fe25401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f55f24639d233d16 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe260a00640 1 -- 172.21.15.50:0/1673501594 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540a58c0 con 0x7fe25c06fc60 2024-01-30T08:08:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe260a00640 1 -- 172.21.15.50:0/1673501594 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2540a5a20 con 0x7fe25c06fc60 2024-01-30T08:08:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe260a00640 1 -- 172.21.15.50:0/1673501594 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540a5db0 con 0x7fe25c06fc60 2024-01-30T08:08:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe264800640 1 -- 172.21.15.50:0/1673501594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c06fc60 msgr2=0x7fe25c154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe264800640 1 --2- 172.21.15.50:0/1673501594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c06fc60 0x7fe25c154e60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe254009d90 tx=0x7fe25401c800 comp rx=0 tx=0).stop 2024-01-30T08:08:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe264800640 1 -- 172.21.15.50:0/1673501594 shutdown_connections 2024-01-30T08:08:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe264800640 1 --2- 172.21.15.50:0/1673501594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c06fc60 0x7fe25c154e60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe264800640 1 -- 172.21.15.50:0/1673501594 >> 172.21.15.50:0/1673501594 conn(0x7fe25c0c74a0 msgr2=0x7fe25c0c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe264800640 1 -- 172.21.15.50:0/1673501594 shutdown_connections 2024-01-30T08:08:38.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.340+0000 7fe264800640 1 -- 172.21.15.50:0/1673501594 wait complete. 2024-01-30T08:08:38.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 Processor -- start 2024-01-30T08:08:38.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 -- start start 2024-01-30T08:08:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe25c06fc60 0x7fe25c1f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe25c0ac6e0 0x7fe25c1f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c151c80 0x7fe25c0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c153950 con 0x7fe25c06fc60 2024-01-30T08:08:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c06c700 con 0x7fe25c151c80 2024-01-30T08:08:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c1526d0 con 0x7fe25c0ac6e0 2024-01-30T08:08:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe261400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe25c0ac6e0 0x7fe25c1f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe261e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe25c06fc60 0x7fe25c1f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe261400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe25c0ac6e0 0x7fe25c1f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:59180/0 (socket says 172.21.15.50:59180) 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe261400640 1 -- 172.21.15.50:0/3376313445 learned_addr learned my addr 172.21.15.50:0/3376313445 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe263200640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c151c80 0x7fe25c0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe263200640 1 -- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe25c0ac6e0 msgr2=0x7fe25c1f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe263200640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe25c0ac6e0 0x7fe25c1f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe263200640 1 -- 172.21.15.50:0/3376313445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe25c06fc60 msgr2=0x7fe25c1f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe263200640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe25c06fc60 0x7fe25c1f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe263200640 1 -- 172.21.15.50:0/3376313445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254009a70 con 0x7fe25c151c80 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe261400640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe25c0ac6e0 0x7fe25c1f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe263200640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c151c80 0x7fe25c0c5c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2540ac000 tx=0x7fe2540195a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe25a000640 1 -- 172.21.15.50:0/3376313445 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540ad640 con 0x7fe25c151c80 2024-01-30T08:08:38.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe25a000640 1 -- 172.21.15.50:0/3376313445 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2540ad7a0 con 0x7fe25c151c80 2024-01-30T08:08:38.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe25a000640 1 -- 172.21.15.50:0/3376313445 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540adb50 con 0x7fe25c151c80 2024-01-30T08:08:38.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.344+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c0c57e0 con 0x7fe25c151c80 2024-01-30T08:08:38.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.348+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c153340 con 0x7fe25c151c80 2024-01-30T08:08:38.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.348+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c0c5970 con 0x7fe25c151c80 2024-01-30T08:08:38.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.348+0000 7fe25a000640 1 -- 172.21.15.50:0/3376313445 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7fe2540b4070 con 0x7fe25c151c80 2024-01-30T08:08:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.348+0000 7fe25a000640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe234066470 0x7fe234068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.348+0000 7fe25a000640 1 -- 172.21.15.50:0/3376313445 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe25411ee80 con 0x7fe25c151c80 2024-01-30T08:08:38.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.348+0000 7fe261e00640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe234066470 0x7fe234068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.348+0000 7fe261e00640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe234066470 0x7fe234068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0017c0 tx=0x7fe24c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:38.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.352+0000 7fe25a000640 1 -- 172.21.15.50:0/3376313445 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe2540ec5e0 con 0x7fe25c151c80 2024-01-30T08:08:38.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.516+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe25c074ba0 con 0x7fe25c151c80 2024-01-30T08:08:38.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.520+0000 7fe25a000640 1 -- 172.21.15.50:0/3376313445 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12851 (secure 0 0 0) 0x7fe2540c5090 con 0x7fe25c151c80 2024-01-30T08:08:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:38.522 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:37.849797+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:38.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.520+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe234066470 msgr2=0x7fe234068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.520+0000 7fe264800640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe234066470 0x7fe234068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0017c0 tx=0x7fe24c009040 comp rx=0 tx=0).stop 2024-01-30T08:08:38.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.520+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c151c80 msgr2=0x7fe25c0c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.520+0000 7fe264800640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c151c80 0x7fe25c0c5c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2540ac000 tx=0x7fe2540195a0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 shutdown_connections 2024-01-30T08:08:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25c151c80 0x7fe25c0c5c70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe234066470 0x7fe234068930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe25c0ac6e0 0x7fe25c1f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 --2- 172.21.15.50:0/3376313445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe25c06fc60 0x7fe25c1f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 >> 172.21.15.50:0/3376313445 conn(0x7fe25c0c74a0 msgr2=0x7fe25c150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 shutdown_connections 2024-01-30T08:08:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.524+0000 7fe264800640 1 -- 172.21.15.50:0/3376313445 wait complete. 2024-01-30T08:08:38.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:08:38.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:08:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.688+0000 7febd6200640 1 Processor -- start 2024-01-30T08:08:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.688+0000 7febd6200640 1 -- start start 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febd6200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7febd006bfe0 0x7febd00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febd6200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febd00c3c50 0x7febd00c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febd6200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd006c4c0 con 0x7febd0072b60 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febd6200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00c0550 con 0x7febd00c3c50 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febd6200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00c07c0 con 0x7febd006bfe0 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcfe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febd00c3c50 0x7febd00c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcf400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7febd0072b60 0x7febd00a4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35148/0 (socket says 172.21.15.50:35148) 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcf400640 1 -- 172.21.15.50:0/3457063451 learned_addr learned my addr 172.21.15.50:0/3457063451 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcea00640 1 --2- 172.21.15.50:0/3457063451 >> v2:172.21.15.125:3300/0 conn(0x7febd006bfe0 0x7febd00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcfe00640 1 -- 172.21.15.50:0/3457063451 >> v2:172.21.15.125:3300/0 conn(0x7febd006bfe0 msgr2=0x7febd00c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcfe00640 1 --2- 172.21.15.50:0/3457063451 >> v2:172.21.15.125:3300/0 conn(0x7febd006bfe0 0x7febd00c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcfe00640 1 -- 172.21.15.50:0/3457063451 >> v1:172.21.15.50:6789/0 conn(0x7febd0072b60 legacy=0x7febd00a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcfe00640 1 -- 172.21.15.50:0/3457063451 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd00c0aa0 con 0x7febd00c3c50 2024-01-30T08:08:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febce000640 1 -- 172.21.15.50:0/3457063451 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907792775 0 0) 0x7febd006c4c0 con 0x7febd0072b60 2024-01-30T08:08:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.692+0000 7febcfe00640 1 --2- 172.21.15.50:0/3457063451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd00c3c50 0x7febd00c17e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febd006b640 tx=0x7febc801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ecb2e90bfc4cd6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febce000640 1 -- 172.21.15.50:0/3457063451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80a58b0 con 0x7febd00c3c50 2024-01-30T08:08:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febce000640 1 -- 172.21.15.50:0/3457063451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc80a5a10 con 0x7febd00c3c50 2024-01-30T08:08:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febce000640 1 -- 172.21.15.50:0/3457063451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80a5da0 con 0x7febd00c3c50 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- 172.21.15.50:0/3457063451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd00c3c50 msgr2=0x7febd00c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 --2- 172.21.15.50:0/3457063451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd00c3c50 0x7febd00c17e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febd006b640 tx=0x7febc801c850 comp rx=0 tx=0).stop 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- 172.21.15.50:0/3457063451 shutdown_connections 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 --2- 172.21.15.50:0/3457063451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd00c3c50 0x7febd00c17e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 --2- 172.21.15.50:0/3457063451 >> v2:172.21.15.125:3300/0 conn(0x7febd006bfe0 0x7febd00c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- 172.21.15.50:0/3457063451 >> 172.21.15.50:0/3457063451 conn(0x7febd00c5b30 msgr2=0x7febd00c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- 172.21.15.50:0/3457063451 shutdown_connections 2024-01-30T08:08:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- 172.21.15.50:0/3457063451 wait complete. 2024-01-30T08:08:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 Processor -- start 2024-01-30T08:08:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- start start 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd006bfe0 0x7febd01eed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febd0072b60 0x7febd00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd00c3c50 0x7febd014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd01ee920 con 0x7febd006bfe0 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd01ee2a0 con 0x7febd00c3c50 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febd6200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd014ece0 con 0x7febd0072b60 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febcf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd006bfe0 0x7febd01eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.696+0000 7febcea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febd0072b60 0x7febd00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febd0072b60 0x7febd00c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:59192/0 (socket says 172.21.15.50:59192) 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcea00640 1 -- 172.21.15.50:0/4197564282 learned_addr learned my addr 172.21.15.50:0/4197564282 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd006bfe0 0x7febd01eed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48452/0 (socket says 172.21.15.50:48452) 2024-01-30T08:08:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcfe00640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd00c3c50 0x7febd014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcf400640 1 -- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febd0072b60 msgr2=0x7febd00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcf400640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febd0072b60 0x7febd00c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcf400640 1 -- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd00c3c50 msgr2=0x7febd014c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcf400640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd00c3c50 0x7febd014c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcf400640 1 -- 172.21.15.50:0/4197564282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc8009a70 con 0x7febd006bfe0 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcea00640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febd0072b60 0x7febd00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febcf400640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd006bfe0 0x7febd01eed40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febc000c410 tx=0x7febc000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febc7400640 1 -- 172.21.15.50:0/4197564282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc00074e0 con 0x7febd006bfe0 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd01eb8b0 con 0x7febd006bfe0 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febc7400640 1 -- 172.21.15.50:0/4197564282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc0007640 con 0x7febd006bfe0 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febc7400640 1 -- 172.21.15.50:0/4197564282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0004a30 con 0x7febd006bfe0 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd01ebb90 con 0x7febd006bfe0 2024-01-30T08:08:38.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd00ab980 con 0x7febd006bfe0 2024-01-30T08:08:38.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.700+0000 7febc7400640 1 -- 172.21.15.50:0/4197564282 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7febc0004b90 con 0x7febd006bfe0 2024-01-30T08:08:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.704+0000 7febc7400640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feba80664a0 0x7feba8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.704+0000 7febc7400640 1 -- 172.21.15.50:0/4197564282 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7febc00836d0 con 0x7febd006bfe0 2024-01-30T08:08:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.704+0000 7febcea00640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feba80664a0 0x7feba8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:38.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.704+0000 7febcea00640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feba80664a0 0x7feba8068960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febd015b650 tx=0x7febb8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:38.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.708+0000 7febc7400640 1 -- 172.21.15.50:0/4197564282 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7febc0050e80 con 0x7febd006bfe0 2024-01-30T08:08:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febd0151dc0 con 0x7febd006bfe0 2024-01-30T08:08:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febc7400640 1 -- 172.21.15.50:0/4197564282 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7febd0151dc0 con 0x7febd006bfe0 2024-01-30T08:08:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:08:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feba80664a0 msgr2=0x7feba8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feba80664a0 0x7feba8068960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febd015b650 tx=0x7febb8009190 comp rx=0 tx=0).stop 2024-01-30T08:08:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd006bfe0 msgr2=0x7febd01eed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd006bfe0 0x7febd01eed40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febc000c410 tx=0x7febc000c8d0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 shutdown_connections 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd00c3c50 0x7febd014c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feba80664a0 0x7feba8068960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febd0072b60 0x7febd00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 --2- 172.21.15.50:0/4197564282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febd006bfe0 0x7febd01eed40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 >> 172.21.15.50:0/4197564282 conn(0x7febd00c5b30 msgr2=0x7febd00c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 shutdown_connections 2024-01-30T08:08:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:38.868+0000 7febd6200640 1 -- 172.21.15.50:0/4197564282 wait complete. 2024-01-30T08:08:38.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-30T08:08:39.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d6a800640 1 Processor -- start 2024-01-30T08:08:39.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d6a800640 1 -- start start 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d6a800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d640a7120 0x7f7d641584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d6a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d6406e220 0x7f7d6415f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d6a800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640c7b40 con 0x7f7d6406de40 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d6a800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d640a7770 con 0x7f7d6406e220 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d6a800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d64155310 con 0x7f7d640a7120 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d63e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d6406e220 0x7f7d6415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d63e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d6406e220 0x7f7d6415f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36454/0 (socket says 172.21.15.50:36454) 2024-01-30T08:08:39.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d63e00640 1 -- 172.21.15.50:0/2687133180 learned_addr learned my addr 172.21.15.50:0/2687133180 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d62a00640 1 --2- 172.21.15.50:0/2687133180 >> v2:172.21.15.125:3300/0 conn(0x7f7d640a7120 0x7f7d641584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d63e00640 1 -- 172.21.15.50:0/2687133180 >> v2:172.21.15.125:3300/0 conn(0x7f7d640a7120 msgr2=0x7f7d641584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d63e00640 1 --2- 172.21.15.50:0/2687133180 >> v2:172.21.15.125:3300/0 conn(0x7f7d640a7120 0x7f7d641584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d63e00640 1 -- 172.21.15.50:0/2687133180 >> v1:172.21.15.125:6789/0 conn(0x7f7d6406de40 legacy=0x7f7d64157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d63e00640 1 -- 172.21.15.50:0/2687133180 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64155730 con 0x7f7d6406e220 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.032+0000 7f7d62a00640 1 --2- 172.21.15.50:0/2687133180 >> v2:172.21.15.125:3300/0 conn(0x7f7d640a7120 0x7f7d641584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d63e00640 1 --2- 172.21.15.50:0/2687133180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406e220 0x7f7d6415f120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d640aaaf0 tx=0x7f7d5c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583667f0d6ebbfbf server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d62000640 1 -- 172.21.15.50:0/2687133180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0a5650 con 0x7f7d6406e220 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d62000640 1 -- 172.21.15.50:0/2687133180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c0a57b0 con 0x7f7d6406e220 2024-01-30T08:08:39.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d62000640 1 -- 172.21.15.50:0/2687133180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0a5b40 con 0x7f7d6406e220 2024-01-30T08:08:39.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 -- 172.21.15.50:0/2687133180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406e220 msgr2=0x7f7d6415f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 --2- 172.21.15.50:0/2687133180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406e220 0x7f7d6415f120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d640aaaf0 tx=0x7f7d5c01c990 comp rx=0 tx=0).stop 2024-01-30T08:08:39.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 -- 172.21.15.50:0/2687133180 shutdown_connections 2024-01-30T08:08:39.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 --2- 172.21.15.50:0/2687133180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406e220 0x7f7d6415f120 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 --2- 172.21.15.50:0/2687133180 >> v2:172.21.15.125:3300/0 conn(0x7f7d640a7120 0x7f7d641584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 -- 172.21.15.50:0/2687133180 >> 172.21.15.50:0/2687133180 conn(0x7f7d640c4830 msgr2=0x7f7d640c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:39.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 -- 172.21.15.50:0/2687133180 shutdown_connections 2024-01-30T08:08:39.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.036+0000 7f7d6a800640 1 -- 172.21.15.50:0/2687133180 wait complete. 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 Processor -- start 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 -- start start 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406de40 0x7f7d64146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d6406e220 0x7f7d64144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a7120 0x7f7d64145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d641ee700 con 0x7f7d6406de40 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d641ede10 con 0x7f7d640a7120 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d641f0c70 con 0x7f7d6406e220 2024-01-30T08:08:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406de40 0x7f7d64146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406de40 0x7f7d64146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36460/0 (socket says 172.21.15.50:36460) 2024-01-30T08:08:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 -- 172.21.15.50:0/4124853060 learned_addr learned my addr 172.21.15.50:0/4124853060 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d62a00640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d6406e220 0x7f7d64144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63e00640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a7120 0x7f7d64145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 -- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d6406e220 msgr2=0x7f7d64144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d6406e220 0x7f7d64144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 -- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a7120 msgr2=0x7f7d64145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a7120 0x7f7d64145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 -- 172.21.15.50:0/4124853060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c009b30 con 0x7f7d6406de40 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d63400640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406de40 0x7f7d64146db0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400c450 tx=0x7f7d5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d5b400640 1 -- 172.21.15.50:0/4124853060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54012830 con 0x7f7d6406de40 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d5b400640 1 -- 172.21.15.50:0/4124853060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d540129b0 con 0x7f7d6406de40 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d641ee0b0 con 0x7f7d6406de40 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d5b400640 1 -- 172.21.15.50:0/4124853060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54012d60 con 0x7f7d6406de40 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6414bc80 con 0x7f7d6406de40 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.040+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d64074a20 con 0x7f7d6406de40 2024-01-30T08:08:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.044+0000 7f7d5b400640 1 -- 172.21.15.50:0/4124853060 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7f7d5401c460 con 0x7f7d6406de40 2024-01-30T08:08:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.044+0000 7f7d5b400640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7d3c066470 0x7f7d3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.044+0000 7f7d5b400640 1 -- 172.21.15.50:0/4124853060 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d540837a0 con 0x7f7d6406de40 2024-01-30T08:08:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.044+0000 7f7d62a00640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7d3c066470 0x7f7d3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.044+0000 7f7d62a00640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7d3c066470 0x7f7d3c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d641576d0 tx=0x7f7d4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:39.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.048+0000 7f7d5b400640 1 -- 172.21.15.50:0/4124853060 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7d54050f10 con 0x7f7d6406de40 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.208+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7d6406ee10 con 0x7f7d6406de40 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d5b400640 1 -- 172.21.15.50:0/4124853060 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7d54054530 con 0x7f7d6406de40 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-01-30T08:08:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:08:39.213 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7d3c066470 msgr2=0x7f7d3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7d3c066470 0x7f7d3c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d641576d0 tx=0x7f7d4c008040 comp rx=0 tx=0).stop 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406de40 msgr2=0x7f7d64146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406de40 0x7f7d64146db0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400c450 tx=0x7f7d5400c910 comp rx=0 tx=0).stop 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 shutdown_connections 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d640a7120 0x7f7d64145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7d3c066470 0x7f7d3c068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7d6406e220 0x7f7d64144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 --2- 172.21.15.50:0/4124853060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6406de40 0x7f7d64146db0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 >> 172.21.15.50:0/4124853060 conn(0x7f7d640c4830 msgr2=0x7f7d6414a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 shutdown_connections 2024-01-30T08:08:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.212+0000 7f7d6a800640 1 -- 172.21.15.50:0/4124853060 wait complete. 2024-01-30T08:08:39.234 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-30T08:08:39.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-30T08:08:39.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.376+0000 7faa06200640 1 Processor -- start 2024-01-30T08:08:39.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.376+0000 7faa06200640 1 -- start start 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7faa06200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa000c4960 0x7faa000c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7faa06200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa001551d0 0x7faa00155620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7faa06200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa000c3670 con 0x7faa0006ca80 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7faa06200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa000c3a20 con 0x7faa001551d0 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7faa06200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0006c5f0 con 0x7faa000c4960 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9ffe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa001551d0 0x7faa00155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9fea00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa0006ca80 0x7faa000c5ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41168/0 (socket says 172.21.15.50:41168) 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9fea00640 1 -- 172.21.15.50:0/1285511158 learned_addr learned my addr 172.21.15.50:0/1285511158 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9ff400640 1 --2- 172.21.15.50:0/1285511158 >> v2:172.21.15.125:3300/0 conn(0x7faa000c4960 0x7faa000c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9ffe00640 1 -- 172.21.15.50:0/1285511158 >> v2:172.21.15.125:3300/0 conn(0x7faa000c4960 msgr2=0x7faa000c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9ffe00640 1 --2- 172.21.15.50:0/1285511158 >> v2:172.21.15.125:3300/0 conn(0x7faa000c4960 0x7faa000c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9ffe00640 1 -- 172.21.15.50:0/1285511158 >> v1:172.21.15.50:6789/0 conn(0x7faa0006ca80 legacy=0x7faa000c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9ffe00640 1 -- 172.21.15.50:0/1285511158 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00158d80 con 0x7faa001551d0 2024-01-30T08:08:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9fe000640 1 -- 172.21.15.50:0/1285511158 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232567114 0 0) 0x7fa9e8001120 con 0x7faa0006ca80 2024-01-30T08:08:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.380+0000 7fa9ff400640 1 --2- 172.21.15.50:0/1285511158 >> v2:172.21.15.125:3300/0 conn(0x7faa000c4960 0x7faa000c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7fa9ffe00640 1 --2- 172.21.15.50:0/1285511158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa001551d0 0x7faa00155620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa000c5490 tx=0x7fa9f801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f608482edb58b917 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7fa9fe000640 1 -- 172.21.15.50:0/1285511158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80a5910 con 0x7faa001551d0 2024-01-30T08:08:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7fa9fe000640 1 -- 172.21.15.50:0/1285511158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f80a5a70 con 0x7faa001551d0 2024-01-30T08:08:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7fa9fe000640 1 -- 172.21.15.50:0/1285511158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80a5e00 con 0x7faa001551d0 2024-01-30T08:08:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 -- 172.21.15.50:0/1285511158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa001551d0 msgr2=0x7faa00155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 --2- 172.21.15.50:0/1285511158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa001551d0 0x7faa00155620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa000c5490 tx=0x7fa9f801c850 comp rx=0 tx=0).stop 2024-01-30T08:08:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 -- 172.21.15.50:0/1285511158 shutdown_connections 2024-01-30T08:08:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 --2- 172.21.15.50:0/1285511158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa001551d0 0x7faa00155620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 --2- 172.21.15.50:0/1285511158 >> v2:172.21.15.125:3300/0 conn(0x7faa000c4960 0x7faa000c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 -- 172.21.15.50:0/1285511158 >> 172.21.15.50:0/1285511158 conn(0x7faa000a9a80 msgr2=0x7faa000a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 -- 172.21.15.50:0/1285511158 shutdown_connections 2024-01-30T08:08:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 -- 172.21.15.50:0/1285511158 wait complete. 2024-01-30T08:08:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 Processor -- start 2024-01-30T08:08:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.384+0000 7faa06200640 1 -- start start 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa0006ca80 0x7faa0014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa000c4960 0x7faa000acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa001551d0 0x7faa0006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0015eb80 con 0x7faa000c4960 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0006f610 con 0x7faa0006ca80 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa000ad500 con 0x7faa001551d0 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa000c4960 0x7faa000acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa000c4960 0x7faa000acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36482/0 (socket says 172.21.15.50:36482) 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 -- 172.21.15.50:0/3085210329 learned_addr learned my addr 172.21.15.50:0/3085210329 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9ff400640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa0006ca80 0x7faa0014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9ffe00640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa001551d0 0x7faa0006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 -- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa001551d0 msgr2=0x7faa0006ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa001551d0 0x7faa0006ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 -- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa0006ca80 msgr2=0x7faa0014f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa0006ca80 0x7faa0014f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 -- 172.21.15.50:0/3085210329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8009a70 con 0x7faa000c4960 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9ffe00640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa001551d0 0x7faa0006ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9fea00640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa000c4960 0x7faa000acc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800c7b0 tx=0x7fa9e800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80072d0 con 0x7faa000c4960 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e8007450 con 0x7faa000c4960 2024-01-30T08:08:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa001ed670 con 0x7faa000c4960 2024-01-30T08:08:39.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80047f0 con 0x7faa000c4960 2024-01-30T08:08:39.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa000ada60 con 0x7faa000c4960 2024-01-30T08:08:39.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.388+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa00074a20 con 0x7faa000c4960 2024-01-30T08:08:39.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.392+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7fa9e8004950 con 0x7faa000c4960 2024-01-30T08:08:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.392+0000 7fa9f7400640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9d80664a0 0x7fa9d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.392+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa9e8082e00 con 0x7faa000c4960 2024-01-30T08:08:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.392+0000 7fa9ff400640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9d80664a0 0x7fa9d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.392+0000 7fa9ff400640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9d80664a0 0x7fa9d8068960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009950 tx=0x7fa9f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:39.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.396+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa9e8087070 con 0x7faa000c4960 2024-01-30T08:08:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.560+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faa000c3670 con 0x7faa000c4960 2024-01-30T08:08:39.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:39.848+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa9e80508b0 con 0x7faa000c4960 2024-01-30T08:08:40.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7fa9f7400640 1 -- 172.21.15.50:0/3085210329 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa9e806f9d0 con 0x7faa000c4960 2024-01-30T08:08:40.245 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-01-30T08:08:40.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9d80664a0 msgr2=0x7fa9d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:40.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9d80664a0 0x7fa9d8068960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009950 tx=0x7fa9f0008040 comp rx=0 tx=0).stop 2024-01-30T08:08:40.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa000c4960 msgr2=0x7faa000acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:40.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa000c4960 0x7faa000acc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800c7b0 tx=0x7fa9e800cc70 comp rx=0 tx=0).stop 2024-01-30T08:08:40.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 shutdown_connections 2024-01-30T08:08:40.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9d80664a0 0x7fa9d8068960 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009950 tx=0x7fa9f0008040 comp rx=0 tx=0).stop 2024-01-30T08:08:40.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa001551d0 0x7faa0006ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.244+0000 7faa06200640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa000c4960 0x7faa000acc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.248+0000 7faa06200640 1 --2- 172.21.15.50:0/3085210329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa0006ca80 0x7faa0014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.248+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 >> 172.21.15.50:0/3085210329 conn(0x7faa000a9a80 msgr2=0x7faa000c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:40.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.248+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 shutdown_connections 2024-01-30T08:08:40.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.248+0000 7faa06200640 1 -- 172.21.15.50:0/3085210329 wait complete. 2024-01-30T08:08:40.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-30T08:08:40.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f708ce00640 1 Processor -- start 2024-01-30T08:08:40.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f708ce00640 1 -- start start 2024-01-30T08:08:40.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f708ce00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f70880727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:40.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f708ce00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7088154290 0x7f7088154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:40.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f708ce00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70880c22b0 con 0x7f708806c960 2024-01-30T08:08:40.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f708ce00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880c5890 con 0x7f7088154290 2024-01-30T08:08:40.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f708ce00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880c52d0 con 0x7f7088071e10 2024-01-30T08:08:40.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7086800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7088154290 0x7f7088154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:40.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7086800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7088154290 0x7f7088154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36498/0 (socket says 172.21.15.50:36498) 2024-01-30T08:08:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7086800640 1 -- 172.21.15.50:0/650274479 learned_addr learned my addr 172.21.15.50:0/650274479 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7085400640 1 --1- 172.21.15.50:0/650274479 >> v1:172.21.15.50:6789/0 conn(0x7f708806c960 0x7f70880c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41172/0 (socket says 172.21.15.50:41172) 2024-01-30T08:08:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7085e00640 1 --2- 172.21.15.50:0/650274479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f70880727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7086800640 1 -- 172.21.15.50:0/650274479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 msgr2=0x7f70880727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7086800640 1 --2- 172.21.15.50:0/650274479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f70880727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7086800640 1 -- 172.21.15.50:0/650274479 >> v1:172.21.15.50:6789/0 conn(0x7f708806c960 legacy=0x7f70880c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.428+0000 7f7086800640 1 -- 172.21.15.50:0/650274479 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880c55b0 con 0x7f7088154290 2024-01-30T08:08:40.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f7086800640 1 --2- 172.21.15.50:0/650274479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088154720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7080009e50 tx=0x7f708001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ef00565842c71e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:40.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f7084a00640 1 -- 172.21.15.50:0/650274479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800a5620 con 0x7f7088154290 2024-01-30T08:08:40.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f7084a00640 1 -- 172.21.15.50:0/650274479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70800a5780 con 0x7f7088154290 2024-01-30T08:08:40.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f7084a00640 1 -- 172.21.15.50:0/650274479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800a5b10 con 0x7f7088154290 2024-01-30T08:08:40.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 -- 172.21.15.50:0/650274479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 msgr2=0x7f7088154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:40.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 --2- 172.21.15.50:0/650274479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088154720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7080009e50 tx=0x7f708001c8f0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 -- 172.21.15.50:0/650274479 shutdown_connections 2024-01-30T08:08:40.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 --2- 172.21.15.50:0/650274479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088154720 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 --2- 172.21.15.50:0/650274479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f70880727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 -- 172.21.15.50:0/650274479 >> 172.21.15.50:0/650274479 conn(0x7f70880c5b30 msgr2=0x7f70880c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:40.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 -- 172.21.15.50:0/650274479 shutdown_connections 2024-01-30T08:08:40.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.432+0000 7f708ce00640 1 -- 172.21.15.50:0/650274479 wait complete. 2024-01-30T08:08:40.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 Processor -- start 2024-01-30T08:08:40.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 -- start start 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f708806c960 0x7f7088150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f708814d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708814aba0 con 0x7f7088154290 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708814e800 con 0x7f708806c960 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708814d470 con 0x7f7088071e10 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36510/0 (socket says 172.21.15.50:36510) 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 -- 172.21.15.50:0/2021990099 learned_addr learned my addr 172.21.15.50:0/2021990099 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7085400640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f708814d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7085e00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f708806c960 0x7f7088150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:40.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 -- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 msgr2=0x7f708814d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:40.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f708814d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 -- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f708806c960 msgr2=0x7f7088150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:40.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f708806c960 0x7f7088150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:40.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 -- 172.21.15.50:0/2021990099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080009b30 con 0x7f7088154290 2024-01-30T08:08:40.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f7086800640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088149dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70800af040 tx=0x7f7080019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f707e000640 1 -- 172.21.15.50:0/2021990099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800b8670 con 0x7f7088154290 2024-01-30T08:08:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f707e000640 1 -- 172.21.15.50:0/2021990099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70800b87d0 con 0x7f7088154290 2024-01-30T08:08:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f707e000640 1 -- 172.21.15.50:0/2021990099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800b8b80 con 0x7f7088154290 2024-01-30T08:08:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.436+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7088152840 con 0x7f7088154290 2024-01-30T08:08:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.440+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708814d190 con 0x7f7088154290 2024-01-30T08:08:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.440+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7088152090 con 0x7f7088154290 2024-01-30T08:08:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.440+0000 7f707e000640 1 -- 172.21.15.50:0/2021990099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f70800b8ce0 con 0x7f7088154290 2024-01-30T08:08:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.440+0000 7f707e000640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7060066500 0x7f70600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.440+0000 7f707e000640 1 -- 172.21.15.50:0/2021990099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f708011ef50 con 0x7f7088154290 2024-01-30T08:08:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.440+0000 7f7085e00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7060066500 0x7f70600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.440+0000 7f7085e00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7060066500 0x7f70600689c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f70881ead60 tx=0x7f7078008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.444+0000 7f707e000640 1 -- 172.21.15.50:0/2021990099 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7088152090 con 0x7f7088154290 2024-01-30T08:08:40.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:40.604+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f7088152090 con 0x7f7088154290 2024-01-30T08:08:41.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.248+0000 7f707e000640 1 -- 172.21.15.50:0/2021990099 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7088152090 con 0x7f7088154290 2024-01-30T08:08:41.251 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-01-30T08:08:41.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7060066500 msgr2=0x7f70600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7060066500 0x7f70600689c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f70881ead60 tx=0x7f7078008040 comp rx=0 tx=0).stop 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 msgr2=0x7f7088149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088149dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70800af040 tx=0x7f7080019690 comp rx=0 tx=0).stop 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 shutdown_connections 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7060066500 0x7f70600689c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7088154290 0x7f7088149dd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7088071e10 0x7f708814d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 --2- 172.21.15.50:0/2021990099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f708806c960 0x7f7088150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.252+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 >> 172.21.15.50:0/2021990099 conn(0x7f70880c5b30 msgr2=0x7f70880c2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.256+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 shutdown_connections 2024-01-30T08:08:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.256+0000 7f708ce00640 1 -- 172.21.15.50:0/2021990099 wait complete. 2024-01-30T08:08:41.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-30T08:08:41.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5292e00640 1 Processor -- start 2024-01-30T08:08:41.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5292e00640 1 -- start start 2024-01-30T08:08:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5292e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c155500 0x7f528c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5292e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f528c06f6a0 0x7f528c0c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5292e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c158b70 con 0x7f528c06f240 2024-01-30T08:08:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5292e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c06fb10 con 0x7f528c06f6a0 2024-01-30T08:08:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5292e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c157f60 con 0x7f528c155500 2024-01-30T08:08:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f528be00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c155500 0x7f528c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:41.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5290e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f528c06f6a0 0x7f528c0c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:41.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f528b400640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f528c06f240 0x7f528c0c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:44806/0 (socket says 172.21.15.50:44806) 2024-01-30T08:08:41.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f528b400640 1 -- 172.21.15.50:0/1462137045 learned_addr learned my addr 172.21.15.50:0/1462137045 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:41.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f528aa00640 1 -- 172.21.15.50:0/1462137045 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256727583 0 0) 0x7f528c158b70 con 0x7f528c06f240 2024-01-30T08:08:41.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f528aa00640 1 -- 172.21.15.50:0/1462137045 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f526c003530 con 0x7f528c06f240 2024-01-30T08:08:41.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5290e00640 1 -- 172.21.15.50:0/1462137045 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c155500 msgr2=0x7f528c0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:41.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5290e00640 1 --2- 172.21.15.50:0/1462137045 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c155500 0x7f528c0c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5290e00640 1 -- 172.21.15.50:0/1462137045 >> v1:172.21.15.125:6789/0 conn(0x7f528c06f240 legacy=0x7f528c0c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.444+0000 7f5290e00640 1 -- 172.21.15.50:0/1462137045 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c158240 con 0x7f528c06f6a0 2024-01-30T08:08:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.448+0000 7f5290e00640 1 --2- 172.21.15.50:0/1462137045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c06f6a0 0x7f528c0c1910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c7ca94c66ad7143 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.448+0000 7f528aa00640 1 -- 172.21.15.50:0/1462137045 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840a58c0 con 0x7f528c06f6a0 2024-01-30T08:08:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.448+0000 7f528aa00640 1 -- 172.21.15.50:0/1462137045 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52840a5a20 con 0x7f528c06f6a0 2024-01-30T08:08:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.448+0000 7f528aa00640 1 -- 172.21.15.50:0/1462137045 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840a5db0 con 0x7f528c06f6a0 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.448+0000 7f5292e00640 1 -- 172.21.15.50:0/1462137045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c06f6a0 msgr2=0x7f528c0c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.448+0000 7f5292e00640 1 --2- 172.21.15.50:0/1462137045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c06f6a0 0x7f528c0c1910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528401c800 comp rx=0 tx=0).stop 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- 172.21.15.50:0/1462137045 shutdown_connections 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 --2- 172.21.15.50:0/1462137045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c06f6a0 0x7f528c0c1910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 --2- 172.21.15.50:0/1462137045 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c155500 0x7f528c0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- 172.21.15.50:0/1462137045 >> 172.21.15.50:0/1462137045 conn(0x7f528c0727c0 msgr2=0x7f528c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- 172.21.15.50:0/1462137045 shutdown_connections 2024-01-30T08:08:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- 172.21.15.50:0/1462137045 wait complete. 2024-01-30T08:08:41.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 Processor -- start 2024-01-30T08:08:41.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- start start 2024-01-30T08:08:41.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c06f240 0x7f528c0a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f528c06f6a0 0x7f528c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c155500 0x7f528c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c0a7fc0 con 0x7f528c06f6a0 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c15a130 con 0x7f528c155500 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5292e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c14f100 con 0x7f528c06f240 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f528c06f6a0 0x7f528c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f528c06f6a0 0x7f528c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36516/0 (socket says 172.21.15.50:36516) 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 -- 172.21.15.50:0/482998023 learned_addr learned my addr 172.21.15.50:0/482998023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528be00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c06f240 0x7f528c0a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f5290e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c155500 0x7f528c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 -- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c06f240 msgr2=0x7f528c0a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c06f240 0x7f528c0a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 -- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c155500 msgr2=0x7f528c154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c155500 0x7f528c154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.452+0000 7f528b400640 1 -- 172.21.15.50:0/482998023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284009a70 con 0x7f528c06f6a0 2024-01-30T08:08:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f528b400640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f528c06f6a0 0x7f528c14ebc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f527400c3c0 tx=0x7f527400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5283e00640 1 -- 172.21.15.50:0/482998023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274005cf0 con 0x7f528c06f6a0 2024-01-30T08:08:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5283e00640 1 -- 172.21.15.50:0/482998023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5274005e50 con 0x7f528c06f6a0 2024-01-30T08:08:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528c1f0d90 con 0x7f528c06f6a0 2024-01-30T08:08:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5283e00640 1 -- 172.21.15.50:0/482998023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740072f0 con 0x7f528c06f6a0 2024-01-30T08:08:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528c0a7ce0 con 0x7f528c06f6a0 2024-01-30T08:08:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528c074a20 con 0x7f528c06f6a0 2024-01-30T08:08:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5283e00640 1 -- 172.21.15.50:0/482998023 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5274007450 con 0x7f528c06f6a0 2024-01-30T08:08:41.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5283e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5264066530 0x7f52640689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:41.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.456+0000 7f5283e00640 1 -- 172.21.15.50:0/482998023 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5274083370 con 0x7f528c06f6a0 2024-01-30T08:08:41.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.460+0000 7f528be00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5264066530 0x7f52640689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:41.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.460+0000 7f528be00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5264066530 0x7f52640689f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f527c009ac0 tx=0x7f527c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:41.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.460+0000 7f5283e00640 1 -- 172.21.15.50:0/482998023 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5274050710 con 0x7f528c06f6a0 2024-01-30T08:08:41.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:41.652+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f528c0c83c0 con 0x7f528c06f6a0 2024-01-30T08:08:42.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.260+0000 7f5283e00640 1 -- 172.21.15.50:0/482998023 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f52740170c0 con 0x7f528c06f6a0 2024-01-30T08:08:42.265 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2024-01-30T08:08:42.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5264066530 msgr2=0x7f52640689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:42.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5264066530 0x7f52640689f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f527c009ac0 tx=0x7f527c009190 comp rx=0 tx=0).stop 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f528c06f6a0 msgr2=0x7f528c14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f528c06f6a0 0x7f528c14ebc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f527400c3c0 tx=0x7f527400c880 comp rx=0 tx=0).stop 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 shutdown_connections 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f528c155500 0x7f528c154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5264066530 0x7f52640689f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f528c06f6a0 0x7f528c14ebc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 --2- 172.21.15.50:0/482998023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f528c06f240 0x7f528c0a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 >> 172.21.15.50:0/482998023 conn(0x7f528c0727c0 msgr2=0x7f528c06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 shutdown_connections 2024-01-30T08:08:42.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.276+0000 7f5292e00640 1 -- 172.21.15.50:0/482998023 wait complete. 2024-01-30T08:08:42.313 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-30T08:08:42.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-30T08:08:42.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd21400640 1 Processor -- start 2024-01-30T08:08:42.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd21400640 1 -- start start 2024-01-30T08:08:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd21400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd1c06e1f0 0x7fdd1c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd21400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c1535e0 con 0x7fdd1c0c4420 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd21400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c152a60 con 0x7fdd1c0a70d0 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd21400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c06f2e0 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd1b200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdd1c0c4420 0x7fdd1c0c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41180/0 (socket says 172.21.15.50:41180) 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd1b200640 1 -- 172.21.15.50:0/600981444 learned_addr learned my addr 172.21.15.50:0/600981444 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd19e00640 1 --2- 172.21.15.50:0/600981444 >> v2:172.21.15.125:3300/0 conn(0x7fdd1c06e1f0 0x7fdd1c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd19400640 1 -- 172.21.15.50:0/600981444 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365856026 0 0) 0x7fdd1c1535e0 con 0x7fdd1c0c4420 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd19400640 1 -- 172.21.15.50:0/600981444 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcfc003530 con 0x7fdd1c0c4420 2024-01-30T08:08:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd19e00640 1 -- 172.21.15.50:0/600981444 >> v1:172.21.15.125:6789/0 conn(0x7fdd1c0a70d0 legacy=0x7fdd1c14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd19e00640 1 -- 172.21.15.50:0/600981444 >> v1:172.21.15.50:6789/0 conn(0x7fdd1c0c4420 legacy=0x7fdd1c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.460+0000 7fdd19e00640 1 -- 172.21.15.50:0/600981444 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c152d40 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.464+0000 7fdd19e00640 1 --2- 172.21.15.50:0/600981444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0c7660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097c0 tx=0x7fdd0401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cace5df039c50ff server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.464+0000 7fdd19400640 1 -- 172.21.15.50:0/600981444 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ab600 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.464+0000 7fdd19400640 1 -- 172.21.15.50:0/600981444 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040a7050 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.464+0000 7fdd19400640 1 -- 172.21.15.50:0/600981444 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ab980 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.464+0000 7fdd21400640 1 -- 172.21.15.50:0/600981444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c06e1f0 msgr2=0x7fdd1c0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.464+0000 7fdd21400640 1 --2- 172.21.15.50:0/600981444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0c7660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097c0 tx=0x7fdd0401c3f0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- 172.21.15.50:0/600981444 shutdown_connections 2024-01-30T08:08:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 --2- 172.21.15.50:0/600981444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0c7660 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- 172.21.15.50:0/600981444 >> 172.21.15.50:0/600981444 conn(0x7fdd1c0a9a80 msgr2=0x7fdd1c0a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- 172.21.15.50:0/600981444 shutdown_connections 2024-01-30T08:08:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- 172.21.15.50:0/600981444 wait complete. 2024-01-30T08:08:42.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 Processor -- start 2024-01-30T08:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- start start 2024-01-30T08:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd1c0a70d0 0x7fdd1c1ee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c0c4420 0x7fdd1c14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c149430 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c1eede0 con 0x7fdd1c0c4420 2024-01-30T08:08:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd21400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0a8e70 con 0x7fdd1c0a70d0 2024-01-30T08:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0a8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36524/0 (socket says 172.21.15.50:36524) 2024-01-30T08:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 -- 172.21.15.50:0/4277830585 learned_addr learned my addr 172.21.15.50:0/4277830585 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd19e00640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd1c0a70d0 0x7fdd1c1ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1b200640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c0c4420 0x7fdd1c14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 -- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd1c0a70d0 msgr2=0x7fdd1c1ee8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd1c0a70d0 0x7fdd1c1ee8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 -- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c0c4420 msgr2=0x7fdd1c14e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c0c4420 0x7fdd1c14e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.468+0000 7fdd1a800640 1 -- 172.21.15.50:0/4277830585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009420 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd1a800640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0a8030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c420 tx=0x7fdd0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd12a00640 1 -- 172.21.15.50:0/4277830585 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0052d0 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd12a00640 1 -- 172.21.15.50:0/4277830585 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c005430 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd12a00640 1 -- 172.21.15.50:0/4277830585 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c007260 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c0a7550 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c0a7b10 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c074a20 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd12a00640 1 -- 172.21.15.50:0/4277830585 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdd0c0073c0 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd12a00640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdcf4066500 0x7fdcf40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd12a00640 1 -- 172.21.15.50:0/4277830585 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd0c083210 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.472+0000 7fdd19e00640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdcf4066500 0x7fdcf40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.476+0000 7fdd19e00640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdcf4066500 0x7fdcf40689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd040ad000 tx=0x7fdd04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.476+0000 7fdd12a00640 1 -- 172.21.15.50:0/4277830585 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdd0c050550 con 0x7fdd1c06e1f0 2024-01-30T08:08:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:42.656+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fdd1c0a97d0 con 0x7fdd1c06e1f0 2024-01-30T08:08:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.264+0000 7fdd12a00640 1 -- 172.21.15.50:0/4277830585 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fdd0c053b70 con 0x7fdd1c06e1f0 2024-01-30T08:08:43.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdcf4066500 msgr2=0x7fdcf40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:43.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdcf4066500 0x7fdcf40689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd040ad000 tx=0x7fdd04008040 comp rx=0 tx=0).stop 2024-01-30T08:08:43.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd1c06e1f0 msgr2=0x7fdd1c0a8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:43.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0a8030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c420 tx=0x7fdd0c00c8e0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 shutdown_connections 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd1c0c4420 0x7fdd1c14e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdcf4066500 0x7fdcf40689c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd1c0a70d0 0x7fdd1c1ee8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 --2- 172.21.15.50:0/4277830585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd1c06e1f0 0x7fdd1c0a8030 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 >> 172.21.15.50:0/4277830585 conn(0x7fdd1c0a9a80 msgr2=0x7fdd1c0a9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 shutdown_connections 2024-01-30T08:08:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.268+0000 7fdd21400640 1 -- 172.21.15.50:0/4277830585 wait complete. 2024-01-30T08:08:43.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-30T08:08:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.444+0000 7f8557000640 1 Processor -- start 2024-01-30T08:08:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8557000640 1 -- start start 2024-01-30T08:08:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8557000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85500c29a0 0x7f85500c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8557000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85500c3a40 con 0x7f8550072af0 2024-01-30T08:08:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8557000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85500c42e0 con 0x7f85500c2540 2024-01-30T08:08:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8557000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85500aa130 con 0x7f85500c29a0 2024-01-30T08:08:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854fe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8550072af0 0x7f85500c0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41192/0 (socket says 172.21.15.50:41192) 2024-01-30T08:08:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854fe00640 1 -- 172.21.15.50:0/341082046 learned_addr learned my addr 172.21.15.50:0/341082046 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:43.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705583708 0 0) 0x7f85500c3a40 con 0x7f8550072af0 2024-01-30T08:08:43.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8555000640 1 --2- 172.21.15.50:0/341082046 >> v2:172.21.15.125:3300/0 conn(0x7f85500c29a0 0x7f85500c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8530003530 con 0x7f8550072af0 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128039423 0 0) 0x7f8530003530 con 0x7f8550072af0 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 >> v2:172.21.15.125:3300/0 conn(0x7f85500c29a0 msgr2=0x7f85500c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 --2- 172.21.15.50:0/341082046 >> v2:172.21.15.125:3300/0 conn(0x7f85500c29a0 0x7f85500c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 >> v1:172.21.15.125:6789/0 conn(0x7f85500c2540 legacy=0x7f85500c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500c1fe0 con 0x7f8550072af0 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f8540001680 con 0x7f8550072af0 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 >> v1:172.21.15.50:6789/0 conn(0x7f8550072af0 legacy=0x7f85500c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8530003980 0x7f8530003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8530004380 0x7f8530004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85300050f0 0x7f853000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853000c000 con 0x7f85300050f0 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853000c170 con 0x7f8530003980 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853000c330 con 0x7f8530004380 2024-01-30T08:08:43.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8555000640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85300050f0 0x7f853000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854f400640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8530004380 0x7f8530004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f854fe00640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8530003980 0x7f8530003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8555000640 1 -- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8530004380 msgr2=0x7f8530004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8555000640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8530004380 0x7f8530004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8555000640 1 -- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8530003980 msgr2=0x7f8530003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8555000640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8530003980 0x7f8530003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.448+0000 7f8555000640 1 -- 172.21.15.50:0/341082046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530003530 con 0x7f85300050f0 2024-01-30T08:08:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8555000640 1 -- 172.21.15.50:0/341082046 reap_dead start 2024-01-30T08:08:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8555000640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85300050f0 0x7f853000b990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8548009fc0 tx=0x7f854801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6f481528115cce server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480a5cb0 con 0x7f85300050f0 2024-01-30T08:08:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800f040 con 0x7f85300050f0 2024-01-30T08:08:43.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f854ea00640 1 -- 172.21.15.50:0/341082046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548003be0 con 0x7f85300050f0 2024-01-30T08:08:43.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8557000640 1 -- 172.21.15.50:0/341082046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85300050f0 msgr2=0x7f853000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:43.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8557000640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85300050f0 0x7f853000b990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8548009fc0 tx=0x7f854801cca0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8557000640 1 -- 172.21.15.50:0/341082046 shutdown_connections 2024-01-30T08:08:43.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8557000640 1 --2- 172.21.15.50:0/341082046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85300050f0 0x7f853000b990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8557000640 1 -- 172.21.15.50:0/341082046 >> 172.21.15.50:0/341082046 conn(0x7f85500a79e0 msgr2=0x7f85500a7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:43.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8557000640 1 -- 172.21.15.50:0/341082046 shutdown_connections 2024-01-30T08:08:43.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.452+0000 7f8557000640 1 -- 172.21.15.50:0/341082046 wait complete. 2024-01-30T08:08:43.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 Processor -- start 2024-01-30T08:08:43.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 -- start start 2024-01-30T08:08:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85300050f0 0x7f85501d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85501eadd0 0x7f85501eb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85501daa90 0x7f85501daf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85501dc150 con 0x7f85501eadd0 2024-01-30T08:08:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85501eb790 con 0x7f85501daa90 2024-01-30T08:08:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85501ea940 con 0x7f85300050f0 2024-01-30T08:08:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85501eadd0 0x7f85501eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85501eadd0 0x7f85501eb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36546/0 (socket says 172.21.15.50:36546) 2024-01-30T08:08:43.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 -- 172.21.15.50:0/1469515832 learned_addr learned my addr 172.21.15.50:0/1469515832 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:43.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8555000640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85501daa90 0x7f85501daf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854fe00640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85300050f0 0x7f85501d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 -- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85300050f0 msgr2=0x7f85501d9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85300050f0 0x7f85501d9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 -- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85501daa90 msgr2=0x7f85501daf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85501daa90 0x7f85501daf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 -- 172.21.15.50:0/1469515832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85501525d0 con 0x7f85501eadd0 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f854f400640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85501eadd0 0x7f85501eb250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8538011c40 tx=0x7f853800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8547e00640 1 -- 172.21.15.50:0/1469515832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538011c70 con 0x7f85501eadd0 2024-01-30T08:08:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8547e00640 1 -- 172.21.15.50:0/1469515832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8538011df0 con 0x7f85501eadd0 2024-01-30T08:08:43.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8547e00640 1 -- 172.21.15.50:0/1469515832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538005310 con 0x7f85501eadd0 2024-01-30T08:08:43.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85501dbe70 con 0x7f85501eadd0 2024-01-30T08:08:43.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.456+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85501da010 con 0x7f85501eadd0 2024-01-30T08:08:43.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.460+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8550067cc0 con 0x7f85501eadd0 2024-01-30T08:08:43.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.460+0000 7f8547e00640 1 -- 172.21.15.50:0/1469515832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8538003600 con 0x7f85501eadd0 2024-01-30T08:08:43.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.460+0000 7f8547e00640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8528066500 0x7f85280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:43.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.460+0000 7f8547e00640 1 -- 172.21.15.50:0/1469515832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8538087710 con 0x7f85501eadd0 2024-01-30T08:08:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.460+0000 7f854fe00640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8528066500 0x7f85280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:43.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.460+0000 7f854fe00640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8528066500 0x7f85280689c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85500bfb30 tx=0x7f8540001c30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:43.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.464+0000 7f8547e00640 1 -- 172.21.15.50:0/1469515832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f85380548c0 con 0x7f85501eadd0 2024-01-30T08:08:43.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:43.628+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8550074a20 con 0x7f85501eadd0 2024-01-30T08:08:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.276+0000 7f8547e00640 1 -- 172.21.15.50:0/1469515832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f8538057ee0 con 0x7f85501eadd0 2024-01-30T08:08:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2024-01-30T08:08:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8528066500 msgr2=0x7f85280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8528066500 0x7f85280689c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85500bfb30 tx=0x7f8540001c30 comp rx=0 tx=0).stop 2024-01-30T08:08:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85501eadd0 msgr2=0x7f85501eb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85501eadd0 0x7f85501eb250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8538011c40 tx=0x7f853800f5a0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 shutdown_connections 2024-01-30T08:08:45.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85501daa90 0x7f85501daf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8528066500 0x7f85280689c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85501eadd0 0x7f85501eb250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 --2- 172.21.15.50:0/1469515832 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85300050f0 0x7f85501d9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.280+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 >> 172.21.15.50:0/1469515832 conn(0x7f85500a79e0 msgr2=0x7f85501dd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:45.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.284+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 shutdown_connections 2024-01-30T08:08:45.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.284+0000 7f8557000640 1 -- 172.21.15.50:0/1469515832 wait complete. 2024-01-30T08:08:45.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-30T08:08:45.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.464+0000 7fdc82c00640 1 Processor -- start 2024-01-30T08:08:45.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.464+0000 7fdc82c00640 1 -- start start 2024-01-30T08:08:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.464+0000 7fdc82c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc7c06ca80 0x7fdc7c0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.464+0000 7fdc82c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c0c3670 con 0x7fdc7c1551d0 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.464+0000 7fdc82c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c06c5f0 con 0x7fdc7c0c4960 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.464+0000 7fdc82c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c3a20 con 0x7fdc7c06ca80 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc80c00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc7c1551d0 0x7fdc7c15f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41202/0 (socket says 172.21.15.50:41202) 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc80c00640 1 -- 172.21.15.50:0/371713730 learned_addr learned my addr 172.21.15.50:0/371713730 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7b400640 1 --2- 172.21.15.50:0/371713730 >> v2:172.21.15.125:3300/0 conn(0x7fdc7c06ca80 0x7fdc7c0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183324038 0 0) 0x7fdc740014a0 con 0x7fdc7c1551d0 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc5c003530 con 0x7fdc7c1551d0 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280076209 0 0) 0x7fdc7c06c5f0 con 0x7fdc7c0c4960 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc740014a0 con 0x7fdc7c0c4960 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7b400640 1 -- 172.21.15.50:0/371713730 >> v1:172.21.15.125:6789/0 conn(0x7fdc7c0c4960 legacy=0x7fdc7c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7b400640 1 -- 172.21.15.50:0/371713730 >> v1:172.21.15.50:6789/0 conn(0x7fdc7c1551d0 legacy=0x7fdc7c15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069286773 0 0) 0x7fdc5c003530 con 0x7fdc7c1551d0 2024-01-30T08:08:45.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.468+0000 7fdc7b400640 1 -- 172.21.15.50:0/371713730 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c158d80 con 0x7fdc7c06ca80 2024-01-30T08:08:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc7b400640 1 --2- 172.21.15.50:0/371713730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c0c3130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097c0 tx=0x7fdc6401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9247a108701e478c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74001b90 con 0x7fdc7c06ca80 2024-01-30T08:08:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc640a7050 con 0x7fdc7c06ca80 2024-01-30T08:08:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc7aa00640 1 -- 172.21.15.50:0/371713730 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640ab620 con 0x7fdc7c06ca80 2024-01-30T08:08:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 -- 172.21.15.50:0/371713730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c06ca80 msgr2=0x7fdc7c0c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 --2- 172.21.15.50:0/371713730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c0c3130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097c0 tx=0x7fdc6401c370 comp rx=0 tx=0).stop 2024-01-30T08:08:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 -- 172.21.15.50:0/371713730 shutdown_connections 2024-01-30T08:08:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 --2- 172.21.15.50:0/371713730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c0c3130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 -- 172.21.15.50:0/371713730 >> 172.21.15.50:0/371713730 conn(0x7fdc7c0a9a80 msgr2=0x7fdc7c0a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 -- 172.21.15.50:0/371713730 shutdown_connections 2024-01-30T08:08:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 -- 172.21.15.50:0/371713730 wait complete. 2024-01-30T08:08:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 Processor -- start 2024-01-30T08:08:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.472+0000 7fdc82c00640 1 -- start start 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c0c4960 0x7fdc7c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7c1551d0 0x7fdc7c14dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c153e50 con 0x7fdc7c06ca80 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c1543f0 con 0x7fdc7c0c4960 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c157a30 con 0x7fdc7c1551d0 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c1573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36556/0 (socket says 172.21.15.50:36556) 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 -- 172.21.15.50:0/2978318786 learned_addr learned my addr 172.21.15.50:0/2978318786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7b400640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c0c4960 0x7fdc7c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc80c00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7c1551d0 0x7fdc7c14dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 -- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7c1551d0 msgr2=0x7fdc7c14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:45.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7c1551d0 0x7fdc7c14dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 -- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c0c4960 msgr2=0x7fdc7c154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c0c4960 0x7fdc7c154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 -- 172.21.15.50:0/2978318786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc64009420 con 0x7fdc7c06ca80 2024-01-30T08:08:45.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc7be00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c1573c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c490 tx=0x7fdc6c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc73e00640 1 -- 172.21.15.50:0/2978318786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0052d0 con 0x7fdc7c06ca80 2024-01-30T08:08:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc73e00640 1 -- 172.21.15.50:0/2978318786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c005430 con 0x7fdc7c06ca80 2024-01-30T08:08:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c157d10 con 0x7fdc7c06ca80 2024-01-30T08:08:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc73e00640 1 -- 172.21.15.50:0/2978318786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c012870 con 0x7fdc7c06ca80 2024-01-30T08:08:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c0a6e70 con 0x7fdc7c06ca80 2024-01-30T08:08:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c157f50 con 0x7fdc7c06ca80 2024-01-30T08:08:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.476+0000 7fdc73e00640 1 -- 172.21.15.50:0/2978318786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdc6c0129d0 con 0x7fdc7c06ca80 2024-01-30T08:08:45.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.480+0000 7fdc73e00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc54066500 0x7fdc540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:45.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.480+0000 7fdc73e00640 1 -- 172.21.15.50:0/2978318786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fdc6c083b20 con 0x7fdc7c06ca80 2024-01-30T08:08:45.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.480+0000 7fdc7b400640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc54066500 0x7fdc540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:45.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.480+0000 7fdc7b400640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc54066500 0x7fdc540689c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc640ad000 tx=0x7fdc64008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:45.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.484+0000 7fdc73e00640 1 -- 172.21.15.50:0/2978318786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdc7c157f50 con 0x7fdc7c06ca80 2024-01-30T08:08:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:45.640+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fdc7c157f50 con 0x7fdc7c06ca80 2024-01-30T08:08:46.206 INFO:tasks.ceph.mds.d.smithi125.stderr:2024-01-30T08:08:46.206+0000 7ffb18200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-30T08:08:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.280+0000 7fdc73e00640 1 -- 172.21.15.50:0/2978318786 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdc7c157f50 con 0x7fdc7c06ca80 2024-01-30T08:08:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 allow_ec_overwrites to true 2024-01-30T08:08:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc54066500 msgr2=0x7fdc540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc54066500 0x7fdc540689c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc640ad000 tx=0x7fdc64008040 comp rx=0 tx=0).stop 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7c06ca80 msgr2=0x7fdc7c1573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c1573c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c490 tx=0x7fdc6c00c950 comp rx=0 tx=0).stop 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 shutdown_connections 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc7c0c4960 0x7fdc7c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc54066500 0x7fdc540689c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc7c1551d0 0x7fdc7c14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 --2- 172.21.15.50:0/2978318786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7c06ca80 0x7fdc7c1573c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 >> 172.21.15.50:0/2978318786 conn(0x7fdc7c0a9a80 msgr2=0x7fdc7c06ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:46.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 shutdown_connections 2024-01-30T08:08:46.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.284+0000 7fdc82c00640 1 -- 172.21.15.50:0/2978318786 wait complete. 2024-01-30T08:08:46.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-30T08:08:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74ece00640 1 Processor -- start 2024-01-30T08:08:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74ece00640 1 -- start start 2024-01-30T08:08:46.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74ece00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74e8155500 0x7f74e80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:46.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74ece00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e8158b70 con 0x7f74e806f240 2024-01-30T08:08:46.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74ece00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e8157f60 con 0x7f74e806f6d0 2024-01-30T08:08:46.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74ece00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e806fae0 con 0x7f74e8155500 2024-01-30T08:08:46.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74e5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74e8155500 0x7f74e80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:46.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74e5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74e8155500 0x7f74e80c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36564/0 (socket says 172.21.15.50:36564) 2024-01-30T08:08:46.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74e5e00640 1 -- 172.21.15.50:0/3712813015 learned_addr learned my addr 172.21.15.50:0/3712813015 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:46.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74e5400640 1 --1- 172.21.15.50:0/3712813015 >> v1:172.21.15.50:6789/0 conn(0x7f74e806f240 0x7f74e80c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41216/0 (socket says 172.21.15.50:41216) 2024-01-30T08:08:46.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74e5e00640 1 -- 172.21.15.50:0/3712813015 >> v1:172.21.15.125:6789/0 conn(0x7f74e806f6d0 legacy=0x7f74e80c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:46.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74e5e00640 1 -- 172.21.15.50:0/3712813015 >> v1:172.21.15.50:6789/0 conn(0x7f74e806f240 legacy=0x7f74e80c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:46.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.476+0000 7f74e5e00640 1 -- 172.21.15.50:0/3712813015 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8158240 con 0x7f74e8155500 2024-01-30T08:08:46.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74e5e00640 1 --2- 172.21.15.50:0/3712813015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e8155500 0x7f74e80c85e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74e806fc20 tx=0x7f74d801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ff307dc994d289 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:46.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74e4a00640 1 -- 172.21.15.50:0/3712813015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80ac630 con 0x7f74e8155500 2024-01-30T08:08:46.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74e4a00640 1 -- 172.21.15.50:0/3712813015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d80ac790 con 0x7f74e8155500 2024-01-30T08:08:46.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74e4a00640 1 -- 172.21.15.50:0/3712813015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80acb20 con 0x7f74e8155500 2024-01-30T08:08:46.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 -- 172.21.15.50:0/3712813015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e8155500 msgr2=0x7f74e80c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:46.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 --2- 172.21.15.50:0/3712813015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e8155500 0x7f74e80c85e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74e806fc20 tx=0x7f74d801c3d0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 -- 172.21.15.50:0/3712813015 shutdown_connections 2024-01-30T08:08:46.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 --2- 172.21.15.50:0/3712813015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e8155500 0x7f74e80c85e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 -- 172.21.15.50:0/3712813015 >> 172.21.15.50:0/3712813015 conn(0x7f74e80727c0 msgr2=0x7f74e806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:46.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 -- 172.21.15.50:0/3712813015 shutdown_connections 2024-01-30T08:08:46.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 -- 172.21.15.50:0/3712813015 wait complete. 2024-01-30T08:08:46.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.480+0000 7f74ece00640 1 Processor -- start 2024-01-30T08:08:46.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 -- start start 2024-01-30T08:08:46.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e806f240 0x7f74e8154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74e806f6d0 0x7f74e814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74e8155500 0x7f74e814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80a7210 con 0x7f74e806f240 2024-01-30T08:08:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e814ae90 con 0x7f74e8155500 2024-01-30T08:08:46.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81ed990 con 0x7f74e806f6d0 2024-01-30T08:08:46.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e806f240 0x7f74e8154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:46.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e806f240 0x7f74e8154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36568/0 (socket says 172.21.15.50:36568) 2024-01-30T08:08:46.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 -- 172.21.15.50:0/2967229418 learned_addr learned my addr 172.21.15.50:0/2967229418 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:46.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e6800640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74e8155500 0x7f74e814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:46.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5400640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74e806f6d0 0x7f74e814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:46.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 -- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74e806f6d0 msgr2=0x7f74e814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:46.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74e806f6d0 0x7f74e814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 -- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74e8155500 msgr2=0x7f74e814a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:46.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74e8155500 0x7f74e814a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:46.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 -- 172.21.15.50:0/2967229418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80094d0 con 0x7f74e806f240 2024-01-30T08:08:46.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74e5e00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e806f240 0x7f74e8154750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74d80af040 tx=0x7f74d8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:46.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74de000640 1 -- 172.21.15.50:0/2967229418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80b5830 con 0x7f74e806f240 2024-01-30T08:08:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74de000640 1 -- 172.21.15.50:0/2967229418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d80b59b0 con 0x7f74e806f240 2024-01-30T08:08:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e80a6f50 con 0x7f74e806f240 2024-01-30T08:08:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74de000640 1 -- 172.21.15.50:0/2967229418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80b5d60 con 0x7f74e806f240 2024-01-30T08:08:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e81ed620 con 0x7f74e806f240 2024-01-30T08:08:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.484+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e814e950 con 0x7f74e806f240 2024-01-30T08:08:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.488+0000 7f74de000640 1 -- 172.21.15.50:0/2967229418 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f74d80b3070 con 0x7f74e806f240 2024-01-30T08:08:46.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.488+0000 7f74de000640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f74c0066500 0x7f74c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:46.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.488+0000 7f74de000640 1 -- 172.21.15.50:0/2967229418 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f74d811ea70 con 0x7f74e806f240 2024-01-30T08:08:46.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.488+0000 7f74e5400640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f74c0066500 0x7f74c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:46.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.488+0000 7f74e5400640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f74c0066500 0x7f74c00689c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74e80c2500 tx=0x7f74d0007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:46.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.492+0000 7f74de000640 1 -- 172.21.15.50:0/2967229418 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f74e814e950 con 0x7f74e806f240 2024-01-30T08:08:46.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:46.692+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f74e81ed480 con 0x7f74e806f240 2024-01-30T08:08:47.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.304+0000 7f74de000640 1 -- 172.21.15.50:0/2967229418 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f74e81ed480 con 0x7f74e806f240 2024-01-30T08:08:47.306 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 4 to fsmap 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f74c0066500 msgr2=0x7f74c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f74c0066500 0x7f74c00689c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74e80c2500 tx=0x7f74d0007c90 comp rx=0 tx=0).stop 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e806f240 msgr2=0x7f74e8154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e806f240 0x7f74e8154750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74d80af040 tx=0x7f74d8019170 comp rx=0 tx=0).stop 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 shutdown_connections 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74e8155500 0x7f74e814a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f74c0066500 0x7f74c00689c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74e806f6d0 0x7f74e814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 --2- 172.21.15.50:0/2967229418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e806f240 0x7f74e8154750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 >> 172.21.15.50:0/2967229418 conn(0x7f74e80727c0 msgr2=0x7f74e80c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 shutdown_connections 2024-01-30T08:08:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.308+0000 7f74ece00640 1 -- 172.21.15.50:0/2967229418 wait complete. 2024-01-30T08:08:47.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:08:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.472+0000 7f323b400640 1 Processor -- start 2024-01-30T08:08:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.472+0000 7f323b400640 1 -- start start 2024-01-30T08:08:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f323b400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f323406de40 0x7f323406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f323b400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234152f00 con 0x7f32340c4310 2024-01-30T08:08:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f323b400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32341525f0 con 0x7f3234153390 2024-01-30T08:08:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f323b400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32340a7680 con 0x7f323406de40 2024-01-30T08:08:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3239400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f32340c4310 0x7f3234155be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41220/0 (socket says 172.21.15.50:41220) 2024-01-30T08:08:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3239400640 1 -- 172.21.15.50:0/3356861505 learned_addr learned my addr 172.21.15.50:0/3356861505 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3238a00640 1 --2- 172.21.15.50:0/3356861505 >> v2:172.21.15.125:3300/0 conn(0x7f323406de40 0x7f323406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036366431 0 0) 0x7f3234152f00 con 0x7f32340c4310 2024-01-30T08:08:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3214003530 con 0x7f32340c4310 2024-01-30T08:08:47.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569661027 0 0) 0x7f32341525f0 con 0x7f3234153390 2024-01-30T08:08:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234152f00 con 0x7f3234153390 2024-01-30T08:08:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3238a00640 1 -- 172.21.15.50:0/3356861505 >> v1:172.21.15.125:6789/0 conn(0x7f3234153390 legacy=0x7f32340a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2265274157 0 0) 0x7f3214003530 con 0x7f32340c4310 2024-01-30T08:08:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3238a00640 1 -- 172.21.15.50:0/3356861505 >> v1:172.21.15.50:6789/0 conn(0x7f32340c4310 legacy=0x7f3234155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.476+0000 7f3238a00640 1 -- 172.21.15.50:0/3356861505 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32341528b0 con 0x7f323406de40 2024-01-30T08:08:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f3238a00640 1 --2- 172.21.15.50:0/3356861505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f323406de40 0x7f323406e220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32240097c0 tx=0x7f322401c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91bc24e06743eb6d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c001a00 con 0x7f323406de40 2024-01-30T08:08:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32240a7050 con 0x7f323406de40 2024-01-30T08:08:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f3233400640 1 -- 172.21.15.50:0/3356861505 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32240ab620 con 0x7f323406de40 2024-01-30T08:08:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 -- 172.21.15.50:0/3356861505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f323406de40 msgr2=0x7f323406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 --2- 172.21.15.50:0/3356861505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f323406de40 0x7f323406e220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32240097c0 tx=0x7f322401c250 comp rx=0 tx=0).stop 2024-01-30T08:08:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 -- 172.21.15.50:0/3356861505 shutdown_connections 2024-01-30T08:08:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 --2- 172.21.15.50:0/3356861505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f323406de40 0x7f323406e220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 -- 172.21.15.50:0/3356861505 >> 172.21.15.50:0/3356861505 conn(0x7f32340c4830 msgr2=0x7f32340c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 -- 172.21.15.50:0/3356861505 shutdown_connections 2024-01-30T08:08:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 -- 172.21.15.50:0/3356861505 wait complete. 2024-01-30T08:08:47.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.480+0000 7f323b400640 1 Processor -- start 2024-01-30T08:08:47.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 -- start start 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f323406de40 0x7f32341eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32340c4310 0x7f3234151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3234153390 0x7f3234154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341f0f10 con 0x7f32340c4310 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341ecf70 con 0x7f3234153390 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32341ed250 con 0x7f323406de40 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32340c4310 0x7f3234151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32340c4310 0x7f3234151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36582/0 (socket says 172.21.15.50:36582) 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 -- 172.21.15.50:0/1681078508 learned_addr learned my addr 172.21.15.50:0/1681078508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3239400640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3234153390 0x7f3234154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3238a00640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f323406de40 0x7f32341eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 -- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f323406de40 msgr2=0x7f32341eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f323406de40 0x7f32341eda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 -- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3234153390 msgr2=0x7f3234154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3234153390 0x7f3234154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 -- 172.21.15.50:0/1681078508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224009420 con 0x7f32340c4310 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3233e00640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32340c4310 0x7f3234151b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c430 tx=0x7f321c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3230c00640 1 -- 172.21.15.50:0/1681078508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c0052d0 con 0x7f32340c4310 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3230c00640 1 -- 172.21.15.50:0/1681078508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c005450 con 0x7f32340c4310 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f3230c00640 1 -- 172.21.15.50:0/1681078508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c003840 con 0x7f32340c4310 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32341ed530 con 0x7f32340c4310 2024-01-30T08:08:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3234152060 con 0x7f32340c4310 2024-01-30T08:08:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.484+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32340672d0 con 0x7f32340c4310 2024-01-30T08:08:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.488+0000 7f3230c00640 1 -- 172.21.15.50:0/1681078508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f321c0039a0 con 0x7f32340c4310 2024-01-30T08:08:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.488+0000 7f3230c00640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f320c066500 0x7f320c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.488+0000 7f3230c00640 1 -- 172.21.15.50:0/1681078508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f321c083810 con 0x7f32340c4310 2024-01-30T08:08:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.488+0000 7f3238a00640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f320c066500 0x7f320c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.488+0000 7f3238a00640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f320c066500 0x7f320c0689c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f32240ad000 tx=0x7f32240a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.492+0000 7f3230c00640 1 -- 172.21.15.50:0/1681078508 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f321c050740 con 0x7f32340c4310 2024-01-30T08:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.680+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32341ed720 con 0x7f32340c4310 2024-01-30T08:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f3230c00640 1 -- 172.21.15.50:0/1681078508 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4934 (secure 0 0 0) 0x7f321c053d60 con 0x7f32340c4310 2024-01-30T08:08:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:47.685 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:08:46.697772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-30T08:08:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f320c066500 msgr2=0x7f320c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f320c066500 0x7f320c0689c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f32240ad000 tx=0x7f32240a6000 comp rx=0 tx=0).stop 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32340c4310 msgr2=0x7f3234151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32340c4310 0x7f3234151b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c430 tx=0x7f321c00c8f0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 shutdown_connections 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3234153390 0x7f3234154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f320c066500 0x7f320c0689c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32340c4310 0x7f3234151b20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 --2- 172.21.15.50:0/1681078508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f323406de40 0x7f32341eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 >> 172.21.15.50:0/1681078508 conn(0x7f32340c4830 msgr2=0x7f3234150650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 shutdown_connections 2024-01-30T08:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.684+0000 7f323b400640 1 -- 172.21.15.50:0/1681078508 wait complete. 2024-01-30T08:08:47.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:47.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.844+0000 7f3f93800640 1 Processor -- start 2024-01-30T08:08:47.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.844+0000 7f3f93800640 1 -- start start 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f93800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f8c06de40 0x7f3f8c0a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f93800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f8c1584a0 0x7f3f8c15f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f93800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c0c7b40 con 0x7f3f8c06e220 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f93800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c0a7770 con 0x7f3f8c1584a0 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f93800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c155310 con 0x7f3f8c06de40 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f91800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f8c1584a0 0x7f3f8c15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f8be00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f8c06e220 0x7f3f8c157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41232/0 (socket says 172.21.15.50:41232) 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f91800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f8c1584a0 0x7f3f8c15f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36596/0 (socket says 172.21.15.50:36596) 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f8be00640 1 -- 172.21.15.50:0/4107493976 learned_addr learned my addr 172.21.15.50:0/4107493976 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f90e00640 1 --2- 172.21.15.50:0/4107493976 >> v2:172.21.15.125:3300/0 conn(0x7f3f8c06de40 0x7f3f8c0a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f91800640 1 -- 172.21.15.50:0/4107493976 >> v2:172.21.15.125:3300/0 conn(0x7f3f8c06de40 msgr2=0x7f3f8c0a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f91800640 1 --2- 172.21.15.50:0/4107493976 >> v2:172.21.15.125:3300/0 conn(0x7f3f8c06de40 0x7f3f8c0a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f91800640 1 -- 172.21.15.50:0/4107493976 >> v1:172.21.15.50:6789/0 conn(0x7f3f8c06e220 legacy=0x7f3f8c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f91800640 1 -- 172.21.15.50:0/4107493976 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c155730 con 0x7f3f8c1584a0 2024-01-30T08:08:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f8b400640 1 -- 172.21.15.50:0/4107493976 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936981835 0 0) 0x7f3f74001120 con 0x7f3f8c06e220 2024-01-30T08:08:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.848+0000 7f3f91800640 1 --2- 172.21.15.50:0/4107493976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c1584a0 0x7f3f8c15f120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c073f80 tx=0x7f3f8401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badbd92e03b21e28 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f8b400640 1 -- 172.21.15.50:0/4107493976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840a57d0 con 0x7f3f8c1584a0 2024-01-30T08:08:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f8b400640 1 -- 172.21.15.50:0/4107493976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f840a5930 con 0x7f3f8c1584a0 2024-01-30T08:08:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f8b400640 1 -- 172.21.15.50:0/4107493976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840a5cc0 con 0x7f3f8c1584a0 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- 172.21.15.50:0/4107493976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c1584a0 msgr2=0x7f3f8c15f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 --2- 172.21.15.50:0/4107493976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c1584a0 0x7f3f8c15f120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c073f80 tx=0x7f3f8401c910 comp rx=0 tx=0).stop 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- 172.21.15.50:0/4107493976 shutdown_connections 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 --2- 172.21.15.50:0/4107493976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c1584a0 0x7f3f8c15f120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 --2- 172.21.15.50:0/4107493976 >> v2:172.21.15.125:3300/0 conn(0x7f3f8c06de40 0x7f3f8c0a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- 172.21.15.50:0/4107493976 >> 172.21.15.50:0/4107493976 conn(0x7f3f8c0c4830 msgr2=0x7f3f8c0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- 172.21.15.50:0/4107493976 shutdown_connections 2024-01-30T08:08:47.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- 172.21.15.50:0/4107493976 wait complete. 2024-01-30T08:08:47.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 Processor -- start 2024-01-30T08:08:47.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- start start 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f8c06de40 0x7f3f8c0a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c06e220 0x7f3f8c146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f8c1584a0 0x7f3f8c147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1f12d0 con 0x7f3f8c06e220 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1f0e40 con 0x7f3f8c06de40 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f93800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c156f70 con 0x7f3f8c1584a0 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c06e220 0x7f3f8c146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f8be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c06e220 0x7f3f8c146d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36610/0 (socket says 172.21.15.50:36610) 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.852+0000 7f3f8be00640 1 -- 172.21.15.50:0/1226564435 learned_addr learned my addr 172.21.15.50:0/1226564435 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f90e00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f8c06de40 0x7f3f8c0a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f91800640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f8c1584a0 0x7f3f8c147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f8be00640 1 -- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f8c1584a0 msgr2=0x7f3f8c147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f8be00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f8c1584a0 0x7f3f8c147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f8be00640 1 -- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f8c06de40 msgr2=0x7f3f8c0a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f8be00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f8c06de40 0x7f3f8c0a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f8be00640 1 -- 172.21.15.50:0/1226564435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009a70 con 0x7f3f8c06e220 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f90e00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f8c06de40 0x7f3f8c0a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f8be00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c06e220 0x7f3f8c146d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400c780 tx=0x7f3f7400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f88c00640 1 -- 172.21.15.50:0/1226564435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740072d0 con 0x7f3f8c06e220 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f88c00640 1 -- 172.21.15.50:0/1226564435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f74007450 con 0x7f3f8c06e220 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f88c00640 1 -- 172.21.15.50:0/1226564435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740047f0 con 0x7f3f8c06e220 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c1f0510 con 0x7f3f8c06e220 2024-01-30T08:08:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c1f0ad0 con 0x7f3f8c06e220 2024-01-30T08:08:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c1f0fb0 con 0x7f3f8c06e220 2024-01-30T08:08:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f88c00640 1 -- 172.21.15.50:0/1226564435 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3f74004950 con 0x7f3f8c06e220 2024-01-30T08:08:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.856+0000 7f3f88c00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3f64066500 0x7f3f640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.860+0000 7f3f88c00640 1 -- 172.21.15.50:0/1226564435 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f74083130 con 0x7f3f8c06e220 2024-01-30T08:08:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.860+0000 7f3f90e00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3f64066500 0x7f3f640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.860+0000 7f3f90e00640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3f64066500 0x7f3f640689c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c156b30 tx=0x7f3f7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:47.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:47.860+0000 7f3f88c00640 1 -- 172.21.15.50:0/1226564435 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3f74050170 con 0x7f3f8c06e220 2024-01-30T08:08:48.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.020+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f8c0c7b20 con 0x7f3f8c06e220 2024-01-30T08:08:48.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f88c00640 1 -- 172.21.15.50:0/1226564435 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f3f74053790 con 0x7f3f8c06e220 2024-01-30T08:08:48.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:48.025 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3f64066500 msgr2=0x7f3f640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3f64066500 0x7f3f640689c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c156b30 tx=0x7f3f7c008040 comp rx=0 tx=0).stop 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c06e220 msgr2=0x7f3f8c146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c06e220 0x7f3f8c146d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400c780 tx=0x7f3f7400cc40 comp rx=0 tx=0).stop 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 shutdown_connections 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3f64066500 0x7f3f640689c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f8c1584a0 0x7f3f8c147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f8c06e220 0x7f3f8c146d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 --2- 172.21.15.50:0/1226564435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f8c06de40 0x7f3f8c0a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 >> 172.21.15.50:0/1226564435 conn(0x7f3f8c0c4830 msgr2=0x7f3f8c0704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 shutdown_connections 2024-01-30T08:08:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.024+0000 7f3f93800640 1 -- 172.21.15.50:0/1226564435 wait complete. 2024-01-30T08:08:48.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe2a00640 1 Processor -- start 2024-01-30T08:08:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe2a00640 1 -- start start 2024-01-30T08:08:48.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe2a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fdc0a7120 0x7f2fdc1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe2a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0c7b40 con 0x7f2fdc06e220 2024-01-30T08:08:48.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe2a00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc155730 con 0x7f2fdc06de40 2024-01-30T08:08:48.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe2a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0a7770 con 0x7f2fdc0a7120 2024-01-30T08:08:48.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe0a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2fdc06e220 0x7f2fdc15f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41236/0 (socket says 172.21.15.50:41236) 2024-01-30T08:08:48.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fe0a00640 1 -- 172.21.15.50:0/571612572 learned_addr learned my addr 172.21.15.50:0/571612572 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdb400640 1 --2- 172.21.15.50:0/571612572 >> v2:172.21.15.125:3300/0 conn(0x7f2fdc0a7120 0x7f2fdc1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdaa00640 1 -- 172.21.15.50:0/571612572 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627601023 0 0) 0x7f2fd40014a0 con 0x7f2fdc06e220 2024-01-30T08:08:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdaa00640 1 -- 172.21.15.50:0/571612572 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fbc003530 con 0x7f2fdc06e220 2024-01-30T08:08:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdaa00640 1 -- 172.21.15.50:0/571612572 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077482068 0 0) 0x7f2fcc001120 con 0x7f2fdc06de40 2024-01-30T08:08:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdaa00640 1 -- 172.21.15.50:0/571612572 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd40014a0 con 0x7f2fdc06de40 2024-01-30T08:08:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdb400640 1 -- 172.21.15.50:0/571612572 >> v1:172.21.15.125:6789/0 conn(0x7f2fdc06de40 legacy=0x7f2fdc157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdb400640 1 -- 172.21.15.50:0/571612572 >> v1:172.21.15.50:6789/0 conn(0x7f2fdc06e220 legacy=0x7f2fdc15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.188+0000 7f2fdb400640 1 -- 172.21.15.50:0/571612572 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc06ec20 con 0x7f2fdc0a7120 2024-01-30T08:08:48.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fdb400640 1 --2- 172.21.15.50:0/571612572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1584a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097c0 tx=0x7f2fc401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78be0b18a69ec453 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fdaa00640 1 -- 172.21.15.50:0/571612572 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40ab600 con 0x7f2fdc0a7120 2024-01-30T08:08:48.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fdaa00640 1 -- 172.21.15.50:0/571612572 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc40a7050 con 0x7f2fdc0a7120 2024-01-30T08:08:48.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fdaa00640 1 -- 172.21.15.50:0/571612572 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40ab960 con 0x7f2fdc0a7120 2024-01-30T08:08:48.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fe2a00640 1 -- 172.21.15.50:0/571612572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc0a7120 msgr2=0x7f2fdc1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/571612572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1584a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097c0 tx=0x7f2fc401c480 comp rx=0 tx=0).stop 2024-01-30T08:08:48.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fe2a00640 1 -- 172.21.15.50:0/571612572 shutdown_connections 2024-01-30T08:08:48.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/571612572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1584a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fe2a00640 1 -- 172.21.15.50:0/571612572 >> 172.21.15.50:0/571612572 conn(0x7f2fdc0c4830 msgr2=0x7f2fdc0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:48.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fe2a00640 1 -- 172.21.15.50:0/571612572 shutdown_connections 2024-01-30T08:08:48.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.192+0000 7f2fe2a00640 1 -- 172.21.15.50:0/571612572 wait complete. 2024-01-30T08:08:48.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 Processor -- start 2024-01-30T08:08:48.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 -- start start 2024-01-30T08:08:48.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fdc06de40 0x7f2fdc155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc06e220 0x7f2fdc14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc155310 con 0x7f2fdc0a7120 2024-01-30T08:08:48.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1edc60 con 0x7f2fdc06e220 2024-01-30T08:08:48.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc143d40 con 0x7f2fdc06de40 2024-01-30T08:08:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1ee080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36614/0 (socket says 172.21.15.50:36614) 2024-01-30T08:08:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 -- 172.21.15.50:0/1796034495 learned_addr learned my addr 172.21.15.50:0/1796034495 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fdb400640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc06e220 0x7f2fdc14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fdbe00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fdc06de40 0x7f2fdc155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 -- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fdc06de40 msgr2=0x7f2fdc155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fdc06de40 0x7f2fdc155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 -- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc06e220 msgr2=0x7f2fdc14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc06e220 0x7f2fdc14bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 -- 172.21.15.50:0/1796034495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4009420 con 0x7f2fdc0a7120 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe0a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1ee080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001f90 tx=0x7f2fd400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fd3e00640 1 -- 172.21.15.50:0/1796034495 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4012400 con 0x7f2fdc0a7120 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fd3e00640 1 -- 172.21.15.50:0/1796034495 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd4012560 con 0x7f2fdc0a7120 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc143f50 con 0x7f2fdc0a7120 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fd3e00640 1 -- 172.21.15.50:0/1796034495 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40128d0 con 0x7f2fdc0a7120 2024-01-30T08:08:48.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.196+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc144510 con 0x7f2fdc0a7120 2024-01-30T08:08:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.200+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc1edda0 con 0x7f2fdc0a7120 2024-01-30T08:08:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.200+0000 7f2fd3e00640 1 -- 172.21.15.50:0/1796034495 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2fd4007070 con 0x7f2fdc0a7120 2024-01-30T08:08:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.200+0000 7f2fd3e00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2fb4066500 0x7f2fb40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.200+0000 7f2fd3e00640 1 -- 172.21.15.50:0/1796034495 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fd4084130 con 0x7f2fdc0a7120 2024-01-30T08:08:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.200+0000 7f2fdbe00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2fb4066500 0x7f2fb40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.200+0000 7f2fdbe00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2fb4066500 0x7f2fb40689c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc007fd0 tx=0x7f2fcc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.204+0000 7f2fd3e00640 1 -- 172.21.15.50:0/1796034495 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2fdc1edda0 con 0x7f2fdc0a7120 2024-01-30T08:08:48.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.368+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fdc0c7b40 con 0x7f2fdc0a7120 2024-01-30T08:08:48.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fd3e00640 1 -- 172.21.15.50:0/1796034495 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f2fdc0c7b40 con 0x7f2fdc0a7120 2024-01-30T08:08:48.372 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:48.372 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2fb4066500 msgr2=0x7f2fb40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2fb4066500 0x7f2fb40689c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc007fd0 tx=0x7f2fcc009040 comp rx=0 tx=0).stop 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc0a7120 msgr2=0x7f2fdc1ee080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1ee080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001f90 tx=0x7f2fd400a430 comp rx=0 tx=0).stop 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 shutdown_connections 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fdc06e220 0x7f2fdc14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2fb4066500 0x7f2fb40689c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc0a7120 0x7f2fdc1ee080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 --2- 172.21.15.50:0/1796034495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fdc06de40 0x7f2fdc155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 >> 172.21.15.50:0/1796034495 conn(0x7f2fdc0c4830 msgr2=0x7f2fdc06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 shutdown_connections 2024-01-30T08:08:48.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.372+0000 7f2fe2a00640 1 -- 172.21.15.50:0/1796034495 wait complete. 2024-01-30T08:08:48.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:08:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.548+0000 7fd14ac00640 1 Processor -- start 2024-01-30T08:08:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.548+0000 7fd14ac00640 1 -- start start 2024-01-30T08:08:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd14ac00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406de40 0x7fd1440a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd14ac00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd14406e220 0x7fd144157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd14ac00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440c7b40 con 0x7fd1441582d0 2024-01-30T08:08:48.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd14ac00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1440a7770 con 0x7fd14406e220 2024-01-30T08:08:48.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd14ac00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd144155310 con 0x7fd14406de40 2024-01-30T08:08:48.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd143e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406de40 0x7fd1440a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd143400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd14406e220 0x7fd144157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd148c00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd1441582d0 0x7fd14406f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:44858/0 (socket says 172.21.15.50:44858) 2024-01-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd148c00640 1 -- 172.21.15.50:0/2347880118 learned_addr learned my addr 172.21.15.50:0/2347880118 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd142a00640 1 -- 172.21.15.50:0/2347880118 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248028054 0 0) 0x7fd13c0014a0 con 0x7fd1441582d0 2024-01-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd143400640 1 -- 172.21.15.50:0/2347880118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406de40 msgr2=0x7fd1440a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd143400640 1 --2- 172.21.15.50:0/2347880118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406de40 0x7fd1440a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd143400640 1 -- 172.21.15.50:0/2347880118 >> v1:172.21.15.125:6789/0 conn(0x7fd1441582d0 legacy=0x7fd14406f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.552+0000 7fd143400640 1 -- 172.21.15.50:0/2347880118 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd144155730 con 0x7fd14406e220 2024-01-30T08:08:48.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd143400640 1 --2- 172.21.15.50:0/2347880118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14406e220 0x7fd144157d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0097c0 tx=0x7fd12c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18c97956435534f server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd142a00640 1 -- 172.21.15.50:0/2347880118 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0ab600 con 0x7fd14406e220 2024-01-30T08:08:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd142a00640 1 -- 172.21.15.50:0/2347880118 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0a7050 con 0x7fd14406e220 2024-01-30T08:08:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd142a00640 1 -- 172.21.15.50:0/2347880118 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0ab980 con 0x7fd14406e220 2024-01-30T08:08:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 -- 172.21.15.50:0/2347880118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14406e220 msgr2=0x7fd144157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 --2- 172.21.15.50:0/2347880118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14406e220 0x7fd144157d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0097c0 tx=0x7fd12c01c480 comp rx=0 tx=0).stop 2024-01-30T08:08:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 -- 172.21.15.50:0/2347880118 shutdown_connections 2024-01-30T08:08:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 --2- 172.21.15.50:0/2347880118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd14406e220 0x7fd144157d90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 --2- 172.21.15.50:0/2347880118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406de40 0x7fd1440a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 -- 172.21.15.50:0/2347880118 >> 172.21.15.50:0/2347880118 conn(0x7fd1440c4830 msgr2=0x7fd1440c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 -- 172.21.15.50:0/2347880118 shutdown_connections 2024-01-30T08:08:48.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 -- 172.21.15.50:0/2347880118 wait complete. 2024-01-30T08:08:48.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 Processor -- start 2024-01-30T08:08:48.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.556+0000 7fd14ac00640 1 -- start start 2024-01-30T08:08:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14406de40 0x7fd1440bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406e220 0x7fd1440ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1441582d0 0x7fd1440c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440abd60 con 0x7fd14406de40 2024-01-30T08:08:48.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440ab4b0 con 0x7fd1441582d0 2024-01-30T08:08:48.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd144151690 con 0x7fd14406e220 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14406de40 0x7fd1440bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14406de40 0x7fd1440bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36622/0 (socket says 172.21.15.50:36622) 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 -- 172.21.15.50:0/895205299 learned_addr learned my addr 172.21.15.50:0/895205299 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd148c00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1441582d0 0x7fd1440c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143400640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406e220 0x7fd1440ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 -- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406e220 msgr2=0x7fd1440ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406e220 0x7fd1440ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 -- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1441582d0 msgr2=0x7fd1440c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1441582d0 0x7fd1440c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 -- 172.21.15.50:0/895205299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009420 con 0x7fd14406de40 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd148c00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1441582d0 0x7fd1440c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd143e00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14406de40 0x7fd1440bfb80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd13400e930 tx=0x7fd13400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd13be00640 1 -- 172.21.15.50:0/895205299 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134009690 con 0x7fd14406de40 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd13be00640 1 -- 172.21.15.50:0/895205299 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13400ca00 con 0x7fd14406de40 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440ab710 con 0x7fd14406de40 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd13be00640 1 -- 172.21.15.50:0/895205299 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400cd70 con 0x7fd14406de40 2024-01-30T08:08:48.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1440add10 con 0x7fd14406de40 2024-01-30T08:08:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.560+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd144074a20 con 0x7fd14406de40 2024-01-30T08:08:48.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.564+0000 7fd13be00640 1 -- 172.21.15.50:0/895205299 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd134013470 con 0x7fd14406de40 2024-01-30T08:08:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.564+0000 7fd13be00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd11c066530 0x7fd11c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.564+0000 7fd13be00640 1 -- 172.21.15.50:0/895205299 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd134084390 con 0x7fd14406de40 2024-01-30T08:08:48.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.564+0000 7fd143400640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd11c066530 0x7fd11c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.564+0000 7fd143400640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd11c066530 0x7fd11c0689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0ad000 tx=0x7fd12c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.568+0000 7fd13be00640 1 -- 172.21.15.50:0/895205299 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd1340514a0 con 0x7fd14406de40 2024-01-30T08:08:48.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd14406ee10 con 0x7fd14406de40 2024-01-30T08:08:48.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd13be00640 1 -- 172.21.15.50:0/895205299 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4934 (secure 0 0 0) 0x7fd134054ac0 con 0x7fd14406de40 2024-01-30T08:08:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:48.762 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:08:46.697772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-30T08:08:48.762 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2024-01-30T08:08:48.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd11c066530 msgr2=0x7fd11c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd11c066530 0x7fd11c0689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0ad000 tx=0x7fd12c008040 comp rx=0 tx=0).stop 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14406de40 msgr2=0x7fd1440bfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14406de40 0x7fd1440bfb80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd13400e930 tx=0x7fd13400edf0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 shutdown_connections 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1441582d0 0x7fd1440c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd11c066530 0x7fd11c0689f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd14406e220 0x7fd1440ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 --2- 172.21.15.50:0/895205299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd14406de40 0x7fd1440bfb80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 >> 172.21.15.50:0/895205299 conn(0x7fd1440c4830 msgr2=0x7fd14406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 shutdown_connections 2024-01-30T08:08:48.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.760+0000 7fd14ac00640 1 -- 172.21.15.50:0/895205299 wait complete. 2024-01-30T08:08:48.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0ca4c00640 1 Processor -- start 2024-01-30T08:08:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0ca4c00640 1 -- start start 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0ca4c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca00c1840 0x7f0ca00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0ca4c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ca00c5650 0x7f0ca00a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0ca4c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00a8cf0 con 0x7f0ca00c4760 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0ca4c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca0072a30 con 0x7f0ca00c1840 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0ca4c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00a8f40 con 0x7f0ca00c5650 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0c9de00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca00c1840 0x7f0ca00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0c9de00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca00c1840 0x7f0ca00a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36634/0 (socket says 172.21.15.50:36634) 2024-01-30T08:08:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0c9de00640 1 -- 172.21.15.50:0/3185989720 learned_addr learned my addr 172.21.15.50:0/3185989720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:48.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0c9de00640 1 -- 172.21.15.50:0/3185989720 >> v2:172.21.15.125:3300/0 conn(0x7f0ca00c5650 msgr2=0x7f0ca00a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:48.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0c9de00640 1 --2- 172.21.15.50:0/3185989720 >> v2:172.21.15.125:3300/0 conn(0x7f0ca00c5650 0x7f0ca00a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0c9de00640 1 -- 172.21.15.50:0/3185989720 >> v1:172.21.15.125:6789/0 conn(0x7f0ca00c4760 legacy=0x7f0ca006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:48.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.924+0000 7f0c9de00640 1 -- 172.21.15.50:0/3185989720 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0072cd0 con 0x7f0ca00c1840 2024-01-30T08:08:48.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0c9de00640 1 --2- 172.21.15.50:0/3185989720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c1840 0x7f0ca00a4d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00729c0 tx=0x7f0c9001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a4ed0a48fc4d18 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0c9ca00640 1 -- 172.21.15.50:0/3185989720 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900ab600 con 0x7f0ca00c1840 2024-01-30T08:08:48.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0c9ca00640 1 -- 172.21.15.50:0/3185989720 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900a7050 con 0x7f0ca00c1840 2024-01-30T08:08:48.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0c9ca00640 1 -- 172.21.15.50:0/3185989720 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900ab980 con 0x7f0ca00c1840 2024-01-30T08:08:48.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3185989720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c1840 msgr2=0x7f0ca00a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3185989720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c1840 0x7f0ca00a4d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00729c0 tx=0x7f0c9001c3a0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3185989720 shutdown_connections 2024-01-30T08:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3185989720 >> v2:172.21.15.125:3300/0 conn(0x7f0ca00c5650 0x7f0ca00a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3185989720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c1840 0x7f0ca00a4d50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3185989720 >> 172.21.15.50:0/3185989720 conn(0x7f0ca00c5b50 msgr2=0x7f0ca00c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3185989720 shutdown_connections 2024-01-30T08:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.928+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3185989720 wait complete. 2024-01-30T08:08:48.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 Processor -- start 2024-01-30T08:08:48.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 -- start start 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ca00c1840 0x7f0ca0152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c4760 0x7f0ca0153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ca00c5650 0x7f0ca00bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca015a410 con 0x7f0ca00c4760 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0153990 con 0x7f0ca00c1840 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01f0eb0 con 0x7f0ca00c5650 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c4760 0x7f0ca0153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c4760 0x7f0ca0153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36642/0 (socket says 172.21.15.50:36642) 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 -- 172.21.15.50:0/3905413506 learned_addr learned my addr 172.21.15.50:0/3905413506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9de00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ca00c1840 0x7f0ca0152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9e800640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ca00c5650 0x7f0ca00bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 -- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ca00c5650 msgr2=0x7f0ca00bef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ca00c5650 0x7f0ca00bef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 -- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ca00c1840 msgr2=0x7f0ca0152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ca00c1840 0x7f0ca0152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 -- 172.21.15.50:0/3905413506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900094d0 con 0x7f0ca00c4760 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c9d400640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c4760 0x7f0ca0153450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800b410 tx=0x7f0c8800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c96000640 1 -- 172.21.15.50:0/3905413506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88011830 con 0x7f0ca00c4760 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c96000640 1 -- 172.21.15.50:0/3905413506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c88011990 con 0x7f0ca00c4760 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0c96000640 1 -- 172.21.15.50:0/3905413506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88011d40 con 0x7f0ca00c4760 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca0153ba0 con 0x7f0ca00c4760 2024-01-30T08:08:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.932+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca01f1150 con 0x7f0ca00c4760 2024-01-30T08:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.936+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0074a20 con 0x7f0ca00c4760 2024-01-30T08:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.936+0000 7f0c96000640 1 -- 172.21.15.50:0/3905413506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0c8801a400 con 0x7f0ca00c4760 2024-01-30T08:08:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.936+0000 7f0c96000640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0c78066500 0x7f0c780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.936+0000 7f0c96000640 1 -- 172.21.15.50:0/3905413506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c88084230 con 0x7f0ca00c4760 2024-01-30T08:08:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.936+0000 7f0c9de00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0c78066500 0x7f0c780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.936+0000 7f0c9de00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0c78066500 0x7f0c780689c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00c03a0 tx=0x7f0c90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:48.940+0000 7f0c96000640 1 -- 172.21.15.50:0/3905413506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0c880511d0 con 0x7f0ca00c4760 2024-01-30T08:08:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.104+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca00c4540 con 0x7f0ca00c4760 2024-01-30T08:08:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.104+0000 7f0c96000640 1 -- 172.21.15.50:0/3905413506 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f0c880547f0 con 0x7f0ca00c4760 2024-01-30T08:08:49.106 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:49.106 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0c78066500 msgr2=0x7f0c780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0c78066500 0x7f0c780689c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00c03a0 tx=0x7f0c90009040 comp rx=0 tx=0).stop 2024-01-30T08:08:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c4760 msgr2=0x7f0ca0153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c4760 0x7f0ca0153450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800b410 tx=0x7f0c8800b8d0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 shutdown_connections 2024-01-30T08:08:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0c78066500 0x7f0c780689c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ca00c5650 0x7f0ca00bef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca00c4760 0x7f0ca0153450 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 --2- 172.21.15.50:0/3905413506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ca00c1840 0x7f0ca0152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 >> 172.21.15.50:0/3905413506 conn(0x7f0ca00c5b50 msgr2=0x7f0ca00a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 shutdown_connections 2024-01-30T08:08:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.108+0000 7f0ca4c00640 1 -- 172.21.15.50:0/3905413506 wait complete. 2024-01-30T08:08:49.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-30T08:08:41.658963+0000', 'modified': '2024-01-30T08:08:46.697772+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/987731246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6835', 'nonce': 987731246}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 987731246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-30T08:08:49.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-30T08:08:49.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-30T08:08:49.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:08:49.584 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:08:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.676+0000 7fca25000640 1 Processor -- start 2024-01-30T08:08:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.676+0000 7fca25000640 1 -- start start 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca25000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2014fbb0 0x7fca200c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca25000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca200a4dc0 0x7fca2006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca25000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fca2006dc50 0x7fca20152660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca25000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca200c0980 con 0x7fca200a4dc0 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca25000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca201564e0 con 0x7fca2006dc50 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca25000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca20156780 con 0x7fca2014fbb0 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca200a4dc0 0x7fca2006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca200a4dc0 0x7fca2006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37842/0 (socket says 172.21.15.50:37842) 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 -- 172.21.15.50:0/4016971699 learned_addr learned my addr 172.21.15.50:0/4016971699 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1e800640 1 --2- 172.21.15.50:0/4016971699 >> v2:172.21.15.125:3300/0 conn(0x7fca2006dc50 0x7fca20152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1de00640 1 --2- 172.21.15.50:0/4016971699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2014fbb0 0x7fca200c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 -- 172.21.15.50:0/4016971699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2014fbb0 msgr2=0x7fca200c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 --2- 172.21.15.50:0/4016971699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2014fbb0 0x7fca200c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 -- 172.21.15.50:0/4016971699 >> v2:172.21.15.125:3300/0 conn(0x7fca2006dc50 msgr2=0x7fca20152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 --2- 172.21.15.50:0/4016971699 >> v2:172.21.15.125:3300/0 conn(0x7fca2006dc50 0x7fca20152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 -- 172.21.15.50:0/4016971699 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200c0610 con 0x7fca200a4dc0 2024-01-30T08:08:49.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1de00640 1 --2- 172.21.15.50:0/4016971699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2014fbb0 0x7fca200c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:49.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1e800640 1 --2- 172.21.15.50:0/4016971699 >> v2:172.21.15.125:3300/0 conn(0x7fca2006dc50 0x7fca20152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1d400640 1 --2- 172.21.15.50:0/4016971699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca2006ab40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca200a53a0 tx=0x7fca0801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac3b46161e065ca server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1ca00640 1 -- 172.21.15.50:0/4016971699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca201533b0 con 0x7fca200a4dc0 2024-01-30T08:08:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1ca00640 1 -- 172.21.15.50:0/4016971699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca080ac630 con 0x7fca200a4dc0 2024-01-30T08:08:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.680+0000 7fca1ca00640 1 -- 172.21.15.50:0/4016971699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080ac9c0 con 0x7fca200a4dc0 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- 172.21.15.50:0/4016971699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 msgr2=0x7fca2006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 --2- 172.21.15.50:0/4016971699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca2006ab40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca200a53a0 tx=0x7fca0801c500 comp rx=0 tx=0).stop 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- 172.21.15.50:0/4016971699 shutdown_connections 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 --2- 172.21.15.50:0/4016971699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca2006ab40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 --2- 172.21.15.50:0/4016971699 >> v2:172.21.15.125:3300/0 conn(0x7fca2006dc50 0x7fca20152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 --2- 172.21.15.50:0/4016971699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2014fbb0 0x7fca200c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- 172.21.15.50:0/4016971699 >> 172.21.15.50:0/4016971699 conn(0x7fca200c5f10 msgr2=0x7fca200c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- 172.21.15.50:0/4016971699 shutdown_connections 2024-01-30T08:08:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- 172.21.15.50:0/4016971699 wait complete. 2024-01-30T08:08:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 Processor -- start 2024-01-30T08:08:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- start start 2024-01-30T08:08:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2006dc50 0x7fca200bf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca20155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca2014fbb0 0x7fca200aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2015bff0 con 0x7fca200a4dc0 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca201ee920 con 0x7fca2014fbb0 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca25000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca201eec00 con 0x7fca2006dc50 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca1d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca20155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca1d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca20155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37852/0 (socket says 172.21.15.50:37852) 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.684+0000 7fca1d400640 1 -- 172.21.15.50:0/2101652378 learned_addr learned my addr 172.21.15.50:0/2101652378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1e800640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca2014fbb0 0x7fca200aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1de00640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2006dc50 0x7fca200bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1d400640 1 -- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2006dc50 msgr2=0x7fca200bf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1d400640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2006dc50 0x7fca200bf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1d400640 1 -- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca2014fbb0 msgr2=0x7fca200aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1d400640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca2014fbb0 0x7fca200aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1d400640 1 -- 172.21.15.50:0/2101652378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080094d0 con 0x7fca200a4dc0 2024-01-30T08:08:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca1d400640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca20155970 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca080af040 tx=0x7fca0801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca16000640 1 -- 172.21.15.50:0/2101652378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080aba10 con 0x7fca200a4dc0 2024-01-30T08:08:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca16000640 1 -- 172.21.15.50:0/2101652378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca080abb90 con 0x7fca200a4dc0 2024-01-30T08:08:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca16000640 1 -- 172.21.15.50:0/2101652378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080b7420 con 0x7fca200a4dc0 2024-01-30T08:08:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca20071fe0 con 0x7fca200a4dc0 2024-01-30T08:08:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca20071240 con 0x7fca200a4dc0 2024-01-30T08:08:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca16000640 1 -- 172.21.15.50:0/2101652378 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fca080b3040 con 0x7fca200a4dc0 2024-01-30T08:08:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.688+0000 7fca16000640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc9f8066500 0x7fc9f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca16000640 1 -- 172.21.15.50:0/2101652378 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca0811ea80 con 0x7fca200a4dc0 2024-01-30T08:08:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 Processor -- start 2024-01-30T08:08:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc9f8066500 0x7fc9f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- start start 2024-01-30T08:08:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc9f8066500 0x7fc9f80689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca201ee850 tx=0x7fca10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x55594619e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x55594619ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461e8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594600a720 con 0x55594619f1f0 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555945ff8d70 con 0x55594619dfb0 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x555945ff62a0 con 0x55594619e8d0 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x55594619e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x55594619e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51242/0 (socket says 172.21.15.50:51242) 2024-01-30T08:08:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 -- 172.21.15.50:0/1120569579 learned_addr learned my addr 172.21.15.50:0/1120569579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1d400640 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x55594619ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 -- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 msgr2=0x55594619ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x55594619ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 -- 172.21.15.50:0/1120569579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 msgr2=0x5559461e8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461e8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 -- 172.21.15.50:0/1120569579 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555945ce8890 con 0x55594619dfb0 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1e800640 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca1de00640 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x55594619e390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca1000f990 tx=0x7fca10012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48bfb18e9f468fe9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca0ea00640 1 -- 172.21.15.50:0/1120569579 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10014be0 con 0x55594619dfb0 2024-01-30T08:08:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca0ea00640 1 -- 172.21.15.50:0/1120569579 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10019070 con 0x55594619dfb0 2024-01-30T08:08:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca0ea00640 1 -- 172.21.15.50:0/1120569579 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10020440 con 0x55594619dfb0 2024-01-30T08:08:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 msgr2=0x55594619e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x55594619e390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca1000f990 tx=0x7fca10012000 comp rx=0 tx=0).stop 2024-01-30T08:08:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- 172.21.15.50:0/1120569579 shutdown_connections 2024-01-30T08:08:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x55594619ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 --2- 172.21.15.50:0/1120569579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x55594619e390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- 172.21.15.50:0/1120569579 >> 172.21.15.50:0/1120569579 conn(0x5559461dc270 msgr2=0x5559461de660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- 172.21.15.50:0/1120569579 shutdown_connections 2024-01-30T08:08:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.692+0000 7fca28574000 1 -- 172.21.15.50:0/1120569579 wait complete. 2024-01-30T08:08:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 -- start start 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 Processor -- start 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619f1f0 0x5559461a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555945ff1b90 con 0x55594619dfb0 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555945fae4c0 con 0x55594619f1f0 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x555945face10 con 0x55594619e8d0 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 10 client.0 _ll_register_callbacks cb 0x555945fa7be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-30T08:08:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37868/0 (socket says 172.21.15.50:37868) 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 -- 172.21.15.50:0/485749037 learned_addr learned my addr 172.21.15.50:0/485749037 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1e800640 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619f1f0 0x5559461a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1d400640 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 -- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 msgr2=0x5559461a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461a3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 -- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619f1f0 msgr2=0x5559461a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619f1f0 0x5559461a4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 -- 172.21.15.50:0/485749037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca18009ce0 con 0x55594619dfb0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca1de00640 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461a6bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x555945f8e990 tx=0x7fca10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15b9ca105c1d9d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca07400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca07400640 1 -- 172.21.15.50:0/485749037 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10020850 con 0x55594619dfb0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca07400640 1 -- 172.21.15.50:0/485749037 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca100209b0 con 0x55594619dfb0 2024-01-30T08:08:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555945f77e30 con 0x55594619dfb0 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca07400640 1 -- 172.21.15.50:0/485749037 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca10020b70 con 0x55594619dfb0 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 10 client.4404 fetch_fsmap learned FSMap version 7 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7fca1000e040 con 0x55594619dfb0 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca07400640 1 -- 172.21.15.50:0/485749037 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555945f77e30 con 0x55594619dfb0 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca07400640 1 -- 172.21.15.50:0/485749037 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fca10020cd0 con 0x55594619dfb0 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 10 client.4404 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 20 client.4404 populate_metadata read hostname 'smithi050' 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x5559461daef0 0x5559461db2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 4 client.4404 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.696+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 --> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55594601ebd0 con 0x5559461daef0 2024-01-30T08:08:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca1d400640 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x5559461daef0 0x5559461db2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca1d400640 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x5559461daef0 0x5559461db2d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eaf6e94244d5c26 server_cookie=79610eccc0a2f302 in_seq=0 out_seq=0 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca07400640 10 client.4404 ms_handle_connect on v2:172.21.15.125:6835/987731246 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca07400640 1 -- 172.21.15.50:0/485749037 <== mds.0 v2:172.21.15.125:6835/987731246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55594601ebd0 con 0x5559461daef0 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca07400640 10 client.4404 handle_command_reply: tid=0 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 client.4404 shutdown 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 msgr2=0x5559461a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461a6bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x555945f8e990 tx=0x7fca10004740 comp rx=0 tx=0).stop 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 shutdown_connections 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x5559461daef0 0x5559461db2d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619f1f0 0x5559461a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 --2- 172.21.15.50:0/485749037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461a6bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca07400640 0 client.4404 ms_handle_reset on v2:172.21.15.125:6835/987731246 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 >> 172.21.15.50:0/485749037 conn(0x5559461dc270 msgr2=0x55594619d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 shutdown_connections 2024-01-30T08:08:49.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 1 -- 172.21.15.50:0/485749037 wait complete. 2024-01-30T08:08:49.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.700+0000 7fca28574000 20 client.4404 trim_cache size 0 max 16384 2024-01-30T08:08:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 Processor -- start 2024-01-30T08:08:49.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 -- start start 2024-01-30T08:08:49.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619e8d0 0x5559461a2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619f1f0 0x5559461a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555945ca9940 con 0x55594619dfb0 2024-01-30T08:08:49.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555945ff97c0 con 0x55594619e8d0 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x555945f742f0 con 0x55594619f1f0 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37880/0 (socket says 172.21.15.50:37880) 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1de00640 1 -- 172.21.15.50:0/112225131 learned_addr learned my addr 172.21.15.50:0/112225131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1d400640 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619e8d0 0x5559461a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1e800640 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619f1f0 0x5559461a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1de00640 1 -- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619f1f0 msgr2=0x5559461a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1de00640 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619f1f0 0x5559461a2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.716+0000 7fca1de00640 1 -- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619e8d0 msgr2=0x5559461a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1de00640 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619e8d0 0x5559461a2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1de00640 1 -- 172.21.15.50:0/112225131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555945fb1b80 con 0x55594619dfb0 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1d400640 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619e8d0 0x5559461a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1de00640 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461d9fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca1000d4f0 tx=0x7fca1002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639b3b50ba3b052f server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca0e000640 1 -- 172.21.15.50:0/112225131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10033770 con 0x55594619dfb0 2024-01-30T08:08:49.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca0e000640 1 -- 172.21.15.50:0/112225131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10019040 con 0x55594619dfb0 2024-01-30T08:08:49.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca0e000640 1 -- 172.21.15.50:0/112225131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10033ad0 con 0x55594619dfb0 2024-01-30T08:08:49.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- 172.21.15.50:0/112225131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 msgr2=0x5559461d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461d9fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca1000d4f0 tx=0x7fca1002c000 comp rx=0 tx=0).stop 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- 172.21.15.50:0/112225131 shutdown_connections 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619e8d0 0x5559461a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619f1f0 0x5559461a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 --2- 172.21.15.50:0/112225131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619dfb0 0x5559461d9fb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- 172.21.15.50:0/112225131 >> 172.21.15.50:0/112225131 conn(0x5559461dc270 msgr2=0x5559461d98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- 172.21.15.50:0/112225131 shutdown_connections 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- 172.21.15.50:0/112225131 wait complete. 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- start start 2024-01-30T08:08:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 Processor -- start 2024-01-30T08:08:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x5559461f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461f5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555945ff0a20 con 0x55594619f1f0 2024-01-30T08:08:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555945febe90 con 0x55594619dfb0 2024-01-30T08:08:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x555945ff5b90 con 0x55594619e8d0 2024-01-30T08:08:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca28574000 10 client.0 _ll_register_callbacks cb 0x555946186470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1de00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x5559461f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1d400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37890/0 (socket says 172.21.15.50:37890) 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.720+0000 7fca1e800640 1 -- 172.21.15.50:0/3615109232 learned_addr learned my addr 172.21.15.50:0/3615109232 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1e800640 1 -- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 msgr2=0x5559461f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1e800640 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1e800640 1 -- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 msgr2=0x5559461f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1e800640 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x5559461f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1e800640 1 -- 172.21.15.50:0/3615109232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1000d040 con 0x55594619f1f0 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1de00640 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x5559461f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1d400640 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1e800640 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461f5910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca18004690 tx=0x7fca18004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f89cbdb213f81e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 1 -- 172.21.15.50:0/3615109232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18016d10 con 0x55594619f1f0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555945fa5640 con 0x55594619f1f0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 1 -- 172.21.15.50:0/3615109232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca18016e70 con 0x55594619f1f0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 1 -- 172.21.15.50:0/3615109232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca18020470 con 0x55594619f1f0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 10 client.4410 fetch_fsmap learned FSMap version 7 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555945f97bd0 con 0x55594619f1f0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 1 -- 172.21.15.50:0/3615109232 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555945fa5640 con 0x55594619f1f0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 1 -- 172.21.15.50:0/3615109232 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fca18014040 con 0x55594619f1f0 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 10 client.4410 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 20 client.4410 populate_metadata read hostname 'smithi050' 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x555946248a30 0x55594624ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 4 client.4410 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-30T08:08:49.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 --> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555945feaa20 con 0x555946248a30 2024-01-30T08:08:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1de00640 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x555946248a30 0x55594624ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca1de00640 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x555946248a30 0x55594624ae20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf8c51524c301ebb server_cookie=db446fa466ece474 in_seq=0 out_seq=0 2024-01-30T08:08:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 10 client.4410 ms_handle_connect on v2:172.21.15.125:6835/987731246 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 1 -- 172.21.15.50:0/3615109232 <== mds.0 v2:172.21.15.125:6835/987731246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x555945feaa20 con 0x555946248a30 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 10 client.4410 handle_command_reply: tid=0 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 client.4410 shutdown 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 msgr2=0x5559461f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461f5910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca18004690 tx=0x7fca18004780 comp rx=0 tx=0).stop 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 shutdown_connections 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55594619f1f0 0x5559461f5910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55594619e8d0 0x5559461f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x555946248a30 0x55594624ae20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 --2- 172.21.15.50:0/3615109232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55594619dfb0 0x5559461f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca07400640 0 client.4410 ms_handle_reset on v2:172.21.15.125:6835/987731246 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 >> 172.21.15.50:0/3615109232 conn(0x5559461dc270 msgr2=0x5559461a2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 shutdown_connections 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 1 -- 172.21.15.50:0/3615109232 wait complete. 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.724+0000 7fca28574000 20 client.4410 trim_cache size 0 max 16384 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "d5419c7a-21ba-491f-86e9-4d6001549d1c", 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4267, 2024-01-30T08:08:49.731 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 7.4581358350000002, 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 7, 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 25, 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.53514326 2024-01-30T08:08:49.732 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc9f8066500 msgr2=0x7fc9f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc9f8066500 0x7fc9f80689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca201ee850 tx=0x7fca10008040 comp rx=0 tx=0).stop 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 msgr2=0x7fca20155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca20155970 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca080af040 tx=0x7fca0801ad40 comp rx=0 tx=0).stop 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 shutdown_connections 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fca2014fbb0 0x7fca200aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc9f8066500 0x7fc9f80689c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca200a4dc0 0x7fca20155970 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 --2- 172.21.15.50:0/2101652378 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fca2006dc50 0x7fca200bf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 >> 172.21.15.50:0/2101652378 conn(0x7fca200c5f10 msgr2=0x7fca200c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 shutdown_connections 2024-01-30T08:08:49.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.728+0000 7fca25000640 1 -- 172.21.15.50:0/2101652378 wait complete. 2024-01-30T08:08:49.747 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-30T08:08:49.747 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:49.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-30T08:08:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b43600640 1 Processor -- start 2024-01-30T08:08:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b43600640 1 -- start start 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b43600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b3c0c5650 0x7f4b3c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b43600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c4760 0x7f4b3c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b43600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c0a8cf0 con 0x7f4b3c0c1840 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b43600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3c072a30 con 0x7f4b3c0c5650 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b43600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0a8f40 con 0x7f4b3c0c4760 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b3be00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b3c0c5650 0x7f4b3c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b3be00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b3c0c5650 0x7f4b3c06cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37902/0 (socket says 172.21.15.50:37902) 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b3be00640 1 -- 172.21.15.50:0/1035180317 learned_addr learned my addr 172.21.15.50:0/1035180317 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b41600640 1 --2- 172.21.15.50:0/1035180317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c4760 0x7f4b3c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b3be00640 1 -- 172.21.15.50:0/1035180317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c4760 msgr2=0x7f4b3c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b3be00640 1 --2- 172.21.15.50:0/1035180317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c4760 0x7f4b3c06d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b3be00640 1 -- 172.21.15.50:0/1035180317 >> v1:172.21.15.125:6789/0 conn(0x7f4b3c0c1840 legacy=0x7f4b3c0a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.888+0000 7f4b3be00640 1 -- 172.21.15.50:0/1035180317 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c072cd0 con 0x7f4b3c0c5650 2024-01-30T08:08:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b3be00640 1 --2- 172.21.15.50:0/1035180317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c06cf00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009870 tx=0x7f4b2401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39508600c614754 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b3b400640 1 -- 172.21.15.50:0/1035180317 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240aa430 con 0x7f4b3c0c5650 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b3b400640 1 -- 172.21.15.50:0/1035180317 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b240aa590 con 0x7f4b3c0c5650 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b3b400640 1 -- 172.21.15.50:0/1035180317 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240aa920 con 0x7f4b3c0c5650 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 -- 172.21.15.50:0/1035180317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 msgr2=0x7f4b3c06cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 --2- 172.21.15.50:0/1035180317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c06cf00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009870 tx=0x7f4b2401c4b0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 -- 172.21.15.50:0/1035180317 shutdown_connections 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 --2- 172.21.15.50:0/1035180317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c4760 0x7f4b3c06d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 --2- 172.21.15.50:0/1035180317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c06cf00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 -- 172.21.15.50:0/1035180317 >> 172.21.15.50:0/1035180317 conn(0x7f4b3c0c5b50 msgr2=0x7f4b3c0c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 -- 172.21.15.50:0/1035180317 shutdown_connections 2024-01-30T08:08:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.892+0000 7f4b43600640 1 -- 172.21.15.50:0/1035180317 wait complete. 2024-01-30T08:08:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 Processor -- start 2024-01-30T08:08:49.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 -- start start 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c1840 0x7f4b3c0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b3c0c4760 0x7f4b3c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c0bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c1f1470 con 0x7f4b3c0c5650 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c1599d0 con 0x7f4b3c0c4760 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0c1100 con 0x7f4b3c0c1840 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c0bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c0bef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37904/0 (socket says 172.21.15.50:37904) 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 -- 172.21.15.50:0/649943538 learned_addr learned my addr 172.21.15.50:0/649943538 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b40c00640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c1840 0x7f4b3c0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b3be00640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b3c0c4760 0x7f4b3c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 -- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c1840 msgr2=0x7f4b3c0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c1840 0x7f4b3c0c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 -- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b3c0c4760 msgr2=0x7f4b3c0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b3c0c4760 0x7f4b3c0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:49.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 -- 172.21.15.50:0/649943538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240094d0 con 0x7f4b3c0c5650 2024-01-30T08:08:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b41600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c0bef00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009d30 tx=0x7f4b3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b38c00640 1 -- 172.21.15.50:0/649943538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b34009ba0 con 0x7f4b3c0c5650 2024-01-30T08:08:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b38c00640 1 -- 172.21.15.50:0/649943538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3400f040 con 0x7f4b3c0c5650 2024-01-30T08:08:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b38c00640 1 -- 172.21.15.50:0/649943538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b340146c0 con 0x7f4b3c0c5650 2024-01-30T08:08:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c1f1190 con 0x7f4b3c0c5650 2024-01-30T08:08:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c156080 con 0x7f4b3c0c5650 2024-01-30T08:08:49.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.896+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c159b60 con 0x7f4b3c0c5650 2024-01-30T08:08:49.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.900+0000 7f4b38c00640 1 -- 172.21.15.50:0/649943538 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4b34014820 con 0x7f4b3c0c5650 2024-01-30T08:08:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.900+0000 7f4b38c00640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4b14066500 0x7f4b140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.900+0000 7f4b38c00640 1 -- 172.21.15.50:0/649943538 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b34084b90 con 0x7f4b3c0c5650 2024-01-30T08:08:49.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.900+0000 7f4b40c00640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4b14066500 0x7f4b140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.900+0000 7f4b40c00640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4b14066500 0x7f4b140689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c001770 tx=0x7f4b2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:49.904+0000 7f4b38c00640 1 -- 172.21.15.50:0/649943538 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4b34051be0 con 0x7f4b3c0c5650 2024-01-30T08:08:50.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.096+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b3c074a20 con 0x7f4b3c0c5650 2024-01-30T08:08:50.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.096+0000 7f4b38c00640 1 -- 172.21.15.50:0/649943538 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4b34018020 con 0x7f4b3c0c5650 2024-01-30T08:08:50.101 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-30T08:08:50.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4b14066500 msgr2=0x7f4b140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:50.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4b14066500 0x7f4b140689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c001770 tx=0x7f4b2c009040 comp rx=0 tx=0).stop 2024-01-30T08:08:50.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 msgr2=0x7f4b3c0bef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:50.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c0bef00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009d30 tx=0x7f4b3400c490 comp rx=0 tx=0).stop 2024-01-30T08:08:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 shutdown_connections 2024-01-30T08:08:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b3c0c4760 0x7f4b3c0a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4b14066500 0x7f4b140689c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b3c0c5650 0x7f4b3c0bef00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 --2- 172.21.15.50:0/649943538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b3c0c1840 0x7f4b3c0c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 >> 172.21.15.50:0/649943538 conn(0x7f4b3c0c5b50 msgr2=0x7f4b3c0a7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:50.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 shutdown_connections 2024-01-30T08:08:50.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:50.100+0000 7f4b43600640 1 -- 172.21.15.50:0/649943538 wait complete. 2024-01-30T08:08:50.122 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-30T08:08:50.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-30T08:08:50.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-01-30T08:08:50.122 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-30T08:08:50.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:50.122 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-30T08:08:50.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-30T08:08:50.123 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-30T08:08:50.123 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-30T08:08:50.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.123 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-01-30T08:08:50.132 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-30T08:08:50.132 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:08:50.133 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42480sec preferred_lft 42480sec 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:08:50.134 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-01-30T08:08:50.135 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-30T08:08:50.135 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:71:66:23:2b brd ff:ff:ff:ff:ff:ff 2024-01-30T08:08:50.135 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-30T08:08:50.135 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:08:50.135 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-30T08:08:50.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.136 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:08:50.136 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:08:50.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-01-30T08:08:50.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-01-30T08:08:50.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-01-30T08:08:50.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-30T08:08:50.136 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:08:50.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.248 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-30T08:08:50.266 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-01-30T08:08:50.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.269 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-01-30T08:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-01-30T08:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-30T08:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-30T08:08:50.339 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-30T08:08:50.340 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-30T08:08:50.340 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-30T08:08:50.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.340 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:08:50.340 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:08:50.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-30T08:08:50.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-30T08:08:50.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-30T08:08:50.341 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:08:50.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.429 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-01-30T08:08:50.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.439 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-01-30T08:08:50.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.496 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:08:50.496 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:08:50.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:08:50.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-30T08:08:50.496 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:08:50.579 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-30T08:08:50.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-30T08:08:50.580 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:08:50.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:50.742 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:08:50.742 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:08:50.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-01-30T08:08:50.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-01-30T08:08:50.742 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:08:50.782 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-30T08:08:50.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:08:50.783 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:50.849 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-30T08:08:50.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:08:50.849 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:50.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-01-30T08:08:50.960 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-01-30T08:08:51.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-01-30T08:08:51.013 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-01-30T08:08:51.013 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-01-30T08:08:51.013 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-01-30T08:08:51.013 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-01-30T08:08:51.013 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-01-30T08:08:51.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/lock 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/fs/nfsd 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysusers.service 2024-01-30T08:08:51.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/rpc_pipefs 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:08:51.015 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:08:51.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:51.016 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-01-30T08:08:51.068 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-30T08:08:51.068 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-30T08:08:51.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-01-30T08:08:51.135 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-01-30T08:08:51.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/run/lock 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-01-30T08:08:51.190 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-01-30T08:08:51.191 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-01-30T08:08:51.191 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-01-30T08:08:51.191 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/fs/nfsd 2024-01-30T08:08:51.191 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-01-30T08:08:51.191 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-01-30T08:08:51.192 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysusers.service 2024-01-30T08:08:51.192 INFO:teuthology.orchestra.run.smithi050.stdout:/run/rpc_pipefs 2024-01-30T08:08:51.192 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-01-30T08:08:51.192 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-01-30T08:08:51.192 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2024-01-30T08:08:51.192 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2024-01-30T08:08:51.193 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2024-01-30T08:08:51.193 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2024-01-30T08:08:51.193 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-01-30T08:08:51.193 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:08:51.193 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:08:51.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:51.194 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-01-30T08:08:51.222 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2024-01-30T08:08:51.220+0000 7f48f4649580 -1 init, newargv = 0x55c0a65f0480 newargc=15 2024-01-30T08:08:51.222 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[31396]: starting ceph client 2024-01-30T08:08:51.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[31396]: starting fuse 2024-01-30T08:08:52.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-01-30T08:08:52.356 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-01-30T08:08:52.414 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-01-30T08:08:52.414 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-01-30T08:08:52.414 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/run/lock 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-01-30T08:08:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/fs/nfsd 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysusers.service 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/run/rpc_pipefs 2024-01-30T08:08:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:08:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:52.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:52.418 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-01-30T08:08:52.469 INFO:teuthology.orchestra.run.smithi050.stdout:43 2024-01-30T08:08:52.469 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-30T08:08:52.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2024-01-30T08:08:52.469 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2024-01-30T08:08:52.469 DEBUG:teuthology.orchestra.run.smithi050:> import re 2024-01-30T08:08:52.469 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-01-30T08:08:52.469 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-30T08:08:52.470 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2024-01-30T08:08:52.471 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2024-01-30T08:08:52.471 DEBUG:teuthology.orchestra.run.smithi050:> return f 2024-01-30T08:08:52.471 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-30T08:08:52.471 DEBUG:teuthology.orchestra.run.smithi050:> 2024-01-30T08:08:52.471 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2024-01-30T08:08:52.471 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-01-30T08:08:52.603 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.31396.asok 2024-01-30T08:08:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-30T08:08:52.616 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31396.asok 2024-01-30T08:08:52.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:52.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31396.asok status 2024-01-30T08:08:52.793 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:08:52.793 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2024-01-30T08:08:52.793 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-30T08:08:52.793 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-30T08:08:52.793 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2024-01-30T08:08:52.793 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "31396", 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4422, 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4422 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-01-30T08:08:52.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2063675802 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2063675802 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4422 172.21.15.50:0/2063675802", 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "172.21.15.50:0/2063675802", 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 7, 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2024-01-30T08:08:52.795 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2024-01-30T08:08:52.796 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2024-01-30T08:08:52.796 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2024-01-30T08:08:52.796 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:08:52.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:52.809 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2024-01-30T08:08:52.809 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:52.818 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2024-01-30T08:08:52.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:52.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:52.819 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:52.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:52.880 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-30T08:08:52.958 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2024-01-30T08:08:52.958 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-30T08:08:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:52.959 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:52.959 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:08:53.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:53.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e3400640 1 Processor -- start 2024-01-30T08:08:53.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e3400640 1 -- start start 2024-01-30T08:08:53.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e3400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc06f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e3400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f43dc0ab270 0x7f43dc1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e3400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc0c2540 con 0x7f43dc06f8c0 2024-01-30T08:08:53.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e3400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc14e570 con 0x7f43dc0ab270 2024-01-30T08:08:53.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e3400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc154110 con 0x7f43dc14e190 2024-01-30T08:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e0a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43e1e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f43dc0ab270 0x7f43dc1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43dbe00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f43dc06f8c0 0x7f43dc150be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:49202/0 (socket says 172.21.15.50:49202) 2024-01-30T08:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.196+0000 7f43dbe00640 1 -- 172.21.15.50:0/577302936 learned_addr learned my addr 172.21.15.50:0/577302936 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43e0a00640 1 -- 172.21.15.50:0/577302936 >> v2:172.21.15.125:3300/0 conn(0x7f43dc0ab270 msgr2=0x7f43dc1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43e0a00640 1 --2- 172.21.15.50:0/577302936 >> v2:172.21.15.125:3300/0 conn(0x7f43dc0ab270 0x7f43dc1512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43e0a00640 1 -- 172.21.15.50:0/577302936 >> v1:172.21.15.125:6789/0 conn(0x7f43dc06f8c0 legacy=0x7f43dc150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43e0a00640 1 -- 172.21.15.50:0/577302936 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc1543f0 con 0x7f43dc14e190 2024-01-30T08:08:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43e0a00640 1 --2- 172.21.15.50:0/577302936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc06f380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0097c0 tx=0x7f43cc01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f0f83bc4b0bd0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43db400640 1 -- 172.21.15.50:0/577302936 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0ab600 con 0x7f43dc14e190 2024-01-30T08:08:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43db400640 1 -- 172.21.15.50:0/577302936 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc0a7050 con 0x7f43dc14e190 2024-01-30T08:08:53.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.200+0000 7f43db400640 1 -- 172.21.15.50:0/577302936 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0ab980 con 0x7f43dc14e190 2024-01-30T08:08:53.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- 172.21.15.50:0/577302936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 msgr2=0x7f43dc06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 --2- 172.21.15.50:0/577302936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc06f380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0097c0 tx=0x7f43cc01c330 comp rx=0 tx=0).stop 2024-01-30T08:08:53.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- 172.21.15.50:0/577302936 shutdown_connections 2024-01-30T08:08:53.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 --2- 172.21.15.50:0/577302936 >> v2:172.21.15.125:3300/0 conn(0x7f43dc0ab270 0x7f43dc1512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 --2- 172.21.15.50:0/577302936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc06f380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- 172.21.15.50:0/577302936 >> 172.21.15.50:0/577302936 conn(0x7f43dc0c74a0 msgr2=0x7f43dc0c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- 172.21.15.50:0/577302936 shutdown_connections 2024-01-30T08:08:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- 172.21.15.50:0/577302936 wait complete. 2024-01-30T08:08:53.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 Processor -- start 2024-01-30T08:08:53.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- start start 2024-01-30T08:08:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43dc06f8c0 0x7f43dc150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43dc0ab270 0x7f43dc14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc15e620 con 0x7f43dc06f8c0 2024-01-30T08:08:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc146720 con 0x7f43dc0ab270 2024-01-30T08:08:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e3400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc146a00 con 0x7f43dc14e190 2024-01-30T08:08:53.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43dc06f8c0 0x7f43dc150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43dc06f8c0 0x7f43dc150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37918/0 (socket says 172.21.15.50:37918) 2024-01-30T08:08:53.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 -- 172.21.15.50:0/3112150493 learned_addr learned my addr 172.21.15.50:0/3112150493 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:53.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e1e00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43dbe00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43dc0ab270 0x7f43dc14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 -- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 msgr2=0x7f43dc14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 -- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43dc0ab270 msgr2=0x7f43dc14d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43dc0ab270 0x7f43dc14d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e0a00640 1 -- 172.21.15.50:0/3112150493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009420 con 0x7f43dc06f8c0 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43e1e00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.204+0000 7f43dbe00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43dc0ab270 0x7f43dc14d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43e0a00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43dc06f8c0 0x7f43dc150ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0ae040 tx=0x7f43cc01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43d8c00640 1 -- 172.21.15.50:0/3112150493 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0b7450 con 0x7f43dc06f8c0 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43d8c00640 1 -- 172.21.15.50:0/3112150493 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc0b75b0 con 0x7f43dc06f8c0 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc1edc20 con 0x7f43dc06f8c0 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43d8c00640 1 -- 172.21.15.50:0/3112150493 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0b7960 con 0x7f43dc06f8c0 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc14fd40 con 0x7f43dc06f8c0 2024-01-30T08:08:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc074ba0 con 0x7f43dc06f8c0 2024-01-30T08:08:53.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43d8c00640 1 -- 172.21.15.50:0/3112150493 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f43cc0b7ac0 con 0x7f43dc06f8c0 2024-01-30T08:08:53.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43d8c00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f43b4066500 0x7f43b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.208+0000 7f43d8c00640 1 -- 172.21.15.50:0/3112150493 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43cc11eae0 con 0x7f43dc06f8c0 2024-01-30T08:08:53.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.212+0000 7f43dbe00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f43b4066500 0x7f43b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.212+0000 7f43dbe00640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f43b4066500 0x7f43b40689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43c4007fd0 tx=0x7f43c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.212+0000 7f43d8c00640 1 -- 172.21.15.50:0/3112150493 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f43cc0ebb20 con 0x7f43dc06f8c0 2024-01-30T08:08:53.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.376+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43dc0c2050 con 0x7f43dc06f8c0 2024-01-30T08:08:53.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.376+0000 7f43d8c00640 1 -- 172.21.15.50:0/3112150493 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f43cc0b0090 con 0x7f43dc06f8c0 2024-01-30T08:08:53.378 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:53.379 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.376+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f43b4066500 msgr2=0x7f43b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.376+0000 7f43e3400640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f43b4066500 0x7f43b40689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43c4007fd0 tx=0x7f43c4009040 comp rx=0 tx=0).stop 2024-01-30T08:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.376+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43dc06f8c0 msgr2=0x7f43dc150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.376+0000 7f43e3400640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43dc06f8c0 0x7f43dc150ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0ae040 tx=0x7f43cc01ab70 comp rx=0 tx=0).stop 2024-01-30T08:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 shutdown_connections 2024-01-30T08:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43dc0ab270 0x7f43dc14d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f43b4066500 0x7f43b40689c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f43dc14e190 0x7f43dc14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 --2- 172.21.15.50:0/3112150493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43dc06f8c0 0x7f43dc150ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 >> 172.21.15.50:0/3112150493 conn(0x7f43dc0c74a0 msgr2=0x7f43dc0c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 shutdown_connections 2024-01-30T08:08:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.380+0000 7f43e3400640 1 -- 172.21.15.50:0/3112150493 wait complete. 2024-01-30T08:08:53.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:08:53.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:08:53.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d6c00640 1 Processor -- start 2024-01-30T08:08:53.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d6c00640 1 -- start start 2024-01-30T08:08:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d6c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d6c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d0158b70 con 0x7f35d00c1200 2024-01-30T08:08:53.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d6c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00c8cf0 con 0x7f35d0155500 2024-01-30T08:08:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d6c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0157f60 con 0x7f35d006f240 2024-01-30T08:08:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d4c00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f35d00c1200 0x7f35d00c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34716/0 (socket says 172.21.15.50:34716) 2024-01-30T08:08:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d4c00640 1 -- 172.21.15.50:0/2724667135 learned_addr learned my addr 172.21.15.50:0/2724667135 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cf400640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185759355 0 0) 0x7f35d0158b70 con 0x7f35d00c1200 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b0003530 con 0x7f35d00c1200 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2036009854 0 0) 0x7f35b0003530 con 0x7f35d00c1200 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 msgr2=0x7f35d006f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 >> v1:172.21.15.125:6789/0 conn(0x7f35d0155500 legacy=0x7f35d00c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0158240 con 0x7f35d00c1200 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f35c8001a00 con 0x7f35d00c1200 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 >> v1:172.21.15.50:6789/0 conn(0x7f35d00c1200 legacy=0x7f35d00c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35b00039b0 0x7f35b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b0004d10 0x7f35b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0157f60 con 0x7f35b0004d10 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b000bb50 con 0x7f35b00039b0 2024-01-30T08:08:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b000bd10 con 0x7f35d006f240 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35d4c00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b0004d10 0x7f35b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cf400640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.544+0000 7f35cfe00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35b00039b0 0x7f35b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cf400640 1 -- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35b00039b0 msgr2=0x7f35b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cf400640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35b00039b0 0x7f35b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cf400640 1 -- 172.21.15.50:0/2724667135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b0004d10 msgr2=0x7f35b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cf400640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b0004d10 0x7f35b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cf400640 1 -- 172.21.15.50:0/2724667135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0003530 con 0x7f35d006f240 2024-01-30T08:08:53.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35d4c00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b0004d10 0x7f35b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cf400640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35b00047d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009ae0 tx=0x7f35b801ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b26589f786f64c39 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b80a5680 con 0x7f35d006f240 2024-01-30T08:08:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b80a57e0 con 0x7f35d006f240 2024-01-30T08:08:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.548+0000 7f35cea00640 1 -- 172.21.15.50:0/2724667135 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b80a5b90 con 0x7f35d006f240 2024-01-30T08:08:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 msgr2=0x7f35b00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 --2- 172.21.15.50:0/2724667135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35b00047d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009ae0 tx=0x7f35b801ca90 comp rx=0 tx=0).stop 2024-01-30T08:08:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d4c00640 1 -- 172.21.15.50:0/2724667135 reap_dead start 2024-01-30T08:08:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- 172.21.15.50:0/2724667135 shutdown_connections 2024-01-30T08:08:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- 172.21.15.50:0/2724667135 >> 172.21.15.50:0/2724667135 conn(0x7f35d00727c0 msgr2=0x7f35d006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- 172.21.15.50:0/2724667135 shutdown_connections 2024-01-30T08:08:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- 172.21.15.50:0/2724667135 wait complete. 2024-01-30T08:08:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 Processor -- start 2024-01-30T08:08:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- start start 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35d01537b0 0x7f35d00a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d00a6d20 0x7f35d00a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d01eaba0 con 0x7f35d00a6d20 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00999e0 con 0x7f35d01537b0 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d6c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00c8810 con 0x7f35d006f240 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d00a6d20 0x7f35d00a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d00a6d20 0x7f35d00a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37942/0 (socket says 172.21.15.50:37942) 2024-01-30T08:08:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.552+0000 7f35d4c00640 1 -- 172.21.15.50:0/4090274421 learned_addr learned my addr 172.21.15.50:0/4090274421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35cf400640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35d01537b0 0x7f35d00a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35cfe00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d4c00640 1 -- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 msgr2=0x7f35d006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d4c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d4c00640 1 -- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35d01537b0 msgr2=0x7f35d00a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d4c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35d01537b0 0x7f35d00a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d4c00640 1 -- 172.21.15.50:0/4090274421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d01ea600 con 0x7f35d00a6d20 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35cfe00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d4c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d00a6d20 0x7f35d00a98b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35d006f070 tx=0x7f35c800af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35c7e00640 1 -- 172.21.15.50:0/4090274421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8007860 con 0x7f35d00a6d20 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35c7e00640 1 -- 172.21.15.50:0/4090274421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c80079c0 con 0x7f35d00a6d20 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35c7e00640 1 -- 172.21.15.50:0/4090274421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8013610 con 0x7f35d00a6d20 2024-01-30T08:08:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d0099bf0 con 0x7f35d00a6d20 2024-01-30T08:08:53.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d006d040 con 0x7f35d00a6d20 2024-01-30T08:08:53.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d00c8980 con 0x7f35d00a6d20 2024-01-30T08:08:53.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.556+0000 7f35c7e00640 1 -- 172.21.15.50:0/4090274421 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f35c8013770 con 0x7f35d00a6d20 2024-01-30T08:08:53.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.560+0000 7f35c7e00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35a8066530 0x7f35a80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.560+0000 7f35c7e00640 1 -- 172.21.15.50:0/4090274421 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35c80846f0 con 0x7f35d00a6d20 2024-01-30T08:08:53.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.560+0000 7f35cfe00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35a8066530 0x7f35a80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.560+0000 7f35cfe00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35a8066530 0x7f35a80689f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35c0007990 tx=0x7f35c0007920 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.564+0000 7f35c7e00640 1 -- 172.21.15.50:0/4090274421 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f35c8051600 con 0x7f35d00a6d20 2024-01-30T08:08:53.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.724+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35d0074a20 con 0x7f35d00a6d20 2024-01-30T08:08:53.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.724+0000 7f35c7e00640 1 -- 172.21.15.50:0/4090274421 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35c8054c20 con 0x7f35d00a6d20 2024-01-30T08:08:53.727 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:08:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35a8066530 msgr2=0x7f35a80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35a8066530 0x7f35a80689f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35c0007990 tx=0x7f35c0007920 comp rx=0 tx=0).stop 2024-01-30T08:08:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d00a6d20 msgr2=0x7f35d00a98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d00a6d20 0x7f35d00a98b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35d006f070 tx=0x7f35c800af80 comp rx=0 tx=0).stop 2024-01-30T08:08:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 shutdown_connections 2024-01-30T08:08:53.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35d01537b0 0x7f35d00a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35a8066530 0x7f35a80689f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d00a6d20 0x7f35d00a98b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 --2- 172.21.15.50:0/4090274421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35d006f240 0x7f35d006cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 >> 172.21.15.50:0/4090274421 conn(0x7f35d00727c0 msgr2=0x7f35d00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 shutdown_connections 2024-01-30T08:08:53.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.728+0000 7f35d6c00640 1 -- 172.21.15.50:0/4090274421 wait complete. 2024-01-30T08:08:53.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:08:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a59000640 1 Processor -- start 2024-01-30T08:08:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a59000640 1 -- start start 2024-01-30T08:08:53.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a59000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a540a4da0 0x7f1a54153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a59000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540c54e0 con 0x7f1a540c04b0 2024-01-30T08:08:53.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a59000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a54152bf0 con 0x7f1a5414fbf0 2024-01-30T08:08:53.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a59000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a54072d90 con 0x7f1a540a4da0 2024-01-30T08:08:53.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a52800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1a540c04b0 0x7f1a5406ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34732/0 (socket says 172.21.15.50:34732) 2024-01-30T08:08:53.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a52800640 1 -- 172.21.15.50:0/2966636674 learned_addr learned my addr 172.21.15.50:0/2966636674 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a51400640 1 --2- 172.21.15.50:0/2966636674 >> v2:172.21.15.125:3300/0 conn(0x7f1a540a4da0 0x7f1a54153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471323401 0 0) 0x7f1a540c54e0 con 0x7f1a540c04b0 2024-01-30T08:08:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a34003530 con 0x7f1a540c04b0 2024-01-30T08:08:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4247111784 0 0) 0x7f1a34003530 con 0x7f1a540c04b0 2024-01-30T08:08:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 >> v2:172.21.15.125:3300/0 conn(0x7f1a540a4da0 msgr2=0x7f1a54153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 --2- 172.21.15.50:0/2966636674 >> v2:172.21.15.125:3300/0 conn(0x7f1a540a4da0 0x7f1a54153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 >> v1:172.21.15.125:6789/0 conn(0x7f1a5414fbf0 legacy=0x7f1a540c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a541525e0 con 0x7f1a540c04b0 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f1a4c001a20 con 0x7f1a540c04b0 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 >> v1:172.21.15.50:6789/0 conn(0x7f1a540c04b0 legacy=0x7f1a5406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a34003980 0x7f1a34003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a340047d0 0x7f1a34004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a34005190 0x7f1a3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54072d90 con 0x7f1a340047d0 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3400c130 con 0x7f1a34005190 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3400c2f0 con 0x7f1a34003980 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a51400640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a340047d0 0x7f1a34004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a51e00640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a34003980 0x7f1a34003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.892+0000 7f1a52800640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a34005190 0x7f1a3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a51400640 1 -- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a34003980 msgr2=0x7f1a34003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a51400640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a34003980 0x7f1a34003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a51400640 1 -- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a34005190 msgr2=0x7f1a3400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a51400640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a34005190 0x7f1a3400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a51400640 1 -- 172.21.15.50:0/2966636674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34003530 con 0x7f1a340047d0 2024-01-30T08:08:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a52800640 1 -- 172.21.15.50:0/2966636674 reap_dead start 2024-01-30T08:08:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a51400640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a340047d0 0x7f1a34004c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009ae0 tx=0x7f1a3c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e335e53441ec1bd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0a6430 con 0x7f1a340047d0 2024-01-30T08:08:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0a6590 con 0x7f1a340047d0 2024-01-30T08:08:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a50a00640 1 -- 172.21.15.50:0/2966636674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0a6940 con 0x7f1a340047d0 2024-01-30T08:08:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a59000640 1 -- 172.21.15.50:0/2966636674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a340047d0 msgr2=0x7f1a34004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a59000640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a340047d0 0x7f1a34004c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009ae0 tx=0x7f1a3c01ca50 comp rx=0 tx=0).stop 2024-01-30T08:08:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a59000640 1 -- 172.21.15.50:0/2966636674 shutdown_connections 2024-01-30T08:08:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a59000640 1 --2- 172.21.15.50:0/2966636674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a340047d0 0x7f1a34004c50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.896+0000 7f1a59000640 1 -- 172.21.15.50:0/2966636674 >> 172.21.15.50:0/2966636674 conn(0x7f1a540c5b30 msgr2=0x7f1a540c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 -- 172.21.15.50:0/2966636674 shutdown_connections 2024-01-30T08:08:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 -- 172.21.15.50:0/2966636674 wait complete. 2024-01-30T08:08:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 Processor -- start 2024-01-30T08:08:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 -- start start 2024-01-30T08:08:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a340047d0 0x7f1a540bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a54145480 0x7f1a541ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a541489d0 0x7f1a540aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540aabb0 con 0x7f1a54145480 2024-01-30T08:08:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540a9cf0 con 0x7f1a541489d0 2024-01-30T08:08:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a59000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540bf440 con 0x7f1a340047d0 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a54145480 0x7f1a541ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a54145480 0x7f1a541ee9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37970/0 (socket says 172.21.15.50:37970) 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 -- 172.21.15.50:0/1297368968 learned_addr learned my addr 172.21.15.50:0/1297368968 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a52800640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a541489d0 0x7f1a540aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51e00640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a340047d0 0x7f1a540bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 -- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a340047d0 msgr2=0x7f1a540bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a340047d0 0x7f1a540bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 -- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a541489d0 msgr2=0x7f1a540aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a541489d0 0x7f1a540aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 -- 172.21.15.50:0/1297368968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540bf720 con 0x7f1a54145480 2024-01-30T08:08:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a52800640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a541489d0 0x7f1a540aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:08:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.900+0000 7f1a51400640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a54145480 0x7f1a541ee9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009ae0 tx=0x7f1a3c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a4a000640 1 -- 172.21.15.50:0/1297368968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00f000 con 0x7f1a54145480 2024-01-30T08:08:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a4a000640 1 -- 172.21.15.50:0/1297368968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0b9440 con 0x7f1a54145480 2024-01-30T08:08:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a540a96a0 con 0x7f1a54145480 2024-01-30T08:08:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a4a000640 1 -- 172.21.15.50:0/1297368968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0b97d0 con 0x7f1a54145480 2024-01-30T08:08:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a541eeee0 con 0x7f1a54145480 2024-01-30T08:08:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a540a9e60 con 0x7f1a54145480 2024-01-30T08:08:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a4a000640 1 -- 172.21.15.50:0/1297368968 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1a3c0c2440 con 0x7f1a54145480 2024-01-30T08:08:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a4a000640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a2c066530 0x7f1a2c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a4a000640 1 -- 172.21.15.50:0/1297368968 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a3c11e290 con 0x7f1a54145480 2024-01-30T08:08:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.904+0000 7f1a51e00640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a2c066530 0x7f1a2c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.908+0000 7f1a51e00640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a2c066530 0x7f1a2c0689f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a44000c10 tx=0x7f1a44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:53.908+0000 7f1a4a000640 1 -- 172.21.15.50:0/1297368968 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1a3c0eb2d0 con 0x7f1a54145480 2024-01-30T08:08:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a54074a20 con 0x7f1a54145480 2024-01-30T08:08:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a4a000640 1 -- 172.21.15.50:0/1297368968 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a3c0ee8f0 con 0x7f1a54145480 2024-01-30T08:08:54.073 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a2c066530 msgr2=0x7f1a2c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a2c066530 0x7f1a2c0689f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a44000c10 tx=0x7f1a44009040 comp rx=0 tx=0).stop 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a54145480 msgr2=0x7f1a541ee9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a54145480 0x7f1a541ee9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009ae0 tx=0x7f1a3c0197f0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 shutdown_connections 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a541489d0 0x7f1a540aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a2c066530 0x7f1a2c0689f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a54145480 0x7f1a541ee9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 --2- 172.21.15.50:0/1297368968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a340047d0 0x7f1a540bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 >> 172.21.15.50:0/1297368968 conn(0x7f1a540c5b30 msgr2=0x7f1a5414e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:54.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 shutdown_connections 2024-01-30T08:08:54.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.072+0000 7f1a59000640 1 -- 172.21.15.50:0/1297368968 wait complete. 2024-01-30T08:08:54.096 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:08:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.236+0000 7fe5bfa00640 1 Processor -- start 2024-01-30T08:08:54.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5bfa00640 1 -- start start 2024-01-30T08:08:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5bfa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5b806f240 0x7fe5b806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5bfa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b80c1200 0x7fe5b80c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5bfa00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b8158b70 con 0x7fe5b8155500 2024-01-30T08:08:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5bfa00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80c8cf0 con 0x7fe5b806f240 2024-01-30T08:08:54.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5bfa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8157f60 con 0x7fe5b80c1200 2024-01-30T08:08:54.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5b7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5b806f240 0x7fe5b806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5b7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5b806f240 0x7fe5b806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37982/0 (socket says 172.21.15.50:37982) 2024-01-30T08:08:54.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5b7e00640 1 -- 172.21.15.50:0/3055125244 learned_addr learned my addr 172.21.15.50:0/3055125244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:54.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5bda00640 1 --2- 172.21.15.50:0/3055125244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b80c1200 0x7fe5b80c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5b7e00640 1 -- 172.21.15.50:0/3055125244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b80c1200 msgr2=0x7fe5b80c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:54.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5b7e00640 1 --2- 172.21.15.50:0/3055125244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b80c1200 0x7fe5b80c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5b7e00640 1 -- 172.21.15.50:0/3055125244 >> v1:172.21.15.125:6789/0 conn(0x7fe5b8155500 legacy=0x7fe5b80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.240+0000 7fe5b7e00640 1 -- 172.21.15.50:0/3055125244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8158240 con 0x7fe5b806f240 2024-01-30T08:08:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5b7e00640 1 --2- 172.21.15.50:0/3055125244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b806f6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009870 tx=0x7fe5a001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8908fa4734ad05a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5b7400640 1 -- 172.21.15.50:0/3055125244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00ab5f0 con 0x7fe5b806f240 2024-01-30T08:08:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5b7400640 1 -- 172.21.15.50:0/3055125244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a00ab750 con 0x7fe5b806f240 2024-01-30T08:08:54.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5b7400640 1 -- 172.21.15.50:0/3055125244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00abae0 con 0x7fe5b806f240 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 -- 172.21.15.50:0/3055125244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 msgr2=0x7fe5b806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/3055125244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b806f6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009870 tx=0x7fe5a001c3f0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 -- 172.21.15.50:0/3055125244 shutdown_connections 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/3055125244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b80c1200 0x7fe5b80c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/3055125244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b806f6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 -- 172.21.15.50:0/3055125244 >> 172.21.15.50:0/3055125244 conn(0x7fe5b80727c0 msgr2=0x7fe5b806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 -- 172.21.15.50:0/3055125244 shutdown_connections 2024-01-30T08:08:54.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 -- 172.21.15.50:0/3055125244 wait complete. 2024-01-30T08:08:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.244+0000 7fe5bfa00640 1 Processor -- start 2024-01-30T08:08:54.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 -- start start 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b81ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5b80c1200 0x7fe5b814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b8155500 0x7fe5b80c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81561f0 con 0x7fe5b806f240 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80ac870 con 0x7fe5b80c1200 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8155c30 con 0x7fe5b8155500 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b81ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b81ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37994/0 (socket says 172.21.15.50:37994) 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 -- 172.21.15.50:0/2205768429 learned_addr learned my addr 172.21.15.50:0/2205768429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5b7e00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5b80c1200 0x7fe5b814cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bda00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b8155500 0x7fe5b80c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 -- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b8155500 msgr2=0x7fe5b80c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b8155500 0x7fe5b80c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 -- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5b80c1200 msgr2=0x7fe5b814cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5b80c1200 0x7fe5b814cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 -- 172.21.15.50:0/2205768429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00094d0 con 0x7fe5b806f240 2024-01-30T08:08:54.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bd000640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b81ed7c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c3a0 tx=0x7fe5a800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5b4c00640 1 -- 172.21.15.50:0/2205768429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80052d0 con 0x7fe5b806f240 2024-01-30T08:08:54.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5b4c00640 1 -- 172.21.15.50:0/2205768429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8005430 con 0x7fe5b806f240 2024-01-30T08:08:54.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5b4c00640 1 -- 172.21.15.50:0/2205768429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8007260 con 0x7fe5b806f240 2024-01-30T08:08:54.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b8155f10 con 0x7fe5b806f240 2024-01-30T08:08:54.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b80acd80 con 0x7fe5b806f240 2024-01-30T08:08:54.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.248+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b80acf70 con 0x7fe5b806f240 2024-01-30T08:08:54.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.252+0000 7fe5b4c00640 1 -- 172.21.15.50:0/2205768429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe5a80073c0 con 0x7fe5b806f240 2024-01-30T08:08:54.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.252+0000 7fe5b4c00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe590066500 0x7fe5900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.252+0000 7fe5b4c00640 1 -- 172.21.15.50:0/2205768429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5a8083530 con 0x7fe5b806f240 2024-01-30T08:08:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.252+0000 7fe5b7e00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe590066500 0x7fe5900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.252+0000 7fe5b7e00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe590066500 0x7fe5900689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00af000 tx=0x7fe5a00b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.256+0000 7fe5b4c00640 1 -- 172.21.15.50:0/2205768429 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe5a80504f0 con 0x7fe5b806f240 2024-01-30T08:08:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.416+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5b8074a20 con 0x7fe5b806f240 2024-01-30T08:08:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.416+0000 7fe5b4c00640 1 -- 172.21.15.50:0/2205768429 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5a8053b10 con 0x7fe5b806f240 2024-01-30T08:08:54.420 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:08:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe590066500 msgr2=0x7fe5900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe590066500 0x7fe5900689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00af000 tx=0x7fe5a00b6040 comp rx=0 tx=0).stop 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 msgr2=0x7fe5b81ed7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b81ed7c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c3a0 tx=0x7fe5a800c860 comp rx=0 tx=0).stop 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 shutdown_connections 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5b80c1200 0x7fe5b814cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe590066500 0x7fe5900689c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5b8155500 0x7fe5b80c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 --2- 172.21.15.50:0/2205768429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b806f240 0x7fe5b81ed7c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 >> 172.21.15.50:0/2205768429 conn(0x7fe5b80727c0 msgr2=0x7fe5b806c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 shutdown_connections 2024-01-30T08:08:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.420+0000 7fe5bfa00640 1 -- 172.21.15.50:0/2205768429 wait complete. 2024-01-30T08:08:54.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:08:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.584+0000 7f16e9200640 1 Processor -- start 2024-01-30T08:08:54.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.584+0000 7f16e9200640 1 -- start start 2024-01-30T08:08:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e9200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16e40c7ae0 0x7f16e40c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e9200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e40c8a50 con 0x7f16e40c50d0 2024-01-30T08:08:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e9200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e40c66d0 con 0x7f16e41568a0 2024-01-30T08:08:54.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e9200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e40c7070 con 0x7f16e40c7ae0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16e40c50d0 0x7f16e4156190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34736/0 (socket says 172.21.15.50:34736) 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 -- 172.21.15.50:0/433360210 learned_addr learned my addr 172.21.15.50:0/433360210 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e2800640 1 --2- 172.21.15.50:0/433360210 >> v2:172.21.15.125:3300/0 conn(0x7f16e40c7ae0 0x7f16e40c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286910963 0 0) 0x7f16e40c8a50 con 0x7f16e40c50d0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c4003530 con 0x7f16e40c50d0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526147298 0 0) 0x7f16e40c66d0 con 0x7f16e41568a0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e40c8a50 con 0x7f16e41568a0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1928784520 0 0) 0x7f16c4003530 con 0x7f16e40c50d0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 >> v2:172.21.15.125:3300/0 conn(0x7f16e40c7ae0 msgr2=0x7f16e40c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 --2- 172.21.15.50:0/433360210 >> v2:172.21.15.125:3300/0 conn(0x7f16e40c7ae0 0x7f16e40c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 >> v1:172.21.15.125:6789/0 conn(0x7f16e41568a0 legacy=0x7f16e40c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40c69b0 con 0x7f16e40c50d0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f16d4001680 con 0x7f16e40c50d0 2024-01-30T08:08:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e2800640 1 --2- 172.21.15.50:0/433360210 >> v2:172.21.15.125:3300/0 conn(0x7f16e40c7ae0 0x7f16e40c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 >> v1:172.21.15.50:6789/0 conn(0x7f16e40c50d0 legacy=0x7f16e4156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16c4003b10 0x7f16c4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c40047d0 0x7f16c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c4005190 0x7f16c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40c7070 con 0x7f16c4003b10 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c400c0c0 con 0x7f16c4005190 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c400c280 con 0x7f16c40047d0 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16c4003b10 0x7f16c4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 -- 172.21.15.50:0/433360210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c40047d0 msgr2=0x7f16c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c40047d0 0x7f16c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 -- 172.21.15.50:0/433360210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c4005190 msgr2=0x7f16c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16c4005190 0x7f16c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e1e00640 1 -- 172.21.15.50:0/433360210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4003530 con 0x7f16c4003b10 2024-01-30T08:08:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.588+0000 7f16e2800640 1 -- 172.21.15.50:0/433360210 reap_dead start 2024-01-30T08:08:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e1e00640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16c4003b10 0x7f16c4003f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c160 tx=0x7f16d401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da8b37d069e91dc server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40058e0 con 0x7f16c4003b10 2024-01-30T08:08:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4005a60 con 0x7f16c4003b10 2024-01-30T08:08:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e0a00640 1 -- 172.21.15.50:0/433360210 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4005e50 con 0x7f16c4003b10 2024-01-30T08:08:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 -- 172.21.15.50:0/433360210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16c4003b10 msgr2=0x7f16c4003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16c4003b10 0x7f16c4003f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c160 tx=0x7f16d401cbb0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 -- 172.21.15.50:0/433360210 shutdown_connections 2024-01-30T08:08:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 --2- 172.21.15.50:0/433360210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16c4003b10 0x7f16c4003f10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 -- 172.21.15.50:0/433360210 >> 172.21.15.50:0/433360210 conn(0x7f16e40727c0 msgr2=0x7f16e406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 -- 172.21.15.50:0/433360210 shutdown_connections 2024-01-30T08:08:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 -- 172.21.15.50:0/433360210 wait complete. 2024-01-30T08:08:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.592+0000 7f16e9200640 1 Processor -- start 2024-01-30T08:08:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 -- start start 2024-01-30T08:08:54.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c4003b10 0x7f16e40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e40aa620 0x7f16e414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e414bdb0 0x7f16e414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40c8d30 con 0x7f16e414bdb0 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40a9540 con 0x7f16e40aa620 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40a7f80 con 0x7f16c4003b10 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e414bdb0 0x7f16e414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e414bdb0 0x7f16e414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38026/0 (socket says 172.21.15.50:38026) 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 -- 172.21.15.50:0/1652440207 learned_addr learned my addr 172.21.15.50:0/1652440207 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e1e00640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c4003b10 0x7f16e40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e1400640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e40aa620 0x7f16e414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 -- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c4003b10 msgr2=0x7f16e40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c4003b10 0x7f16e40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 -- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e40aa620 msgr2=0x7f16e414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e40aa620 0x7f16e414b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 -- 172.21.15.50:0/1652440207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4151dc0 con 0x7f16e414bdb0 2024-01-30T08:08:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e2800640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e414bdb0 0x7f16e414b610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16e406f070 tx=0x7f16dc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16da000640 1 -- 172.21.15.50:0/1652440207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc010040 con 0x7f16e414bdb0 2024-01-30T08:08:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16da000640 1 -- 172.21.15.50:0/1652440207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc00bcb0 con 0x7f16e414bdb0 2024-01-30T08:08:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16da000640 1 -- 172.21.15.50:0/1652440207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc003be0 con 0x7f16e414bdb0 2024-01-30T08:08:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e41520a0 con 0x7f16e414bdb0 2024-01-30T08:08:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e40a7c10 con 0x7f16e414bdb0 2024-01-30T08:08:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.596+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e40a7dd0 con 0x7f16e414bdb0 2024-01-30T08:08:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.600+0000 7f16da000640 1 -- 172.21.15.50:0/1652440207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f16dc003d40 con 0x7f16e414bdb0 2024-01-30T08:08:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.600+0000 7f16da000640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f16bc066500 0x7f16bc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.600+0000 7f16da000640 1 -- 172.21.15.50:0/1652440207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16dc083f70 con 0x7f16e414bdb0 2024-01-30T08:08:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.600+0000 7f16e1e00640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f16bc066500 0x7f16bc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.600+0000 7f16e1e00640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f16bc066500 0x7f16bc0689c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16d40aa000 tx=0x7f16d4001a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.604+0000 7f16da000640 1 -- 172.21.15.50:0/1652440207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f16dc050df0 con 0x7f16e414bdb0 2024-01-30T08:08:54.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.760+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f16e40c2450 con 0x7f16e414bdb0 2024-01-30T08:08:54.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.760+0000 7f16da000640 1 -- 172.21.15.50:0/1652440207 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f16dc01b0a0 con 0x7f16e414bdb0 2024-01-30T08:08:54.764 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:08:54.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f16bc066500 msgr2=0x7f16bc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f16bc066500 0x7f16bc0689c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16d40aa000 tx=0x7f16d4001a00 comp rx=0 tx=0).stop 2024-01-30T08:08:54.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e414bdb0 msgr2=0x7f16e414b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e414bdb0 0x7f16e414b610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16e406f070 tx=0x7f16dc00b480 comp rx=0 tx=0).stop 2024-01-30T08:08:54.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 shutdown_connections 2024-01-30T08:08:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16e40aa620 0x7f16e414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f16bc066500 0x7f16bc0689c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e414bdb0 0x7f16e414b610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 --2- 172.21.15.50:0/1652440207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16c4003b10 0x7f16e40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 >> 172.21.15.50:0/1652440207 conn(0x7f16e40727c0 msgr2=0x7f16e406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 shutdown_connections 2024-01-30T08:08:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.764+0000 7f16e9200640 1 -- 172.21.15.50:0/1652440207 wait complete. 2024-01-30T08:08:54.787 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-30T08:08:54.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.928+0000 7fd319200640 1 Processor -- start 2024-01-30T08:08:54.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.928+0000 7fd319200640 1 -- start start 2024-01-30T08:08:54.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.928+0000 7fd319200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3140c5c40 0x7fd3140c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.928+0000 7fd319200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd314157c40 0x7fd3140c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd319200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd314154c10 con 0x7fd314151dc0 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd319200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31406d890 con 0x7fd314157c40 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd319200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd314154690 con 0x7fd3140c5c40 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd314157c40 0x7fd3140c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd314157c40 0x7fd3140c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38032/0 (socket says 172.21.15.50:38032) 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 -- 172.21.15.50:0/41044256 learned_addr learned my addr 172.21.15.50:0/41044256 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd311400640 1 --2- 172.21.15.50:0/41044256 >> v2:172.21.15.125:3300/0 conn(0x7fd3140c5c40 0x7fd3140c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 -- 172.21.15.50:0/41044256 >> v2:172.21.15.125:3300/0 conn(0x7fd3140c5c40 msgr2=0x7fd3140c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 --2- 172.21.15.50:0/41044256 >> v2:172.21.15.125:3300/0 conn(0x7fd3140c5c40 0x7fd3140c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 -- 172.21.15.50:0/41044256 >> v1:172.21.15.125:6789/0 conn(0x7fd314151dc0 legacy=0x7fd3141550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 -- 172.21.15.50:0/41044256 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140c3490 con 0x7fd314157c40 2024-01-30T08:08:54.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd312800640 1 --2- 172.21.15.50:0/41044256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314157c40 0x7fd3140c47d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3140c2440 tx=0x7fd30c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f577b98fb894218d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd310a00640 1 -- 172.21.15.50:0/41044256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0a57c0 con 0x7fd314157c40 2024-01-30T08:08:54.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd310a00640 1 -- 172.21.15.50:0/41044256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c0a5920 con 0x7fd314157c40 2024-01-30T08:08:54.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.932+0000 7fd310a00640 1 -- 172.21.15.50:0/41044256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0a5cb0 con 0x7fd314157c40 2024-01-30T08:08:54.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- 172.21.15.50:0/41044256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314157c40 msgr2=0x7fd3140c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 --2- 172.21.15.50:0/41044256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314157c40 0x7fd3140c47d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3140c2440 tx=0x7fd30c01c900 comp rx=0 tx=0).stop 2024-01-30T08:08:54.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- 172.21.15.50:0/41044256 shutdown_connections 2024-01-30T08:08:54.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 --2- 172.21.15.50:0/41044256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314157c40 0x7fd3140c47d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 --2- 172.21.15.50:0/41044256 >> v2:172.21.15.125:3300/0 conn(0x7fd3140c5c40 0x7fd3140c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- 172.21.15.50:0/41044256 >> 172.21.15.50:0/41044256 conn(0x7fd31406ad40 msgr2=0x7fd3140c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:54.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- 172.21.15.50:0/41044256 shutdown_connections 2024-01-30T08:08:54.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- 172.21.15.50:0/41044256 wait complete. 2024-01-30T08:08:54.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 Processor -- start 2024-01-30T08:08:54.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- start start 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3140c5c40 0x7fd3141486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314151dc0 0x7fd314145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd314157c40 0x7fd314145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140a89f0 con 0x7fd314151dc0 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141504f0 con 0x7fd314157c40 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd319200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd314148cd0 con 0x7fd3140c5c40 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd311400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314151dc0 0x7fd314145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd311400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314151dc0 0x7fd314145660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38038/0 (socket says 172.21.15.50:38038) 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd311400640 1 -- 172.21.15.50:0/1649105925 learned_addr learned my addr 172.21.15.50:0/1649105925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.936+0000 7fd311e00640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3140c5c40 0x7fd3141486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd312800640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd314157c40 0x7fd314145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd311400640 1 -- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3140c5c40 msgr2=0x7fd3141486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd311400640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3140c5c40 0x7fd3141486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd311400640 1 -- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd314157c40 msgr2=0x7fd314145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd311400640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd314157c40 0x7fd314145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd311400640 1 -- 172.21.15.50:0/1649105925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009b30 con 0x7fd314151dc0 2024-01-30T08:08:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd311400640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314151dc0 0x7fd314145660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c7f0 tx=0x7fd2fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd30a000640 1 -- 172.21.15.50:0/1649105925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc004230 con 0x7fd314151dc0 2024-01-30T08:08:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd30a000640 1 -- 172.21.15.50:0/1649105925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc004390 con 0x7fd314151dc0 2024-01-30T08:08:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31414fee0 con 0x7fd314151dc0 2024-01-30T08:08:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd30a000640 1 -- 172.21.15.50:0/1649105925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc003860 con 0x7fd314151dc0 2024-01-30T08:08:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141eda80 con 0x7fd314151dc0 2024-01-30T08:08:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31406cf80 con 0x7fd314151dc0 2024-01-30T08:08:54.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd30a000640 1 -- 172.21.15.50:0/1649105925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd2fc003bd0 con 0x7fd314151dc0 2024-01-30T08:08:54.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.940+0000 7fd30a000640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd2ec066500 0x7fd2ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:54.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.944+0000 7fd30a000640 1 -- 172.21.15.50:0/1649105925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2fc0843a0 con 0x7fd314151dc0 2024-01-30T08:08:54.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.944+0000 7fd311e00640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd2ec066500 0x7fd2ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:54.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.944+0000 7fd311e00640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd2ec066500 0x7fd2ec0689c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3140c6e40 tx=0x7fd304009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:54.944+0000 7fd30a000640 1 -- 172.21.15.50:0/1649105925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd2fc0512b0 con 0x7fd314151dc0 2024-01-30T08:08:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd31404ead0 con 0x7fd314151dc0 2024-01-30T08:08:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd30a000640 1 -- 172.21.15.50:0/1649105925 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd2fc0548d0 con 0x7fd314151dc0 2024-01-30T08:08:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd2ec066500 msgr2=0x7fd2ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd2ec066500 0x7fd2ec0689c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3140c6e40 tx=0x7fd304009040 comp rx=0 tx=0).stop 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314151dc0 msgr2=0x7fd314145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314151dc0 0x7fd314145660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c7f0 tx=0x7fd2fc00ccb0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 shutdown_connections 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd314157c40 0x7fd314145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd2ec066500 0x7fd2ec0689c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd314151dc0 0x7fd314145660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 --2- 172.21.15.50:0/1649105925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3140c5c40 0x7fd3141486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 >> 172.21.15.50:0/1649105925 conn(0x7fd31406ad40 msgr2=0x7fd31415f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 shutdown_connections 2024-01-30T08:08:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.120+0000 7fd319200640 1 -- 172.21.15.50:0/1649105925 wait complete. 2024-01-30T08:08:55.144 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:08:55.144 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:08:55.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:08:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fc200640 1 Processor -- start 2024-01-30T08:08:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fc200640 1 -- start start 2024-01-30T08:08:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fc200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2f41584a0 0x7fa2f406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fc200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40c7b40 con 0x7fa2f40a7120 2024-01-30T08:08:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fc200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f4155730 con 0x7fa2f406de40 2024-01-30T08:08:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fc200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f40a7770 con 0x7fa2f41584a0 2024-01-30T08:08:55.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fa200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2f41584a0 0x7fa2f406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fa200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2f41584a0 0x7fa2f406e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38048/0 (socket says 172.21.15.50:38048) 2024-01-30T08:08:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fa200640 1 -- 172.21.15.50:0/992820950 learned_addr learned my addr 172.21.15.50:0/992820950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2f8e00640 1 --1- 172.21.15.50:0/992820950 >> v1:172.21.15.50:6789/0 conn(0x7fa2f40a7120 0x7fa2f415d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34752/0 (socket says 172.21.15.50:34752) 2024-01-30T08:08:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fa200640 1 -- 172.21.15.50:0/992820950 >> v1:172.21.15.125:6789/0 conn(0x7fa2f406de40 legacy=0x7fa2f4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fa200640 1 -- 172.21.15.50:0/992820950 >> v1:172.21.15.50:6789/0 conn(0x7fa2f40a7120 legacy=0x7fa2f415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2f3e00640 1 -- 172.21.15.50:0/992820950 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673049134 0 0) 0x7fa2dc001120 con 0x7fa2f40a7120 2024-01-30T08:08:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.336+0000 7fa2fa200640 1 -- 172.21.15.50:0/992820950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f406ec20 con 0x7fa2f41584a0 2024-01-30T08:08:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fa200640 1 --2- 172.21.15.50:0/992820950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f406e220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009e50 tx=0x7fa2ec01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d48c7ea958b274 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:55.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2f3e00640 1 -- 172.21.15.50:0/992820950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0a56e0 con 0x7fa2f41584a0 2024-01-30T08:08:55.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2f3e00640 1 -- 172.21.15.50:0/992820950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0a5840 con 0x7fa2f41584a0 2024-01-30T08:08:55.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2f3e00640 1 -- 172.21.15.50:0/992820950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0a5bd0 con 0x7fa2f41584a0 2024-01-30T08:08:55.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fc200640 1 -- 172.21.15.50:0/992820950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 msgr2=0x7fa2f406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fc200640 1 --2- 172.21.15.50:0/992820950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f406e220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009e50 tx=0x7fa2ec01ca10 comp rx=0 tx=0).stop 2024-01-30T08:08:55.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fc200640 1 -- 172.21.15.50:0/992820950 shutdown_connections 2024-01-30T08:08:55.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fc200640 1 --2- 172.21.15.50:0/992820950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f406e220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fc200640 1 -- 172.21.15.50:0/992820950 >> 172.21.15.50:0/992820950 conn(0x7fa2f40c4830 msgr2=0x7fa2f40c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:55.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fc200640 1 -- 172.21.15.50:0/992820950 shutdown_connections 2024-01-30T08:08:55.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.340+0000 7fa2fc200640 1 -- 172.21.15.50:0/992820950 wait complete. 2024-01-30T08:08:55.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 Processor -- start 2024-01-30T08:08:55.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 -- start start 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2f406de40 0x7fa2f414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2f40a7120 0x7fa2f41eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f41edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4155310 con 0x7fa2f41584a0 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40aa190 con 0x7fa2f406de40 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40a7e40 con 0x7fa2f40a7120 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f41edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f41edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38050/0 (socket says 172.21.15.50:38050) 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 -- 172.21.15.50:0/2685805736 learned_addr learned my addr 172.21.15.50:0/2685805736 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:55.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2f9800640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2f406de40 0x7fa2f414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2f8e00640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2f40a7120 0x7fa2f41eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 -- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2f40a7120 msgr2=0x7fa2f41eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2f40a7120 0x7fa2f41eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 -- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2f406de40 msgr2=0x7fa2f414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2f406de40 0x7fa2f414b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 -- 172.21.15.50:0/2685805736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec009b30 con 0x7fa2f41584a0 2024-01-30T08:08:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fa200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f41edf50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0af040 tx=0x7fa2ec0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2f1600640 1 -- 172.21.15.50:0/2685805736 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0b8880 con 0x7fa2f41584a0 2024-01-30T08:08:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2f1600640 1 -- 172.21.15.50:0/2685805736 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0b89e0 con 0x7fa2f41584a0 2024-01-30T08:08:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2f1600640 1 -- 172.21.15.50:0/2685805736 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0b8d90 con 0x7fa2f41584a0 2024-01-30T08:08:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f40a7540 con 0x7fa2f41584a0 2024-01-30T08:08:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f41f1a90 con 0x7fa2f41584a0 2024-01-30T08:08:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.344+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f41ed6f0 con 0x7fa2f41584a0 2024-01-30T08:08:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.348+0000 7fa2f1600640 1 -- 172.21.15.50:0/2685805736 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa2ec0b6440 con 0x7fa2f41584a0 2024-01-30T08:08:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.348+0000 7fa2f1600640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2cc066500 0x7fa2cc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.348+0000 7fa2f1600640 1 -- 172.21.15.50:0/2685805736 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2ec11f8f0 con 0x7fa2f41584a0 2024-01-30T08:08:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.348+0000 7fa2f9800640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2cc066500 0x7fa2cc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.348+0000 7fa2f9800640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2cc066500 0x7fa2cc0689c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40c6b00 tx=0x7fa2e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.352+0000 7fa2f1600640 1 -- 172.21.15.50:0/2685805736 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa2ec0ec9e0 con 0x7fa2f41584a0 2024-01-30T08:08:55.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.516+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2f4074a20 con 0x7fa2f41584a0 2024-01-30T08:08:55.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.516+0000 7fa2f1600640 1 -- 172.21.15.50:0/2685805736 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7fa2ec0f0000 con 0x7fa2f41584a0 2024-01-30T08:08:55.518 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:08:55.518 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:08:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.516+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2cc066500 msgr2=0x7fa2cc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.516+0000 7fa2fc200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2cc066500 0x7fa2cc0689c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40c6b00 tx=0x7fa2e4009040 comp rx=0 tx=0).stop 2024-01-30T08:08:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.516+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 msgr2=0x7fa2f41edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.516+0000 7fa2fc200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f41edf50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0af040 tx=0x7fa2ec0197b0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 shutdown_connections 2024-01-30T08:08:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2cc066500 0x7fa2cc0689c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2f41584a0 0x7fa2f41edf50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2f40a7120 0x7fa2f41eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 --2- 172.21.15.50:0/2685805736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2f406de40 0x7fa2f414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 >> 172.21.15.50:0/2685805736 conn(0x7fa2f40c4830 msgr2=0x7fa2f406bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 shutdown_connections 2024-01-30T08:08:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.520+0000 7fa2fc200640 1 -- 172.21.15.50:0/2685805736 wait complete. 2024-01-30T08:08:55.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:08:55.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:08:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f5420800640 1 Processor -- start 2024-01-30T08:08:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f5420800640 1 -- start start 2024-01-30T08:08:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f5420800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180a4da0 0x7f5418153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f5420800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180c54e0 con 0x7f541814fbf0 2024-01-30T08:08:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f5420800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5418152bf0 con 0x7f54180c04b0 2024-01-30T08:08:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f5420800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5418072d90 con 0x7f54180a4da0 2024-01-30T08:08:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541de00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f541814fbf0 0x7f54180c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34758/0 (socket says 172.21.15.50:34758) 2024-01-30T08:08:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541de00640 1 -- 172.21.15.50:0/1715505248 learned_addr learned my addr 172.21.15.50:0/1715505248 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541d400640 1 --2- 172.21.15.50:0/1715505248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180a4da0 0x7f5418153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541ca00640 1 -- 172.21.15.50:0/1715505248 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464255596 0 0) 0x7f54180c54e0 con 0x7f541814fbf0 2024-01-30T08:08:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541ca00640 1 -- 172.21.15.50:0/1715505248 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f8003530 con 0x7f541814fbf0 2024-01-30T08:08:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541ca00640 1 -- 172.21.15.50:0/1715505248 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193451709 0 0) 0x7f5418152bf0 con 0x7f54180c04b0 2024-01-30T08:08:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541ca00640 1 -- 172.21.15.50:0/1715505248 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54180c54e0 con 0x7f54180c04b0 2024-01-30T08:08:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541d400640 1 -- 172.21.15.50:0/1715505248 >> v1:172.21.15.125:6789/0 conn(0x7f54180c04b0 legacy=0x7f541806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541d400640 1 -- 172.21.15.50:0/1715505248 >> v1:172.21.15.50:6789/0 conn(0x7f541814fbf0 legacy=0x7f54180c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.684+0000 7f541d400640 1 -- 172.21.15.50:0/1715505248 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54181525e0 con 0x7f54180a4da0 2024-01-30T08:08:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f541d400640 1 --2- 172.21.15.50:0/1715505248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180a4da0 0x7f5418153080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54000097f0 tx=0x7f540001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7400922dd2f98a88 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f541ca00640 1 -- 172.21.15.50:0/1715505248 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000ab600 con 0x7f54180a4da0 2024-01-30T08:08:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f541ca00640 1 -- 172.21.15.50:0/1715505248 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54000a7050 con 0x7f54180a4da0 2024-01-30T08:08:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f541ca00640 1 -- 172.21.15.50:0/1715505248 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000ab980 con 0x7f54180a4da0 2024-01-30T08:08:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f5420800640 1 -- 172.21.15.50:0/1715505248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180a4da0 msgr2=0x7f5418153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f5420800640 1 --2- 172.21.15.50:0/1715505248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180a4da0 0x7f5418153080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54000097f0 tx=0x7f540001c430 comp rx=0 tx=0).stop 2024-01-30T08:08:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f5420800640 1 -- 172.21.15.50:0/1715505248 shutdown_connections 2024-01-30T08:08:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f5420800640 1 --2- 172.21.15.50:0/1715505248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180a4da0 0x7f5418153080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f5420800640 1 -- 172.21.15.50:0/1715505248 >> 172.21.15.50:0/1715505248 conn(0x7f54180c5b30 msgr2=0x7f54180c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f5420800640 1 -- 172.21.15.50:0/1715505248 shutdown_connections 2024-01-30T08:08:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.688+0000 7f5420800640 1 -- 172.21.15.50:0/1715505248 wait complete. 2024-01-30T08:08:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 Processor -- start 2024-01-30T08:08:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 -- start start 2024-01-30T08:08:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54180a4da0 0x7f5418072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180c04b0 0x7f54180a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f541814fbf0 0x7f541814d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54181f0e80 con 0x7f541814fbf0 2024-01-30T08:08:55.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180abce0 con 0x7f54180a4da0 2024-01-30T08:08:55.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54181f0240 con 0x7f54180c04b0 2024-01-30T08:08:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f541814fbf0 0x7f541814d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541de00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54180a4da0 0x7f5418072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541d400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180c04b0 0x7f54180a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f541814fbf0 0x7f541814d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38054/0 (socket says 172.21.15.50:38054) 2024-01-30T08:08:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 -- 172.21.15.50:0/1856035264 learned_addr learned my addr 172.21.15.50:0/1856035264 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 -- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180c04b0 msgr2=0x7f54180a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180c04b0 0x7f54180a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 -- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54180a4da0 msgr2=0x7f5418072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54180a4da0 0x7f5418072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 -- 172.21.15.50:0/1856035264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009420 con 0x7f541814fbf0 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f541e800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f541814fbf0 0x7f541814d970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f541000c790 tx=0x7f541000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5416000640 1 -- 172.21.15.50:0/1856035264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541000cea0 con 0x7f541814fbf0 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5416000640 1 -- 172.21.15.50:0/1856035264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410003b80 con 0x7f541814fbf0 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5416000640 1 -- 172.21.15.50:0/1856035264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541000a850 con 0x7f541814fbf0 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54181f04e0 con 0x7f541814fbf0 2024-01-30T08:08:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.692+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54181f0aa0 con 0x7f541814fbf0 2024-01-30T08:08:55.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.696+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54181f0fc0 con 0x7f541814fbf0 2024-01-30T08:08:55.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.696+0000 7f5416000640 1 -- 172.21.15.50:0/1856035264 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f541000a9b0 con 0x7f541814fbf0 2024-01-30T08:08:55.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.696+0000 7f5416000640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f53f0066500 0x7f53f00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:55.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.696+0000 7f5416000640 1 -- 172.21.15.50:0/1856035264 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5410083f40 con 0x7f541814fbf0 2024-01-30T08:08:55.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.696+0000 7f541de00640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f53f0066500 0x7f53f00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:55.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.696+0000 7f541de00640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f53f0066500 0x7f53f00689c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5408007fd0 tx=0x7f5408007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.700+0000 7f5416000640 1 -- 172.21.15.50:0/1856035264 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f54181f0fc0 con 0x7f541814fbf0 2024-01-30T08:08:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.860+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54181f0fc0 con 0x7f541814fbf0 2024-01-30T08:08:55.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.860+0000 7f5416000640 1 -- 172.21.15.50:0/1856035264 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54181f0fc0 con 0x7f541814fbf0 2024-01-30T08:08:55.862 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:08:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.860+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f53f0066500 msgr2=0x7f53f00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.860+0000 7f5420800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f53f0066500 0x7f53f00689c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5408007fd0 tx=0x7f5408007d80 comp rx=0 tx=0).stop 2024-01-30T08:08:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.860+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f541814fbf0 msgr2=0x7f541814d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.860+0000 7f5420800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f541814fbf0 0x7f541814d970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f541000c790 tx=0x7f541000cc50 comp rx=0 tx=0).stop 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 shutdown_connections 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f53f0066500 0x7f53f00689c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f541814fbf0 0x7f541814d970 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54180c04b0 0x7f54180a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 --2- 172.21.15.50:0/1856035264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54180a4da0 0x7f5418072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 >> 172.21.15.50:0/1856035264 conn(0x7f54180c5b30 msgr2=0x7f541815d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 shutdown_connections 2024-01-30T08:08:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:55.864+0000 7f5420800640 1 -- 172.21.15.50:0/1856035264 wait complete. 2024-01-30T08:08:55.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:08:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.024+0000 7fad0ec00640 1 Processor -- start 2024-01-30T08:08:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.024+0000 7fad0ec00640 1 -- start start 2024-01-30T08:08:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad0ec00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad080c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad0ec00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad0806f6a0 0x7fad080c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad0ec00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad08158b70 con 0x7fad0806f240 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad0ec00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0806fb10 con 0x7fad0806f6a0 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad0ec00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad08157f60 con 0x7fad08155500 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad07400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fad0806f240 0x7fad080c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34768/0 (socket says 172.21.15.50:34768) 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad07400640 1 -- 172.21.15.50:0/4205548885 learned_addr learned my addr 172.21.15.50:0/4205548885 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad07e00640 1 --2- 172.21.15.50:0/4205548885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad080c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad0cc00640 1 --2- 172.21.15.50:0/4205548885 >> v2:172.21.15.125:3300/0 conn(0x7fad0806f6a0 0x7fad080c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad06a00640 1 -- 172.21.15.50:0/4205548885 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538946768 0 0) 0x7fad08158b70 con 0x7fad0806f240 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad06a00640 1 -- 172.21.15.50:0/4205548885 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face8003530 con 0x7fad0806f240 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad07e00640 1 -- 172.21.15.50:0/4205548885 >> v2:172.21.15.125:3300/0 conn(0x7fad0806f6a0 msgr2=0x7fad080c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad07e00640 1 --2- 172.21.15.50:0/4205548885 >> v2:172.21.15.125:3300/0 conn(0x7fad0806f6a0 0x7fad080c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad07e00640 1 -- 172.21.15.50:0/4205548885 >> v1:172.21.15.50:6789/0 conn(0x7fad0806f240 legacy=0x7fad080c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.028+0000 7fad07e00640 1 -- 172.21.15.50:0/4205548885 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08158240 con 0x7fad08155500 2024-01-30T08:08:56.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad07e00640 1 --2- 172.21.15.50:0/4205548885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad080c85e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7facf80097c0 tx=0x7facf801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c132be20cff8ed8e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad06a00640 1 -- 172.21.15.50:0/4205548885 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80ab600 con 0x7fad08155500 2024-01-30T08:08:56.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad06a00640 1 -- 172.21.15.50:0/4205548885 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf80a7050 con 0x7fad08155500 2024-01-30T08:08:56.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad06a00640 1 -- 172.21.15.50:0/4205548885 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80ab980 con 0x7fad08155500 2024-01-30T08:08:56.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 -- 172.21.15.50:0/4205548885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 msgr2=0x7fad080c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 --2- 172.21.15.50:0/4205548885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad080c85e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7facf80097c0 tx=0x7facf801c330 comp rx=0 tx=0).stop 2024-01-30T08:08:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 -- 172.21.15.50:0/4205548885 shutdown_connections 2024-01-30T08:08:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 --2- 172.21.15.50:0/4205548885 >> v2:172.21.15.125:3300/0 conn(0x7fad0806f6a0 0x7fad080c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 --2- 172.21.15.50:0/4205548885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad080c85e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 -- 172.21.15.50:0/4205548885 >> 172.21.15.50:0/4205548885 conn(0x7fad080727c0 msgr2=0x7fad0806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 -- 172.21.15.50:0/4205548885 shutdown_connections 2024-01-30T08:08:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.032+0000 7fad0ec00640 1 -- 172.21.15.50:0/4205548885 wait complete. 2024-01-30T08:08:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 Processor -- start 2024-01-30T08:08:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 -- start start 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad0806f240 0x7fad0815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806f6a0 0x7fad0806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad08143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815de40 con 0x7fad0806f6a0 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815e090 con 0x7fad0806f240 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815e640 con 0x7fad08155500 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806f6a0 0x7fad0806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806f6a0 0x7fad0806cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38066/0 (socket says 172.21.15.50:38066) 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 -- 172.21.15.50:0/360138562 learned_addr learned my addr 172.21.15.50:0/360138562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07e00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad0806f240 0x7fad0815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0cc00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad08143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 -- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 msgr2=0x7fad08143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad08143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 -- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad0806f240 msgr2=0x7fad0815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad0806f240 0x7fad0815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 -- 172.21.15.50:0/360138562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009420 con 0x7fad0806f6a0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad07400640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806f6a0 0x7fad0806cfb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7facf000c3c0 tx=0x7facf000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7facffe00640 1 -- 172.21.15.50:0/360138562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0005cf0 con 0x7fad0806f6a0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad081f0dd0 con 0x7fad0806f6a0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7facffe00640 1 -- 172.21.15.50:0/360138562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0005e50 con 0x7fad0806f6a0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7facffe00640 1 -- 172.21.15.50:0/360138562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00072f0 con 0x7fad0806f6a0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad081f02f0 con 0x7fad0806f6a0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.036+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad08074a20 con 0x7fad0806f6a0 2024-01-30T08:08:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.040+0000 7facffe00640 1 -- 172.21.15.50:0/360138562 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7facf0007450 con 0x7fad0806f6a0 2024-01-30T08:08:56.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.040+0000 7facffe00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7face0066500 0x7face00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.040+0000 7facffe00640 1 -- 172.21.15.50:0/360138562 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facf0083740 con 0x7fad0806f6a0 2024-01-30T08:08:56.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.040+0000 7fad07e00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7face0066500 0x7face00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.040+0000 7fad07e00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7face0066500 0x7face00689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facf80ad000 tx=0x7facf80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.044+0000 7facffe00640 1 -- 172.21.15.50:0/360138562 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7facf0050710 con 0x7fad0806f6a0 2024-01-30T08:08:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.204+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad080c8cc0 con 0x7fad0806f6a0 2024-01-30T08:08:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.204+0000 7facffe00640 1 -- 172.21.15.50:0/360138562 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7facf0053d30 con 0x7fad0806f6a0 2024-01-30T08:08:56.208 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:08:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7face0066500 msgr2=0x7face00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7face0066500 0x7face00689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facf80ad000 tx=0x7facf80a6000 comp rx=0 tx=0).stop 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806f6a0 msgr2=0x7fad0806cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806f6a0 0x7fad0806cfb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7facf000c3c0 tx=0x7facf000c880 comp rx=0 tx=0).stop 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 shutdown_connections 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7face0066500 0x7face00689c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad08155500 0x7fad08143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0806f6a0 0x7fad0806cfb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 --2- 172.21.15.50:0/360138562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad0806f240 0x7fad0815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 >> 172.21.15.50:0/360138562 conn(0x7fad080727c0 msgr2=0x7fad080acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 shutdown_connections 2024-01-30T08:08:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.208+0000 7fad0ec00640 1 -- 172.21.15.50:0/360138562 wait complete. 2024-01-30T08:08:56.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c61000640 1 Processor -- start 2024-01-30T08:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c61000640 1 -- start start 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c61000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c5c1568a0 0x7f5c5c0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c61000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c5c0c7ae0 0x7f5c5c0c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c61000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c0c8a50 con 0x7f5c5c0c50d0 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c61000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0c7070 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c61000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0c8d30 con 0x7f5c5c1568a0 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c5a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c5c0c7ae0 0x7f5c5c0c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c5a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c5c0c7ae0 0x7f5c5c0c35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38082/0 (socket says 172.21.15.50:38082) 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c5a800640 1 -- 172.21.15.50:0/3494278677 learned_addr learned my addr 172.21.15.50:0/3494278677 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c59400640 1 --2- 172.21.15.50:0/3494278677 >> v2:172.21.15.125:3300/0 conn(0x7f5c5c1568a0 0x7f5c5c0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c5a800640 1 -- 172.21.15.50:0/3494278677 >> v2:172.21.15.125:3300/0 conn(0x7f5c5c1568a0 msgr2=0x7f5c5c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c5a800640 1 --2- 172.21.15.50:0/3494278677 >> v2:172.21.15.125:3300/0 conn(0x7f5c5c1568a0 0x7f5c5c0c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c5a800640 1 -- 172.21.15.50:0/3494278677 >> v1:172.21.15.125:6789/0 conn(0x7f5c5c0c50d0 legacy=0x7f5c5c156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.372+0000 7f5c5a800640 1 -- 172.21.15.50:0/3494278677 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0c66d0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c5a800640 1 --2- 172.21.15.50:0/3494278677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c0c35f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c06ec50 tx=0x7f5c5401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5aa150dcc07ac5 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c58a00640 1 -- 172.21.15.50:0/3494278677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540a57d0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c58a00640 1 -- 172.21.15.50:0/3494278677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c540a5930 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c58a00640 1 -- 172.21.15.50:0/3494278677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540a5cc0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 -- 172.21.15.50:0/3494278677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 msgr2=0x7f5c5c0c35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 --2- 172.21.15.50:0/3494278677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c0c35f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c06ec50 tx=0x7f5c5401c910 comp rx=0 tx=0).stop 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 -- 172.21.15.50:0/3494278677 shutdown_connections 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 --2- 172.21.15.50:0/3494278677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c0c35f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 --2- 172.21.15.50:0/3494278677 >> v2:172.21.15.125:3300/0 conn(0x7f5c5c1568a0 0x7f5c5c0c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 -- 172.21.15.50:0/3494278677 >> 172.21.15.50:0/3494278677 conn(0x7f5c5c0727c0 msgr2=0x7f5c5c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 -- 172.21.15.50:0/3494278677 shutdown_connections 2024-01-30T08:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.376+0000 7f5c61000640 1 -- 172.21.15.50:0/3494278677 wait complete. 2024-01-30T08:08:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 Processor -- start 2024-01-30T08:08:56.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 -- start start 2024-01-30T08:08:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c5c0c50d0 0x7f5c5c1ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c1458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c5c1568a0 0x7f5c5c145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c144470 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c0acc30 con 0x7f5c5c1568a0 2024-01-30T08:08:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c144190 con 0x7f5c5c0c50d0 2024-01-30T08:08:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c1458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c1458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38092/0 (socket says 172.21.15.50:38092) 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 -- 172.21.15.50:0/562986250 learned_addr learned my addr 172.21.15.50:0/562986250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c5a800640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c5c1568a0 0x7f5c5c145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59e00640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c5c0c50d0 0x7f5c5c1ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 -- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c5c0c50d0 msgr2=0x7f5c5c1ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c5c0c50d0 0x7f5c5c1ee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 -- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c5c1568a0 msgr2=0x7f5c5c145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c5c1568a0 0x7f5c5c145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 -- 172.21.15.50:0/562986250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009b30 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c59400640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c1458f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c44006e90 tx=0x7f5c4400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c52000640 1 -- 172.21.15.50:0/562986250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400b6c0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c52000640 1 -- 172.21.15.50:0/562986250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400b840 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c52000640 1 -- 172.21.15.50:0/562986250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400bbf0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c1ef1e0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.380+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c147870 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.384+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c074a20 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.384+0000 7f5c52000640 1 -- 172.21.15.50:0/562986250 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5c4400bd50 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.384+0000 7f5c52000640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5c34066500 0x7f5c340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.384+0000 7f5c52000640 1 -- 172.21.15.50:0/562986250 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c440845d0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.384+0000 7f5c59e00640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5c34066500 0x7f5c340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.384+0000 7f5c59e00640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5c34066500 0x7f5c340689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c001810 tx=0x7f5c4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.388+0000 7f5c52000640 1 -- 172.21.15.50:0/562986250 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5c44051590 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c5c0ab690 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c52000640 1 -- 172.21.15.50:0/562986250 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c44054bb0 con 0x7f5c5c0c7ae0 2024-01-30T08:08:56.550 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5c34066500 msgr2=0x7f5c340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5c34066500 0x7f5c340689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c001810 tx=0x7f5c4c009040 comp rx=0 tx=0).stop 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 msgr2=0x7f5c5c1458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c1458f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c44006e90 tx=0x7f5c4400dc60 comp rx=0 tx=0).stop 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 shutdown_connections 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c5c1568a0 0x7f5c5c145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5c34066500 0x7f5c340689c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c0c7ae0 0x7f5c5c1458f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 --2- 172.21.15.50:0/562986250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5c5c0c50d0 0x7f5c5c1ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 >> 172.21.15.50:0/562986250 conn(0x7f5c5c0727c0 msgr2=0x7f5c5c154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 shutdown_connections 2024-01-30T08:08:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.548+0000 7f5c61000640 1 -- 172.21.15.50:0/562986250 wait complete. 2024-01-30T08:08:56.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:08:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.712+0000 7efd17400640 1 Processor -- start 2024-01-30T08:08:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.712+0000 7efd17400640 1 -- start start 2024-01-30T08:08:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd17400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd100c50d0 0x7efd10156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd17400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd100c8a50 con 0x7efd100c7ae0 2024-01-30T08:08:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd17400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd100c66d0 con 0x7efd100c5c90 2024-01-30T08:08:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd17400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd100c7070 con 0x7efd100c50d0 2024-01-30T08:08:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd14a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd100c50d0 0x7efd10156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd0fe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efd100c7ae0 0x7efd100c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34784/0 (socket says 172.21.15.50:34784) 2024-01-30T08:08:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd0fe00640 1 -- 172.21.15.50:0/3476162006 learned_addr learned my addr 172.21.15.50:0/3476162006 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd14a00640 1 -- 172.21.15.50:0/3476162006 >> v1:172.21.15.125:6789/0 conn(0x7efd100c5c90 legacy=0x7efd100c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd14a00640 1 -- 172.21.15.50:0/3476162006 >> v1:172.21.15.50:6789/0 conn(0x7efd100c7ae0 legacy=0x7efd100c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.716+0000 7efd14a00640 1 -- 172.21.15.50:0/3476162006 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd100c69b0 con 0x7efd100c50d0 2024-01-30T08:08:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd14a00640 1 --2- 172.21.15.50:0/3476162006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c50d0 0x7efd10156190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd000097c0 tx=0x7efd0001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8963eb41dae326 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd0f400640 1 -- 172.21.15.50:0/3476162006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd000ab600 con 0x7efd100c50d0 2024-01-30T08:08:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd0f400640 1 -- 172.21.15.50:0/3476162006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd000a7050 con 0x7efd100c50d0 2024-01-30T08:08:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd0f400640 1 -- 172.21.15.50:0/3476162006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd000ab980 con 0x7efd100c50d0 2024-01-30T08:08:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 -- 172.21.15.50:0/3476162006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c50d0 msgr2=0x7efd10156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 --2- 172.21.15.50:0/3476162006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c50d0 0x7efd10156190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd000097c0 tx=0x7efd0001c330 comp rx=0 tx=0).stop 2024-01-30T08:08:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 -- 172.21.15.50:0/3476162006 shutdown_connections 2024-01-30T08:08:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 --2- 172.21.15.50:0/3476162006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c50d0 0x7efd10156190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 -- 172.21.15.50:0/3476162006 >> 172.21.15.50:0/3476162006 conn(0x7efd100727c0 msgr2=0x7efd1006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 -- 172.21.15.50:0/3476162006 shutdown_connections 2024-01-30T08:08:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 -- 172.21.15.50:0/3476162006 wait complete. 2024-01-30T08:08:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 Processor -- start 2024-01-30T08:08:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.720+0000 7efd17400640 1 -- start start 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd100c50d0 0x7efd100c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd100c5c90 0x7efd101f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c7ae0 0x7efd100a7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100c8d30 con 0x7efd100c7ae0 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100a9130 con 0x7efd100c50d0 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd100a9410 con 0x7efd100c5c90 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c7ae0 0x7efd100a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c7ae0 0x7efd100a7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38110/0 (socket says 172.21.15.50:38110) 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 -- 172.21.15.50:0/26051326 learned_addr learned my addr 172.21.15.50:0/26051326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd0fe00640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd100c5c90 0x7efd101f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd14a00640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd100c50d0 0x7efd100c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 -- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd100c5c90 msgr2=0x7efd101f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd100c5c90 0x7efd101f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 -- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd100c50d0 msgr2=0x7efd100c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd100c50d0 0x7efd100c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 -- 172.21.15.50:0/26051326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd00009420 con 0x7efd100c7ae0 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd15400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c7ae0 0x7efd100a7930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd0800c7a0 tx=0x7efd0800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd0cc00640 1 -- 172.21.15.50:0/26051326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08003b80 con 0x7efd100c7ae0 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd0cc00640 1 -- 172.21.15.50:0/26051326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd08003ce0 con 0x7efd100c7ae0 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd0cc00640 1 -- 172.21.15.50:0/26051326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0800aa90 con 0x7efd100c7ae0 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1015d610 con 0x7efd100c7ae0 2024-01-30T08:08:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1015dbb0 con 0x7efd100c7ae0 2024-01-30T08:08:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd10067cc0 con 0x7efd100c7ae0 2024-01-30T08:08:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.724+0000 7efd0cc00640 1 -- 172.21.15.50:0/26051326 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7efd0800abf0 con 0x7efd100c7ae0 2024-01-30T08:08:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.728+0000 7efd0cc00640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efce8066500 0x7efce80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.728+0000 7efd0cc00640 1 -- 172.21.15.50:0/26051326 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd08083f00 con 0x7efd100c7ae0 2024-01-30T08:08:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.728+0000 7efd14a00640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efce8066500 0x7efce80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.728+0000 7efd14a00640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efce8066500 0x7efce80689c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd000ad000 tx=0x7efd00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:56.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.732+0000 7efd0cc00640 1 -- 172.21.15.50:0/26051326 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7efd08050f50 con 0x7efd100c7ae0 2024-01-30T08:08:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.888+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efd10074a20 con 0x7efd100c7ae0 2024-01-30T08:08:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.888+0000 7efd0cc00640 1 -- 172.21.15.50:0/26051326 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd08054570 con 0x7efd100c7ae0 2024-01-30T08:08:56.891 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:08:56.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efce8066500 msgr2=0x7efce80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efce8066500 0x7efce80689c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd000ad000 tx=0x7efd00008040 comp rx=0 tx=0).stop 2024-01-30T08:08:56.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c7ae0 msgr2=0x7efd100a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c7ae0 0x7efd100a7930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd0800c7a0 tx=0x7efd0800cc60 comp rx=0 tx=0).stop 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 shutdown_connections 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efce8066500 0x7efce80689c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100c7ae0 0x7efd100a7930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd100c5c90 0x7efd101f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 --2- 172.21.15.50:0/26051326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd100c50d0 0x7efd100c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 >> 172.21.15.50:0/26051326 conn(0x7efd100727c0 msgr2=0x7efd101525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 shutdown_connections 2024-01-30T08:08:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:56.892+0000 7efd17400640 1 -- 172.21.15.50:0/26051326 wait complete. 2024-01-30T08:08:56.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-30T08:08:57.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f561cc00640 1 Processor -- start 2024-01-30T08:08:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f561cc00640 1 -- start start 2024-01-30T08:08:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f561cc00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f561806eae0 0x7f56180c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f561cc00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56180c6830 con 0x7f56181565a0 2024-01-30T08:08:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f561cc00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56180c3260 con 0x7f56180c7750 2024-01-30T08:08:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f561cc00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56180c3540 con 0x7f561806eae0 2024-01-30T08:08:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f5615e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f56181565a0 0x7f56180c6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34792/0 (socket says 172.21.15.50:34792) 2024-01-30T08:08:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.052+0000 7f5615e00640 1 -- 172.21.15.50:0/958202899 learned_addr learned my addr 172.21.15.50:0/958202899 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5616800640 1 --2- 172.21.15.50:0/958202899 >> v2:172.21.15.125:3300/0 conn(0x7f561806eae0 0x7f56180c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357136519 0 0) 0x7f56180c6830 con 0x7f56181565a0 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f8003530 con 0x7f56181565a0 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893824262 0 0) 0x7f56180c3260 con 0x7f56180c7750 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56180c6830 con 0x7f56180c7750 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5616800640 1 -- 172.21.15.50:0/958202899 >> v1:172.21.15.125:6789/0 conn(0x7f56180c7750 legacy=0x7f56180c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3754828469 0 0) 0x7f55f8003530 con 0x7f56181565a0 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5616800640 1 -- 172.21.15.50:0/958202899 >> v1:172.21.15.50:6789/0 conn(0x7f56181565a0 legacy=0x7f56180c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5616800640 1 -- 172.21.15.50:0/958202899 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56180c3820 con 0x7f561806eae0 2024-01-30T08:08:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5616800640 1 --2- 172.21.15.50:0/958202899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f561806eae0 0x7f56180c1fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5610009d90 tx=0x7f561001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba26860585e5b0d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608001680 con 0x7f561806eae0 2024-01-30T08:08:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56100a5540 con 0x7f561806eae0 2024-01-30T08:08:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.056+0000 7f5614a00640 1 -- 172.21.15.50:0/958202899 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100a58d0 con 0x7f561806eae0 2024-01-30T08:08:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- 172.21.15.50:0/958202899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f561806eae0 msgr2=0x7f56180c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 --2- 172.21.15.50:0/958202899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f561806eae0 0x7f56180c1fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5610009d90 tx=0x7f561001c870 comp rx=0 tx=0).stop 2024-01-30T08:08:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- 172.21.15.50:0/958202899 shutdown_connections 2024-01-30T08:08:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 --2- 172.21.15.50:0/958202899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f561806eae0 0x7f56180c1fe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- 172.21.15.50:0/958202899 >> 172.21.15.50:0/958202899 conn(0x7f561806a740 msgr2=0x7f561806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- 172.21.15.50:0/958202899 shutdown_connections 2024-01-30T08:08:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- 172.21.15.50:0/958202899 wait complete. 2024-01-30T08:08:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 Processor -- start 2024-01-30T08:08:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- start start 2024-01-30T08:08:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561806eae0 0x7f56180abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56180c7750 0x7f561814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56181565a0 0x7f561814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56181ee750 con 0x7f561806eae0 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56180bd7a0 con 0x7f56181565a0 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f561cc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5618153c90 con 0x7f56180c7750 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f5615e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561806eae0 0x7f56180abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f5615e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561806eae0 0x7f56180abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38122/0 (socket says 172.21.15.50:38122) 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.060+0000 7f5615e00640 1 -- 172.21.15.50:0/2014066129 learned_addr learned my addr 172.21.15.50:0/2014066129 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5616800640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56181565a0 0x7f561814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5615400640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56180c7750 0x7f561814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5615e00640 1 -- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56180c7750 msgr2=0x7f561814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5615e00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56180c7750 0x7f561814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5615e00640 1 -- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56181565a0 msgr2=0x7f561814cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5615e00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56181565a0 0x7f561814cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5615e00640 1 -- 172.21.15.50:0/2014066129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009a70 con 0x7f561806eae0 2024-01-30T08:08:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f5615e00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561806eae0 0x7f56180abf10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f560800c520 tx=0x7f560800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f560e000640 1 -- 172.21.15.50:0/2014066129 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608005cf0 con 0x7f561806eae0 2024-01-30T08:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f560e000640 1 -- 172.21.15.50:0/2014066129 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608005e50 con 0x7f561806eae0 2024-01-30T08:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f560e000640 1 -- 172.21.15.50:0/2014066129 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608007270 con 0x7f561806eae0 2024-01-30T08:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56181ee940 con 0x7f561806eae0 2024-01-30T08:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56181eec20 con 0x7f561806eae0 2024-01-30T08:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561804ead0 con 0x7f561806eae0 2024-01-30T08:08:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.064+0000 7f560e000640 1 -- 172.21.15.50:0/2014066129 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f56080073f0 con 0x7f561806eae0 2024-01-30T08:08:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.068+0000 7f560e000640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f55f0066500 0x7f55f00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:08:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.068+0000 7f560e000640 1 -- 172.21.15.50:0/2014066129 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56080836e0 con 0x7f561806eae0 2024-01-30T08:08:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.068+0000 7f5615400640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f55f0066500 0x7f55f00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:08:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.068+0000 7f5615400640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f55f0066500 0x7f55f00689c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5618155df0 tx=0x7f5600009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:08:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.072+0000 7f560e000640 1 -- 172.21.15.50:0/2014066129 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5608050730 con 0x7f561806eae0 2024-01-30T08:08:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.244+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f56181550b0 con 0x7f561806eae0 2024-01-30T08:08:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.244+0000 7f560e000640 1 -- 172.21.15.50:0/2014066129 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5608053d50 con 0x7f561806eae0 2024-01-30T08:08:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-01-30T08:08:57.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f55f0066500 msgr2=0x7f55f00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:57.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f55f0066500 0x7f55f00689c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5618155df0 tx=0x7f5600009040 comp rx=0 tx=0).stop 2024-01-30T08:08:57.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561806eae0 msgr2=0x7f56180abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:08:57.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561806eae0 0x7f56180abf10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f560800c520 tx=0x7f560800c9e0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 shutdown_connections 2024-01-30T08:08:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56181565a0 0x7f561814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f55f0066500 0x7f55f00689c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56180c7750 0x7f561814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 --2- 172.21.15.50:0/2014066129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f561806eae0 0x7f56180abf10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:08:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 >> 172.21.15.50:0/2014066129 conn(0x7f561806a740 msgr2=0x7f56180c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:08:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 shutdown_connections 2024-01-30T08:08:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:08:57.248+0000 7f561cc00640 1 -- 172.21.15.50:0/2014066129 wait complete. 2024-01-30T08:08:57.270 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2024-01-30T08:08:57.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:08:57.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-30T08:08:57.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[31396]: fuse finished with error 0 and tester_r 0 2024-01-30T08:08:57.307 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:09:03.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:09:03.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:03.409 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-30T08:09:03.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.619+0000 7f95a6400640 1 Processor -- start 2024-01-30T08:09:03.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.619+0000 7f95a6400640 1 -- start start 2024-01-30T08:09:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f95a6400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95a00c0ee0 0x7f95a01559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f95a6400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a006a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f95a6400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a00c3ed0 con 0x7f95a014fbf0 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f95a6400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a00a5520 con 0x7f95a00c0ee0 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f95a6400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a006bca0 con 0x7f95a00c1de0 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95a00c0ee0 0x7f95a01559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95a00c0ee0 0x7f95a01559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58968/0 (socket says 172.21.15.50:58968) 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 -- 172.21.15.50:0/1525762126 learned_addr learned my addr 172.21.15.50:0/1525762126 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959f400640 1 --1- 172.21.15.50:0/1525762126 >> v1:172.21.15.50:6789/0 conn(0x7f95a014fbf0 0x7f95a00a4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36966/0 (socket says 172.21.15.50:36966) 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959fe00640 1 --2- 172.21.15.50:0/1525762126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a006a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 -- 172.21.15.50:0/1525762126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 msgr2=0x7f95a006a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 --2- 172.21.15.50:0/1525762126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a006a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 -- 172.21.15.50:0/1525762126 >> v1:172.21.15.50:6789/0 conn(0x7f95a014fbf0 legacy=0x7f95a00a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 -- 172.21.15.50:0/1525762126 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a006bef0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.623+0000 7f959ea00640 1 --2- 172.21.15.50:0/1525762126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a01559c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f958801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a4b453d5e52d36 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:03.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f959e000640 1 -- 172.21.15.50:0/1525762126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880ab640 con 0x7f95a00c0ee0 2024-01-30T08:09:03.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f959e000640 1 -- 172.21.15.50:0/1525762126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95880a7070 con 0x7f95a00c0ee0 2024-01-30T08:09:03.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f959e000640 1 -- 172.21.15.50:0/1525762126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880ab9c0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 -- 172.21.15.50:0/1525762126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 msgr2=0x7f95a01559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 --2- 172.21.15.50:0/1525762126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a01559c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f958801c420 comp rx=0 tx=0).stop 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 -- 172.21.15.50:0/1525762126 shutdown_connections 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 --2- 172.21.15.50:0/1525762126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a006a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 --2- 172.21.15.50:0/1525762126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a01559c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 -- 172.21.15.50:0/1525762126 >> 172.21.15.50:0/1525762126 conn(0x7f95a00c5b50 msgr2=0x7f95a00c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 -- 172.21.15.50:0/1525762126 shutdown_connections 2024-01-30T08:09:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 -- 172.21.15.50:0/1525762126 wait complete. 2024-01-30T08:09:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 Processor -- start 2024-01-30T08:09:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 -- start start 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.627+0000 7f95a6400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a0152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f95a6400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a014fbf0 0x7f95a0152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f95a6400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00a8bc0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f95a6400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0150940 con 0x7f95a014fbf0 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f95a6400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0154740 con 0x7f95a00c1de0 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a014ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58980/0 (socket says 172.21.15.50:58980) 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959ea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a0152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 -- 172.21.15.50:0/3761540046 learned_addr learned my addr 172.21.15.50:0/3761540046 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959fe00640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a014fbf0 0x7f95a0152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 -- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 msgr2=0x7f95a0152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a0152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 -- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a014fbf0 msgr2=0x7f95a0152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a014fbf0 0x7f95a0152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 -- 172.21.15.50:0/3761540046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880094d0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f959f400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a014ce10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f959000c420 tx=0x7f959000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f9597400640 1 -- 172.21.15.50:0/3761540046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900074e0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f9597400640 1 -- 172.21.15.50:0/3761540046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590007640 con 0x7f95a00c0ee0 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a0154a20 con 0x7f95a00c0ee0 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f9597400640 1 -- 172.21.15.50:0/3761540046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590004a30 con 0x7f95a00c0ee0 2024-01-30T08:09:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a00c0bd0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0154ed0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.631+0000 7f9597400640 1 -- 172.21.15.50:0/3761540046 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9590004b90 con 0x7f95a00c0ee0 2024-01-30T08:09:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.635+0000 7f9597400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9578066500 0x7f95780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.635+0000 7f9597400640 1 -- 172.21.15.50:0/3761540046 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9590083a80 con 0x7f95a00c0ee0 2024-01-30T08:09:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.635+0000 7f959ea00640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9578066500 0x7f95780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.635+0000 7f959ea00640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9578066500 0x7f95780689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95880af000 tx=0x7f95880b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:03.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.639+0000 7f9597400640 1 -- 172.21.15.50:0/3761540046 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9590050ad0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95a00a8920 con 0x7f95a00c0ee0 2024-01-30T08:09:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f9597400640 1 -- 172.21.15.50:0/3761540046 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f95900540f0 con 0x7f95a00c0ee0 2024-01-30T08:09:03.802 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:03.802 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9578066500 msgr2=0x7f95780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9578066500 0x7f95780689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95880af000 tx=0x7f95880b6040 comp rx=0 tx=0).stop 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 msgr2=0x7f95a014ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a014ce10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f959000c420 tx=0x7f959000c8e0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 shutdown_connections 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a014fbf0 0x7f95a0152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9578066500 0x7f95780689c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95a00c1de0 0x7f95a0152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 --2- 172.21.15.50:0/3761540046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95a00c0ee0 0x7f95a014ce10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 >> 172.21.15.50:0/3761540046 conn(0x7f95a00c5b50 msgr2=0x7f95a00bf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 shutdown_connections 2024-01-30T08:09:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.799+0000 7f95a6400640 1 -- 172.21.15.50:0/3761540046 wait complete. 2024-01-30T08:09:03.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:03.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.963+0000 7f30e8c00640 1 Processor -- start 2024-01-30T08:09:03.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.963+0000 7f30e8c00640 1 -- start start 2024-01-30T08:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e40a7120 0x7f30e41584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e8c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30e406e220 0x7f30e415f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e8c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e40c7b40 con 0x7f30e406de40 2024-01-30T08:09:03.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e8c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e40a7770 con 0x7f30e406e220 2024-01-30T08:09:03.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e8c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4155310 con 0x7f30e40a7120 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e1400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e40a7120 0x7f30e41584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e2800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30e406e220 0x7f30e415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e1e00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f30e406de40 0x7f30e4157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:54812/0 (socket says 172.21.15.50:54812) 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e1e00640 1 -- 172.21.15.50:0/1506417253 learned_addr learned my addr 172.21.15.50:0/1506417253 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e0a00640 1 -- 172.21.15.50:0/1506417253 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980595448 0 0) 0x7f30d4001120 con 0x7f30e406de40 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e0a00640 1 -- 172.21.15.50:0/1506417253 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30c4003530 con 0x7f30e406de40 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e1400640 1 -- 172.21.15.50:0/1506417253 >> v2:172.21.15.125:3300/0 conn(0x7f30e406e220 msgr2=0x7f30e415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e1400640 1 --2- 172.21.15.50:0/1506417253 >> v2:172.21.15.125:3300/0 conn(0x7f30e406e220 0x7f30e415f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e1400640 1 -- 172.21.15.50:0/1506417253 >> v1:172.21.15.125:6789/0 conn(0x7f30e406de40 legacy=0x7f30e4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e1400640 1 -- 172.21.15.50:0/1506417253 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4155730 con 0x7f30e40a7120 2024-01-30T08:09:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.967+0000 7f30e2800640 1 --2- 172.21.15.50:0/1506417253 >> v2:172.21.15.125:3300/0 conn(0x7f30e406e220 0x7f30e415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e1400640 1 --2- 172.21.15.50:0/1506417253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e40a7120 0x7f30e41584a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0097c0 tx=0x7f30cc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75a8c623e02f7357 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e0a00640 1 -- 172.21.15.50:0/1506417253 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0ab600 con 0x7f30e40a7120 2024-01-30T08:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e0a00640 1 -- 172.21.15.50:0/1506417253 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc0a7050 con 0x7f30e40a7120 2024-01-30T08:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e0a00640 1 -- 172.21.15.50:0/1506417253 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0ab980 con 0x7f30e40a7120 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 -- 172.21.15.50:0/1506417253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e40a7120 msgr2=0x7f30e41584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 --2- 172.21.15.50:0/1506417253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e40a7120 0x7f30e41584a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0097c0 tx=0x7f30cc01c480 comp rx=0 tx=0).stop 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 -- 172.21.15.50:0/1506417253 shutdown_connections 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 --2- 172.21.15.50:0/1506417253 >> v2:172.21.15.125:3300/0 conn(0x7f30e406e220 0x7f30e415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 --2- 172.21.15.50:0/1506417253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e40a7120 0x7f30e41584a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 -- 172.21.15.50:0/1506417253 >> 172.21.15.50:0/1506417253 conn(0x7f30e40c4830 msgr2=0x7f30e40c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 -- 172.21.15.50:0/1506417253 shutdown_connections 2024-01-30T08:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 -- 172.21.15.50:0/1506417253 wait complete. 2024-01-30T08:09:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 Processor -- start 2024-01-30T08:09:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.971+0000 7f30e8c00640 1 -- start start 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e406de40 0x7f30e41f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30e406e220 0x7f30e41f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e40a7120 0x7f30e4157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40a7a80 con 0x7f30e40a7120 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e414ce40 con 0x7f30e406e220 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e414d660 con 0x7f30e406de40 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e40a7120 0x7f30e4157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e40a7120 0x7f30e4157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58986/0 (socket says 172.21.15.50:58986) 2024-01-30T08:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 -- 172.21.15.50:0/27431932 learned_addr learned my addr 172.21.15.50:0/27431932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e1e00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e406de40 0x7f30e41f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e1400640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30e406e220 0x7f30e41f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 -- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e406de40 msgr2=0x7f30e41f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e406de40 0x7f30e41f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 -- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30e406e220 msgr2=0x7f30e41f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30e406e220 0x7f30e41f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 -- 172.21.15.50:0/27431932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc009a70 con 0x7f30e40a7120 2024-01-30T08:09:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e2800640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e40a7120 0x7f30e4157de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00efc0 tx=0x7f30dc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30da000640 1 -- 172.21.15.50:0/27431932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc009d70 con 0x7f30e40a7120 2024-01-30T08:09:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30da000640 1 -- 172.21.15.50:0/27431932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc00f040 con 0x7f30e40a7120 2024-01-30T08:09:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc009420 con 0x7f30e40a7120 2024-01-30T08:09:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30da000640 1 -- 172.21.15.50:0/27431932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0039a0 con 0x7f30e40a7120 2024-01-30T08:09:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e414bf50 con 0x7f30e40a7120 2024-01-30T08:09:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.975+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e414c290 con 0x7f30e40a7120 2024-01-30T08:09:03.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.979+0000 7f30da000640 1 -- 172.21.15.50:0/27431932 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f30dc014480 con 0x7f30e40a7120 2024-01-30T08:09:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.979+0000 7f30da000640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f30bc066530 0x7f30bc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.979+0000 7f30da000640 1 -- 172.21.15.50:0/27431932 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30dc084e10 con 0x7f30e40a7120 2024-01-30T08:09:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.979+0000 7f30e1e00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f30bc066530 0x7f30bc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.979+0000 7f30e1e00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f30bc066530 0x7f30bc0689f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30d4005890 tx=0x7f30d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:03.983+0000 7f30da000640 1 -- 172.21.15.50:0/27431932 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f30dc088030 con 0x7f30e40a7120 2024-01-30T08:09:04.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.143+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30e4074a20 con 0x7f30e40a7120 2024-01-30T08:09:04.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.143+0000 7f30da000640 1 -- 172.21.15.50:0/27431932 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f30dc018090 con 0x7f30e40a7120 2024-01-30T08:09:04.146 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:04.146 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.143+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f30bc066530 msgr2=0x7f30bc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.143+0000 7f30e8c00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f30bc066530 0x7f30bc0689f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30d4005890 tx=0x7f30d4009040 comp rx=0 tx=0).stop 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.143+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e40a7120 msgr2=0x7f30e4157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.143+0000 7f30e8c00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e40a7120 0x7f30e4157de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00efc0 tx=0x7f30dc009f90 comp rx=0 tx=0).stop 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 shutdown_connections 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30e406e220 0x7f30e41f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f30bc066530 0x7f30bc0689f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e40a7120 0x7f30e4157de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 --2- 172.21.15.50:0/27431932 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30e406de40 0x7f30e41f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 >> 172.21.15.50:0/27431932 conn(0x7f30e40c4830 msgr2=0x7f30e41539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 shutdown_connections 2024-01-30T08:09:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.147+0000 7f30e8c00640 1 -- 172.21.15.50:0/27431932 wait complete. 2024-01-30T08:09:04.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-30T08:09:04.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a8800640 1 Processor -- start 2024-01-30T08:09:04.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a8800640 1 -- start start 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a8800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90a0071e10 0x7f90a00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a8800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90a0154290 0x7f90a01546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a8800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a00c22b0 con 0x7f90a006c960 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a8800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00c5890 con 0x7f90a0071e10 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a8800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00c52d0 con 0x7f90a0154290 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90a0071e10 0x7f90a00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90a006c960 0x7f90a00c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36982/0 (socket says 172.21.15.50:36982) 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90a0071e10 0x7f90a00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59002/0 (socket says 172.21.15.50:59002) 2024-01-30T08:09:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5400640 1 -- 172.21.15.50:0/190488652 learned_addr learned my addr 172.21.15.50:0/190488652 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a6800640 1 --2- 172.21.15.50:0/190488652 >> v2:172.21.15.125:3300/0 conn(0x7f90a0154290 0x7f90a01546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5e00640 1 -- 172.21.15.50:0/190488652 >> v2:172.21.15.125:3300/0 conn(0x7f90a0154290 msgr2=0x7f90a01546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5e00640 1 --2- 172.21.15.50:0/190488652 >> v2:172.21.15.125:3300/0 conn(0x7f90a0154290 0x7f90a01546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5e00640 1 -- 172.21.15.50:0/190488652 >> v1:172.21.15.50:6789/0 conn(0x7f90a006c960 legacy=0x7f90a00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a5e00640 1 -- 172.21.15.50:0/190488652 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00c55b0 con 0x7f90a0071e10 2024-01-30T08:09:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.315+0000 7f90a4a00640 1 -- 172.21.15.50:0/190488652 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331818176 0 0) 0x7f90a00c22b0 con 0x7f90a006c960 2024-01-30T08:09:04.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a5e00640 1 --2- 172.21.15.50:0/190488652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0071e10 0x7f90a00727b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f90a0072f30 tx=0x7f909001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddf0f0ca7301c2e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:04.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a4a00640 1 -- 172.21.15.50:0/190488652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ab600 con 0x7f90a0071e10 2024-01-30T08:09:04.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a4a00640 1 -- 172.21.15.50:0/190488652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900a7050 con 0x7f90a0071e10 2024-01-30T08:09:04.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a4a00640 1 -- 172.21.15.50:0/190488652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ab980 con 0x7f90a0071e10 2024-01-30T08:09:04.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 -- 172.21.15.50:0/190488652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0071e10 msgr2=0x7f90a00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:04.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 --2- 172.21.15.50:0/190488652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0071e10 0x7f90a00727b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f90a0072f30 tx=0x7f909001c340 comp rx=0 tx=0).stop 2024-01-30T08:09:04.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 -- 172.21.15.50:0/190488652 shutdown_connections 2024-01-30T08:09:04.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 --2- 172.21.15.50:0/190488652 >> v2:172.21.15.125:3300/0 conn(0x7f90a0154290 0x7f90a01546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 --2- 172.21.15.50:0/190488652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0071e10 0x7f90a00727b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 -- 172.21.15.50:0/190488652 >> 172.21.15.50:0/190488652 conn(0x7f90a00c5b30 msgr2=0x7f90a00c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 -- 172.21.15.50:0/190488652 shutdown_connections 2024-01-30T08:09:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.319+0000 7f90a8800640 1 -- 172.21.15.50:0/190488652 wait complete. 2024-01-30T08:09:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 Processor -- start 2024-01-30T08:09:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 -- start start 2024-01-30T08:09:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a006c960 0x7f90a014ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0071e10 0x7f90a0148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0154290 0x7f90a0148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a014ff30 con 0x7f90a0154290 2024-01-30T08:09:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0148ba0 con 0x7f90a0071e10 2024-01-30T08:09:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01f13e0 con 0x7f90a006c960 2024-01-30T08:09:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0154290 0x7f90a0148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0154290 0x7f90a0148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59018/0 (socket says 172.21.15.50:59018) 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 -- 172.21.15.50:0/1579099767 learned_addr learned my addr 172.21.15.50:0/1579099767 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a5400640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0071e10 0x7f90a0148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a5e00640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a006c960 0x7f90a014ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 -- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a006c960 msgr2=0x7f90a014ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a006c960 0x7f90a014ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 -- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0071e10 msgr2=0x7f90a0148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0071e10 0x7f90a0148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 -- 172.21.15.50:0/1579099767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009420 con 0x7f90a0154290 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a5e00640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a006c960 0x7f90a014ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a5400640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0071e10 0x7f90a0148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a6800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0154290 0x7f90a0148660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9098007e40 tx=0x7f909800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:04.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f909e000640 1 -- 172.21.15.50:0/1579099767 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098014620 con 0x7f90a0154290 2024-01-30T08:09:04.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f909e000640 1 -- 172.21.15.50:0/1579099767 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800ee90 con 0x7f90a0154290 2024-01-30T08:09:04.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a01f0620 con 0x7f90a0154290 2024-01-30T08:09:04.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f909e000640 1 -- 172.21.15.50:0/1579099767 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980149e0 con 0x7f90a0154290 2024-01-30T08:09:04.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a01f0be0 con 0x7f90a0154290 2024-01-30T08:09:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.323+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a0074a20 con 0x7f90a0154290 2024-01-30T08:09:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.327+0000 7f909e000640 1 -- 172.21.15.50:0/1579099767 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9098014b40 con 0x7f90a0154290 2024-01-30T08:09:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.327+0000 7f909e000640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9078066500 0x7f90780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.327+0000 7f909e000640 1 -- 172.21.15.50:0/1579099767 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9098084bb0 con 0x7f90a0154290 2024-01-30T08:09:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.327+0000 7f90a5e00640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9078066500 0x7f90780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.327+0000 7f90a5e00640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9078066500 0x7f90780689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90900ad000 tx=0x7f9090008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.331+0000 7f909e000640 1 -- 172.21.15.50:0/1579099767 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9098051b50 con 0x7f90a0154290 2024-01-30T08:09:04.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:04.527+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f90a00a5530 con 0x7f90a0154290 2024-01-30T08:09:05.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f909e000640 1 -- 172.21.15.50:0/1579099767 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9098084020 con 0x7f90a0154290 2024-01-30T08:09:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9078066500 msgr2=0x7f90780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9078066500 0x7f90780689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90900ad000 tx=0x7f9090008040 comp rx=0 tx=0).stop 2024-01-30T08:09:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0154290 msgr2=0x7f90a0148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0154290 0x7f90a0148660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9098007e40 tx=0x7f909800e4b0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 shutdown_connections 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90a0071e10 0x7f90a0148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9078066500 0x7f90780689c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a0154290 0x7f90a0148660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 --2- 172.21.15.50:0/1579099767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90a006c960 0x7f90a014ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 >> 172.21.15.50:0/1579099767 conn(0x7f90a00c5b30 msgr2=0x7f90a0072580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 shutdown_connections 2024-01-30T08:09:05.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.167+0000 7f90a8800640 1 -- 172.21.15.50:0/1579099767 wait complete. 2024-01-30T08:09:05.195 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-01-30T08:09:05.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-30T08:09:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.343+0000 7efce3800640 1 Processor -- start 2024-01-30T08:09:05.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.343+0000 7efce3800640 1 -- start start 2024-01-30T08:09:05.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.343+0000 7efce3800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efcdc06c960 0x7efcdc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.343+0000 7efce3800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0c22b0 con 0x7efcdc1549a0 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.343+0000 7efce3800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0c5890 con 0x7efcdc071e10 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.343+0000 7efce3800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0c52d0 con 0x7efcdc06c960 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce0e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efcdc06c960 0x7efcdc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce1800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efcdc1549a0 0x7efcdc0c3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36994/0 (socket says 172.21.15.50:36994) 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce0e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efcdc06c960 0x7efcdc0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59032/0 (socket says 172.21.15.50:59032) 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce1800640 1 -- 172.21.15.50:0/1855759713 learned_addr learned my addr 172.21.15.50:0/1855759713 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce0e00640 1 -- 172.21.15.50:0/1855759713 >> v1:172.21.15.125:6789/0 conn(0x7efcdc071e10 legacy=0x7efcdc154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce0e00640 1 -- 172.21.15.50:0/1855759713 >> v1:172.21.15.50:6789/0 conn(0x7efcdc1549a0 legacy=0x7efcdc0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:05.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce0e00640 1 -- 172.21.15.50:0/1855759713 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0c55b0 con 0x7efcdc06c960 2024-01-30T08:09:05.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efce0e00640 1 --2- 172.21.15.50:0/1855759713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc06c960 0x7efcdc0727b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097c0 tx=0x7efccc01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb78929543e061bd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:05.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efcdb400640 1 -- 172.21.15.50:0/1855759713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0ab600 con 0x7efcdc06c960 2024-01-30T08:09:05.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efcdb400640 1 -- 172.21.15.50:0/1855759713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc0a7050 con 0x7efcdc06c960 2024-01-30T08:09:05.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.347+0000 7efcdb400640 1 -- 172.21.15.50:0/1855759713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0ab980 con 0x7efcdc06c960 2024-01-30T08:09:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- 172.21.15.50:0/1855759713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc06c960 msgr2=0x7efcdc0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 --2- 172.21.15.50:0/1855759713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc06c960 0x7efcdc0727b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097c0 tx=0x7efccc01c320 comp rx=0 tx=0).stop 2024-01-30T08:09:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- 172.21.15.50:0/1855759713 shutdown_connections 2024-01-30T08:09:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 --2- 172.21.15.50:0/1855759713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc06c960 0x7efcdc0727b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- 172.21.15.50:0/1855759713 >> 172.21.15.50:0/1855759713 conn(0x7efcdc0c5b30 msgr2=0x7efcdc0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- 172.21.15.50:0/1855759713 shutdown_connections 2024-01-30T08:09:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- 172.21.15.50:0/1855759713 wait complete. 2024-01-30T08:09:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 Processor -- start 2024-01-30T08:09:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- start start 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc06c960 0x7efcdc14dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc071e10 0x7efcdc142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1549a0 0x7efcdc142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc14d4d0 con 0x7efcdc071e10 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1ef430 con 0x7efcdc1549a0 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efce3800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1ef710 con 0x7efcdc06c960 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efcdbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc071e10 0x7efcdc142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efcdbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc071e10 0x7efcdc142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59036/0 (socket says 172.21.15.50:59036) 2024-01-30T08:09:05.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.351+0000 7efcdbe00640 1 -- 172.21.15.50:0/3416885778 learned_addr learned my addr 172.21.15.50:0/3416885778 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:05.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efce1800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1549a0 0x7efcdc142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efce0e00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc06c960 0x7efcdc14dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcdbe00640 1 -- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc06c960 msgr2=0x7efcdc14dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcdbe00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc06c960 0x7efcdc14dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcdbe00640 1 -- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1549a0 msgr2=0x7efcdc142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcdbe00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1549a0 0x7efcdc142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcdbe00640 1 -- 172.21.15.50:0/3416885778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009420 con 0x7efcdc071e10 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efce1800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1549a0 0x7efcdc142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efce0e00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc06c960 0x7efcdc14dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcdbe00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc071e10 0x7efcdc142730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efcc400b410 tx=0x7efcc400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcd8c00640 1 -- 172.21.15.50:0/3416885778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4004020 con 0x7efcdc071e10 2024-01-30T08:09:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcd8c00640 1 -- 172.21.15.50:0/3416885778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4004180 con 0x7efcdc071e10 2024-01-30T08:09:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcd8c00640 1 -- 172.21.15.50:0/3416885778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4011630 con 0x7efcdc071e10 2024-01-30T08:09:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc141f30 con 0x7efcdc071e10 2024-01-30T08:09:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc14e120 con 0x7efcdc071e10 2024-01-30T08:09:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc067cc0 con 0x7efcdc071e10 2024-01-30T08:09:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.355+0000 7efcd8c00640 1 -- 172.21.15.50:0/3416885778 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7efcc4011790 con 0x7efcdc071e10 2024-01-30T08:09:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.359+0000 7efcd8c00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efcb4066500 0x7efcb40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.359+0000 7efcd8c00640 1 -- 172.21.15.50:0/3416885778 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efcc4083f60 con 0x7efcdc071e10 2024-01-30T08:09:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.359+0000 7efce0e00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efcb4066500 0x7efcb40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.359+0000 7efce0e00640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efcb4066500 0x7efcb40689c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efccc0ad000 tx=0x7efccc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:05.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.359+0000 7efcd8c00640 1 -- 172.21.15.50:0/3416885778 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7efcc4050f00 con 0x7efcdc071e10 2024-01-30T08:09:05.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:05.555+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efcdc142450 con 0x7efcdc071e10 2024-01-30T08:09:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.167+0000 7efcd8c00640 1 -- 172.21.15.50:0/3416885778 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7efcdc142450 con 0x7efcdc071e10 2024-01-30T08:09:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efcb4066500 msgr2=0x7efcb40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efcb4066500 0x7efcb40689c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efccc0ad000 tx=0x7efccc008040 comp rx=0 tx=0).stop 2024-01-30T08:09:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc071e10 msgr2=0x7efcdc142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc071e10 0x7efcdc142730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efcc400b410 tx=0x7efcc400b8d0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 shutdown_connections 2024-01-30T08:09:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcdc1549a0 0x7efcdc142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efcb4066500 0x7efcb40689c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcdc071e10 0x7efcdc142730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 --2- 172.21.15.50:0/3416885778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcdc06c960 0x7efcdc14dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 >> 172.21.15.50:0/3416885778 conn(0x7efcdc0c5b30 msgr2=0x7efcdc150d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 shutdown_connections 2024-01-30T08:09:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.171+0000 7efce3800640 1 -- 172.21.15.50:0/3416885778 wait complete. 2024-01-30T08:09:06.197 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-30T08:09:06.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:06.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd136c00640 1 Processor -- start 2024-01-30T08:09:06.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd136c00640 1 -- start start 2024-01-30T08:09:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd136c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1300a7120 0x7fd1301584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd136c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd13006e220 0x7fd13015f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd136c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300c7b40 con 0x7fd13006de40 2024-01-30T08:09:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd136c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1300a7770 con 0x7fd13006e220 2024-01-30T08:09:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd136c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd130155310 con 0x7fd1300a7120 2024-01-30T08:09:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd134c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd13006e220 0x7fd13015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd134c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd13006e220 0x7fd13015f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59048/0 (socket says 172.21.15.50:59048) 2024-01-30T08:09:06.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd134c00640 1 -- 172.21.15.50:0/850951200 learned_addr learned my addr 172.21.15.50:0/850951200 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:06.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.343+0000 7fd12f400640 1 --2- 172.21.15.50:0/850951200 >> v2:172.21.15.125:3300/0 conn(0x7fd1300a7120 0x7fd1301584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd134c00640 1 -- 172.21.15.50:0/850951200 >> v2:172.21.15.125:3300/0 conn(0x7fd1300a7120 msgr2=0x7fd1301584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:06.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd134c00640 1 --2- 172.21.15.50:0/850951200 >> v2:172.21.15.125:3300/0 conn(0x7fd1300a7120 0x7fd1301584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd134c00640 1 -- 172.21.15.50:0/850951200 >> v1:172.21.15.125:6789/0 conn(0x7fd13006de40 legacy=0x7fd130157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd134c00640 1 -- 172.21.15.50:0/850951200 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130155730 con 0x7fd13006e220 2024-01-30T08:09:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd134c00640 1 --2- 172.21.15.50:0/850951200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006e220 0x7fd13015f120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1300aaaf0 tx=0x7fd12801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1204434be3abac1a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd12ea00640 1 -- 172.21.15.50:0/850951200 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a5690 con 0x7fd13006e220 2024-01-30T08:09:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd12ea00640 1 -- 172.21.15.50:0/850951200 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1280a57f0 con 0x7fd13006e220 2024-01-30T08:09:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.347+0000 7fd12ea00640 1 -- 172.21.15.50:0/850951200 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a5b80 con 0x7fd13006e220 2024-01-30T08:09:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- 172.21.15.50:0/850951200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006e220 msgr2=0x7fd13015f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 --2- 172.21.15.50:0/850951200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006e220 0x7fd13015f120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1300aaaf0 tx=0x7fd12801c9d0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- 172.21.15.50:0/850951200 shutdown_connections 2024-01-30T08:09:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 --2- 172.21.15.50:0/850951200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006e220 0x7fd13015f120 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 --2- 172.21.15.50:0/850951200 >> v2:172.21.15.125:3300/0 conn(0x7fd1300a7120 0x7fd1301584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- 172.21.15.50:0/850951200 >> 172.21.15.50:0/850951200 conn(0x7fd1300c4830 msgr2=0x7fd1300c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- 172.21.15.50:0/850951200 shutdown_connections 2024-01-30T08:09:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- 172.21.15.50:0/850951200 wait complete. 2024-01-30T08:09:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 Processor -- start 2024-01-30T08:09:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- start start 2024-01-30T08:09:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006de40 0x7fd1300aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd13006e220 0x7fd1301eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1300a7120 0x7fd1301eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130144f20 con 0x7fd13006de40 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300ab980 con 0x7fd13006e220 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd136c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301edb20 con 0x7fd1300a7120 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006de40 0x7fd1300aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006de40 0x7fd1300aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59052/0 (socket says 172.21.15.50:59052) 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 -- 172.21.15.50:0/3865399431 learned_addr learned my addr 172.21.15.50:0/3865399431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12f400640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd13006e220 0x7fd1301eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd134c00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1300a7120 0x7fd1301eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 -- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1300a7120 msgr2=0x7fd1301eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1300a7120 0x7fd1301eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 -- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd13006e220 msgr2=0x7fd1301eaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd13006e220 0x7fd1301eaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.351+0000 7fd12fe00640 1 -- 172.21.15.50:0/3865399431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009b30 con 0x7fd13006de40 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd12fe00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006de40 0x7fd1300aad50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c420 tx=0x7fd12000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd127e00640 1 -- 172.21.15.50:0/3865399431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200052d0 con 0x7fd13006de40 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd127e00640 1 -- 172.21.15.50:0/3865399431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120005430 con 0x7fd13006de40 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd127e00640 1 -- 172.21.15.50:0/3865399431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120007260 con 0x7fd13006de40 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1300ab6a0 con 0x7fd13006de40 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1300abbd0 con 0x7fd13006de40 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1301ed980 con 0x7fd13006de40 2024-01-30T08:09:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd127e00640 1 -- 172.21.15.50:0/3865399431 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd1200073c0 con 0x7fd13006de40 2024-01-30T08:09:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd127e00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd108066500 0x7fd1080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd127e00640 1 -- 172.21.15.50:0/3865399431 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd120083350 con 0x7fd13006de40 2024-01-30T08:09:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.355+0000 7fd12f400640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd108066500 0x7fd1080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.359+0000 7fd12f400640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd108066500 0x7fd1080689c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd13006c2a0 tx=0x7fd118008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.359+0000 7fd127e00640 1 -- 172.21.15.50:0/3865399431 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd1301ed980 con 0x7fd13006de40 2024-01-30T08:09:06.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.559+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1300c7b40 con 0x7fd13006de40 2024-01-30T08:09:06.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd127e00640 1 -- 172.21.15.50:0/3865399431 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7fd1300c7b40 con 0x7fd13006de40 2024-01-30T08:09:06.564 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:06.565 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:06.565 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd108066500 msgr2=0x7fd1080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd108066500 0x7fd1080689c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd13006c2a0 tx=0x7fd118008040 comp rx=0 tx=0).stop 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006de40 msgr2=0x7fd1300aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006de40 0x7fd1300aad50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c420 tx=0x7fd12000c8e0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 shutdown_connections 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd13006e220 0x7fd1301eaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd108066500 0x7fd1080689c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1300a7120 0x7fd1301eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 --2- 172.21.15.50:0/3865399431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13006de40 0x7fd1300aad50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 >> 172.21.15.50:0/3865399431 conn(0x7fd1300c4830 msgr2=0x7fd130153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 shutdown_connections 2024-01-30T08:09:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.563+0000 7fd136c00640 1 -- 172.21.15.50:0/3865399431 wait complete. 2024-01-30T08:09:06.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.723+0000 7f7fa5e00640 1 Processor -- start 2024-01-30T08:09:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.723+0000 7f7fa5e00640 1 -- start start 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.723+0000 7f7fa5e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c5650 0x7f7fa006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.723+0000 7f7fa5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fa00c4760 0x7f7fa006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7fa5e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa00a8cf0 con 0x7f7fa00c1840 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7fa5e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa0072a30 con 0x7f7fa00c4760 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7fa5e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa00a8f40 con 0x7f7fa00c5650 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fa00c4760 0x7f7fa006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fa00c4760 0x7f7fa006d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59054/0 (socket says 172.21.15.50:59054) 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 -- 172.21.15.50:0/2265649033 learned_addr learned my addr 172.21.15.50:0/2265649033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9e000640 1 --2- 172.21.15.50:0/2265649033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c5650 0x7f7fa006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 -- 172.21.15.50:0/2265649033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c5650 msgr2=0x7f7fa006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 --2- 172.21.15.50:0/2265649033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c5650 0x7f7fa006cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 -- 172.21.15.50:0/2265649033 >> v1:172.21.15.125:6789/0 conn(0x7f7fa00c1840 legacy=0x7f7fa00a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 -- 172.21.15.50:0/2265649033 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0072cd0 con 0x7f7fa00c4760 2024-01-30T08:09:06.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9f400640 1 --2- 172.21.15.50:0/2265649033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa006d440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009e50 tx=0x7f7f9801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7621865b4da08c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:06.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9d600640 1 -- 172.21.15.50:0/2265649033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f980a5900 con 0x7f7fa00c4760 2024-01-30T08:09:06.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9d600640 1 -- 172.21.15.50:0/2265649033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f980a5a60 con 0x7f7fa00c4760 2024-01-30T08:09:06.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.727+0000 7f7f9d600640 1 -- 172.21.15.50:0/2265649033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f980a5df0 con 0x7f7fa00c4760 2024-01-30T08:09:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- 172.21.15.50:0/2265649033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 msgr2=0x7f7fa006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/2265649033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa006d440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009e50 tx=0x7f7f9801ca10 comp rx=0 tx=0).stop 2024-01-30T08:09:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- 172.21.15.50:0/2265649033 shutdown_connections 2024-01-30T08:09:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/2265649033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa006d440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/2265649033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c5650 0x7f7fa006cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- 172.21.15.50:0/2265649033 >> 172.21.15.50:0/2265649033 conn(0x7f7fa00c5b50 msgr2=0x7f7fa00c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- 172.21.15.50:0/2265649033 shutdown_connections 2024-01-30T08:09:06.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- 172.21.15.50:0/2265649033 wait complete. 2024-01-30T08:09:06.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 Processor -- start 2024-01-30T08:09:06.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- start start 2024-01-30T08:09:06.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c1840 0x7f7fa01ef030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa00721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fa00c5650 0x7f7fa0158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01ee5e0 con 0x7f7fa00c4760 2024-01-30T08:09:06.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa00bfa30 con 0x7f7fa00c5650 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.731+0000 7f7fa5e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa00bfd10 con 0x7f7fa00c1840 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa00721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa00721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59068/0 (socket says 172.21.15.50:59068) 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 -- 172.21.15.50:0/58408415 learned_addr learned my addr 172.21.15.50:0/58408415 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9f400640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fa00c5650 0x7f7fa0158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c1840 0x7f7fa01ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 -- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c1840 msgr2=0x7f7fa01ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c1840 0x7f7fa01ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 -- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fa00c5650 msgr2=0x7f7fa0158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fa00c5650 0x7f7fa0158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 -- 172.21.15.50:0/58408415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98009b30 con 0x7f7fa00c4760 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9f400640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fa00c5650 0x7f7fa0158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f9e000640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa00721e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e870 tx=0x7f7f8800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:06.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f97400640 1 -- 172.21.15.50:0/58408415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88009510 con 0x7f7fa00c4760 2024-01-30T08:09:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f97400640 1 -- 172.21.15.50:0/58408415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800eec0 con 0x7f7fa00c4760 2024-01-30T08:09:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa00bfff0 con 0x7f7fa00c4760 2024-01-30T08:09:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f97400640 1 -- 172.21.15.50:0/58408415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800cb40 con 0x7f7fa00c4760 2024-01-30T08:09:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa01eeb10 con 0x7f7fa00c4760 2024-01-30T08:09:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa00c1410 con 0x7f7fa00c4760 2024-01-30T08:09:06.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.735+0000 7f7f97400640 1 -- 172.21.15.50:0/58408415 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7f8800cca0 con 0x7f7fa00c4760 2024-01-30T08:09:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.739+0000 7f7f97400640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f78066500 0x7f7f780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.739+0000 7f7f97400640 1 -- 172.21.15.50:0/58408415 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f88084210 con 0x7f7fa00c4760 2024-01-30T08:09:06.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.739+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f78066500 0x7f7f780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:06.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.739+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f78066500 0x7f7f780689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0156e50 tx=0x7f7f90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.743+0000 7f7f97400640 1 -- 172.21.15.50:0/58408415 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7f88051260 con 0x7f7fa00c4760 2024-01-30T08:09:06.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.903+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fa0074a20 con 0x7f7fa00c4760 2024-01-30T08:09:06.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.903+0000 7f7f97400640 1 -- 172.21.15.50:0/58408415 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f7f88054880 con 0x7f7fa00c4760 2024-01-30T08:09:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:06.907 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f78066500 msgr2=0x7f7f780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f78066500 0x7f7f780689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0156e50 tx=0x7f7f90009040 comp rx=0 tx=0).stop 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 msgr2=0x7f7fa00721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa00721e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e870 tx=0x7f7f8800ec70 comp rx=0 tx=0).stop 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 shutdown_connections 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fa00c5650 0x7f7fa0158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f78066500 0x7f7f780689c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa00c4760 0x7f7fa00721e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 --2- 172.21.15.50:0/58408415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fa00c1840 0x7f7fa01ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 >> 172.21.15.50:0/58408415 conn(0x7f7fa00c5b50 msgr2=0x7f7fa00c0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 shutdown_connections 2024-01-30T08:09:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:06.907+0000 7f7fa5e00640 1 -- 172.21.15.50:0/58408415 wait complete. 2024-01-30T08:09:06.930 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-30T08:09:06.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:07.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.067+0000 7f6e81400640 1 Processor -- start 2024-01-30T08:09:07.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.067+0000 7f6e81400640 1 -- start start 2024-01-30T08:09:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e81400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e7c06de40 0x7f6e7c0a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e81400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c1584a0 0x7f6e7c15f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e81400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7c0c7b40 con 0x7f6e7c06e220 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e81400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7c0a7770 con 0x7f6e7c06de40 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e81400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c155310 con 0x7f6e7c1584a0 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e7c06de40 0x7f6e7c0a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e7c06de40 0x7f6e7c0a7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59070/0 (socket says 172.21.15.50:59070) 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7a800640 1 -- 172.21.15.50:0/2373650239 learned_addr learned my addr 172.21.15.50:0/2373650239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e79e00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6e7c06e220 0x7f6e7c157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:54844/0 (socket says 172.21.15.50:54844) 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7b200640 1 --2- 172.21.15.50:0/2373650239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c1584a0 0x7f6e7c15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7a800640 1 -- 172.21.15.50:0/2373650239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c1584a0 msgr2=0x7f6e7c15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7a800640 1 --2- 172.21.15.50:0/2373650239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c1584a0 0x7f6e7c15f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7a800640 1 -- 172.21.15.50:0/2373650239 >> v1:172.21.15.125:6789/0 conn(0x7f6e7c06e220 legacy=0x7f6e7c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e7a800640 1 -- 172.21.15.50:0/2373650239 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c155730 con 0x7f6e7c06de40 2024-01-30T08:09:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.071+0000 7f6e79400640 1 -- 172.21.15.50:0/2373650239 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121515840 0 0) 0x7f6e64001120 con 0x7f6e7c06e220 2024-01-30T08:09:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e7a800640 1 --2- 172.21.15.50:0/2373650239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c0a7120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009870 tx=0x7f6e6c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b91b2dc86a4e72b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e79400640 1 -- 172.21.15.50:0/2373650239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c0ab600 con 0x7f6e7c06de40 2024-01-30T08:09:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e79400640 1 -- 172.21.15.50:0/2373650239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c0a7050 con 0x7f6e7c06de40 2024-01-30T08:09:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e79400640 1 -- 172.21.15.50:0/2373650239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c0ab980 con 0x7f6e7c06de40 2024-01-30T08:09:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 -- 172.21.15.50:0/2373650239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 msgr2=0x7f6e7c0a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 --2- 172.21.15.50:0/2373650239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c0a7120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009870 tx=0x7f6e6c01c540 comp rx=0 tx=0).stop 2024-01-30T08:09:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 -- 172.21.15.50:0/2373650239 shutdown_connections 2024-01-30T08:09:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 --2- 172.21.15.50:0/2373650239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c1584a0 0x7f6e7c15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 --2- 172.21.15.50:0/2373650239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c0a7120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 -- 172.21.15.50:0/2373650239 >> 172.21.15.50:0/2373650239 conn(0x7f6e7c0c4830 msgr2=0x7f6e7c0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 -- 172.21.15.50:0/2373650239 shutdown_connections 2024-01-30T08:09:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 -- 172.21.15.50:0/2373650239 wait complete. 2024-01-30T08:09:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 Processor -- start 2024-01-30T08:09:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.075+0000 7f6e81400640 1 -- start start 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c1f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c06e220 0x7f6e7c1f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c1584a0 0x7f6e7c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c14e420 con 0x7f6e7c06de40 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0a79f0 con 0x7f6e7c1584a0 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0aa1d0 con 0x7f6e7c06e220 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c1f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7b200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c1584a0 0x7f6e7c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e79e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c06e220 0x7f6e7c1f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7b200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c1584a0 0x7f6e7c146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:33842/0 (socket says 172.21.15.50:33842) 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c1f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59076/0 (socket says 172.21.15.50:59076) 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7b200640 1 -- 172.21.15.50:0/2280325708 learned_addr learned my addr 172.21.15.50:0/2280325708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 -- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c06e220 msgr2=0x7f6e7c1f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c06e220 0x7f6e7c1f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 -- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c1584a0 msgr2=0x7f6e7c146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c1584a0 0x7f6e7c146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 -- 172.21.15.50:0/2280325708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0094d0 con 0x7f6e7c06de40 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7b200640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c1584a0 0x7f6e7c146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e7a800640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c1f0740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0c8d90 tx=0x7f6e6c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e72a00640 1 -- 172.21.15.50:0/2280325708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c004030 con 0x7f6e7c06de40 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e72a00640 1 -- 172.21.15.50:0/2280325708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c004190 con 0x7f6e7c06de40 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c0aa4b0 con 0x7f6e7c06de40 2024-01-30T08:09:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e72a00640 1 -- 172.21.15.50:0/2280325708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c004500 con 0x7f6e7c06de40 2024-01-30T08:09:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c1f1360 con 0x7f6e7c06de40 2024-01-30T08:09:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7c0a7b60 con 0x7f6e7c06de40 2024-01-30T08:09:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.079+0000 7f6e72a00640 1 -- 172.21.15.50:0/2280325708 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6e6c003620 con 0x7f6e7c06de40 2024-01-30T08:09:07.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.083+0000 7f6e72a00640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e54066500 0x7f6e540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.083+0000 7f6e72a00640 1 -- 172.21.15.50:0/2280325708 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e6c11e6a0 con 0x7f6e7c06de40 2024-01-30T08:09:07.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.083+0000 7f6e79e00640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e54066500 0x7f6e540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.083+0000 7f6e79e00640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e54066500 0x7f6e540689c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c15f630 tx=0x7f6e64007ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.087+0000 7f6e72a00640 1 -- 172.21.15.50:0/2280325708 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6e6c0eb810 con 0x7f6e7c06de40 2024-01-30T08:09:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.243+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e7c154f30 con 0x7f6e54066500 2024-01-30T08:09:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.255+0000 7f6e72a00640 1 -- 172.21.15.50:0/2280325708 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345383 (secure 0 0 0) 0x7f6e640075f0 con 0x7f6e54066500 2024-01-30T08:09:07.258 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e54066500 msgr2=0x7f6e540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e54066500 0x7f6e540689c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c15f630 tx=0x7f6e64007ba0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 msgr2=0x7f6e7c1f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c1f0740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0c8d90 tx=0x7f6e6c0192e0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 shutdown_connections 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c1584a0 0x7f6e7c146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e54066500 0x7f6e540689c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c06e220 0x7f6e7c1f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 --2- 172.21.15.50:0/2280325708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c06de40 0x7f6e7c1f0740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 >> 172.21.15.50:0/2280325708 conn(0x7f6e7c0c4830 msgr2=0x7f6e7c0c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 shutdown_connections 2024-01-30T08:09:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.259+0000 7f6e81400640 1 -- 172.21.15.50:0/2280325708 wait complete. 2024-01-30T08:09:07.282 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-01-30T08:09:07.055186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218404,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756316,"statfs":{"total":773094113280,"available":772870467584,"internally_reserved":0,"allocated":2293760,"data_stored":2016230,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003522"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062910+0000","last_change":"2024-01-30T08:08:41.284386+0000","last_active":"2024-01-30T08:08:49.062910+0000","last_peered":"2024-01-30T08:08:49.062910+0000","last_clean":"2024-01-30T08:08:49.062910+0000","last_became_active":"2024-01-30T08:08:41.284070+0000","last_became_peered":"2024-01-30T08:08:41.284070+0000","last_unstale":"2024-01-30T08:08:49.062910+0000","last_undegraded":"2024-01-30T08:08:49.062910+0000","last_fullsized":"2024-01-30T08:08:49.062910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:49:56.992264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305887+0000","last_change":"2024-01-30T08:08:42.279355+0000","last_active":"2024-01-30T08:08:47.305887+0000","last_peered":"2024-01-30T08:08:47.305887+0000","last_clean":"2024-01-30T08:08:47.305887+0000","last_became_active":"2024-01-30T08:08:42.276213+0000","last_became_peered":"2024-01-30T08:08:42.276213+0000","last_unstale":"2024-01-30T08:08:47.305887+0000","last_undegraded":"2024-01-30T08:08:47.305887+0000","last_fullsized":"2024-01-30T08:08:47.305887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.562412+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.561547+0000","last_became_peered":"2024-01-30T08:08:46.561547+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:25.519672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306121+0000","last_change":"2024-01-30T08:08:41.277142+0000","last_active":"2024-01-30T08:08:47.306121+0000","last_peered":"2024-01-30T08:08:47.306121+0000","last_clean":"2024-01-30T08:08:47.306121+0000","last_became_active":"2024-01-30T08:08:41.276876+0000","last_became_peered":"2024-01-30T08:08:41.276876+0000","last_unstale":"2024-01-30T08:08:47.306121+0000","last_undegraded":"2024-01-30T08:08:47.306121+0000","last_fullsized":"2024-01-30T08:08:47.306121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062659+0000","last_change":"2024-01-30T08:08:42.289777+0000","last_active":"2024-01-30T08:08:49.062659+0000","last_peered":"2024-01-30T08:08:49.062659+0000","last_clean":"2024-01-30T08:08:49.062659+0000","last_became_active":"2024-01-30T08:08:42.288789+0000","last_became_peered":"2024-01-30T08:08:42.288789+0000","last_unstale":"2024-01-30T08:08:49.062659+0000","last_undegraded":"2024-01-30T08:08:49.062659+0000","last_fullsized":"2024-01-30T08:08:49.062659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:47:56.164414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305170+0000","last_change":"2024-01-30T08:08:46.315655+0000","last_active":"2024-01-30T08:08:47.305170+0000","last_peered":"2024-01-30T08:08:47.305170+0000","last_clean":"2024-01-30T08:08:47.305170+0000","last_became_active":"2024-01-30T08:08:46.314644+0000","last_became_peered":"2024-01-30T08:08:46.314644+0000","last_unstale":"2024-01-30T08:08:47.305170+0000","last_undegraded":"2024-01-30T08:08:47.305170+0000","last_fullsized":"2024-01-30T08:08:47.305170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:15.180621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061282+0000","last_change":"2024-01-30T08:08:41.289340+0000","last_active":"2024-01-30T08:08:49.061282+0000","last_peered":"2024-01-30T08:08:49.061282+0000","last_clean":"2024-01-30T08:08:49.061282+0000","last_became_active":"2024-01-30T08:08:41.288491+0000","last_became_peered":"2024-01-30T08:08:41.288491+0000","last_unstale":"2024-01-30T08:08:49.061282+0000","last_undegraded":"2024-01-30T08:08:49.061282+0000","last_fullsized":"2024-01-30T08:08:49.061282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062248+0000","last_change":"2024-01-30T08:08:42.297915+0000","last_active":"2024-01-30T08:08:49.062248+0000","last_peered":"2024-01-30T08:08:49.062248+0000","last_clean":"2024-01-30T08:08:49.062248+0000","last_became_active":"2024-01-30T08:08:42.297662+0000","last_became_peered":"2024-01-30T08:08:42.297662+0000","last_unstale":"2024-01-30T08:08:49.062248+0000","last_undegraded":"2024-01-30T08:08:49.062248+0000","last_fullsized":"2024-01-30T08:08:49.062248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:59:23.741905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306032+0000","last_change":"2024-01-30T08:08:46.308032+0000","last_active":"2024-01-30T08:08:47.306032+0000","last_peered":"2024-01-30T08:08:47.306032+0000","last_clean":"2024-01-30T08:08:47.306032+0000","last_became_active":"2024-01-30T08:08:46.307399+0000","last_became_peered":"2024-01-30T08:08:46.307399+0000","last_unstale":"2024-01-30T08:08:47.306032+0000","last_undegraded":"2024-01-30T08:08:47.306032+0000","last_fullsized":"2024-01-30T08:08:47.306032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:00.921167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060898+0000","last_change":"2024-01-30T08:08:41.291632+0000","last_active":"2024-01-30T08:08:49.060898+0000","last_peered":"2024-01-30T08:08:49.060898+0000","last_clean":"2024-01-30T08:08:49.060898+0000","last_became_active":"2024-01-30T08:08:41.291202+0000","last_became_peered":"2024-01-30T08:08:41.291202+0000","last_unstale":"2024-01-30T08:08:49.060898+0000","last_undegraded":"2024-01-30T08:08:49.060898+0000","last_fullsized":"2024-01-30T08:08:49.060898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062453+0000","last_change":"2024-01-30T08:08:42.295783+0000","last_active":"2024-01-30T08:08:49.062453+0000","last_peered":"2024-01-30T08:08:49.062453+0000","last_clean":"2024-01-30T08:08:49.062453+0000","last_became_active":"2024-01-30T08:08:42.295323+0000","last_became_peered":"2024-01-30T08:08:42.295323+0000","last_unstale":"2024-01-30T08:08:49.062453+0000","last_undegraded":"2024-01-30T08:08:49.062453+0000","last_fullsized":"2024-01-30T08:08:49.062453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:19:42.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306102+0000","last_change":"2024-01-30T08:08:46.315845+0000","last_active":"2024-01-30T08:08:47.306102+0000","last_peered":"2024-01-30T08:08:47.306102+0000","last_clean":"2024-01-30T08:08:47.306102+0000","last_became_active":"2024-01-30T08:08:46.315351+0000","last_became_peered":"2024-01-30T08:08:46.315351+0000","last_unstale":"2024-01-30T08:08:47.306102+0000","last_undegraded":"2024-01-30T08:08:47.306102+0000","last_fullsized":"2024-01-30T08:08:47.306102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:05.115925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306123+0000","last_change":"2024-01-30T08:08:42.276052+0000","last_active":"2024-01-30T08:08:47.306123+0000","last_peered":"2024-01-30T08:08:47.306123+0000","last_clean":"2024-01-30T08:08:47.306123+0000","last_became_active":"2024-01-30T08:08:42.275642+0000","last_became_peered":"2024-01-30T08:08:42.275642+0000","last_unstale":"2024-01-30T08:08:47.306123+0000","last_undegraded":"2024-01-30T08:08:47.306123+0000","last_fullsized":"2024-01-30T08:08:47.306123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:38.647109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061678+0000","last_change":"2024-01-30T08:08:41.284716+0000","last_active":"2024-01-30T08:08:49.061678+0000","last_peered":"2024-01-30T08:08:49.061678+0000","last_clean":"2024-01-30T08:08:49.061678+0000","last_became_active":"2024-01-30T08:08:41.284434+0000","last_became_peered":"2024-01-30T08:08:41.284434+0000","last_unstale":"2024-01-30T08:08:49.061678+0000","last_undegraded":"2024-01-30T08:08:49.061678+0000","last_fullsized":"2024-01-30T08:08:49.061678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:49.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306435+0000","last_change":"2024-01-30T08:08:46.304711+0000","last_active":"2024-01-30T08:08:47.306435+0000","last_peered":"2024-01-30T08:08:47.306435+0000","last_clean":"2024-01-30T08:08:47.306435+0000","last_became_active":"2024-01-30T08:08:46.304246+0000","last_became_peered":"2024-01-30T08:08:46.304246+0000","last_unstale":"2024-01-30T08:08:47.306435+0000","last_undegraded":"2024-01-30T08:08:47.306435+0000","last_fullsized":"2024-01-30T08:08:47.306435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305525+0000","last_change":"2024-01-30T08:08:42.284398+0000","last_active":"2024-01-30T08:08:47.305525+0000","last_peered":"2024-01-30T08:08:47.305525+0000","last_clean":"2024-01-30T08:08:47.305525+0000","last_became_active":"2024-01-30T08:08:42.284058+0000","last_became_peered":"2024-01-30T08:08:42.284058+0000","last_unstale":"2024-01-30T08:08:47.305525+0000","last_undegraded":"2024-01-30T08:08:47.305525+0000","last_fullsized":"2024-01-30T08:08:47.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063365+0000","last_change":"2024-01-30T08:08:41.283040+0000","last_active":"2024-01-30T08:08:49.063365+0000","last_peered":"2024-01-30T08:08:49.063365+0000","last_clean":"2024-01-30T08:08:49.063365+0000","last_became_active":"2024-01-30T08:08:41.275704+0000","last_became_peered":"2024-01-30T08:08:41.275704+0000","last_unstale":"2024-01-30T08:08:49.063365+0000","last_undegraded":"2024-01-30T08:08:49.063365+0000","last_fullsized":"2024-01-30T08:08:49.063365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:46.318981+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:46.318487+0000","last_became_peered":"2024-01-30T08:08:46.318487+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305403+0000","last_change":"2024-01-30T08:08:42.276779+0000","last_active":"2024-01-30T08:08:47.305403+0000","last_peered":"2024-01-30T08:08:47.305403+0000","last_clean":"2024-01-30T08:08:47.305403+0000","last_became_active":"2024-01-30T08:08:42.276293+0000","last_became_peered":"2024-01-30T08:08:42.276293+0000","last_unstale":"2024-01-30T08:08:47.305403+0000","last_undegraded":"2024-01-30T08:08:47.305403+0000","last_fullsized":"2024-01-30T08:08:47.305403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062313+0000","last_change":"2024-01-30T08:08:41.280606+0000","last_active":"2024-01-30T08:08:49.062313+0000","last_peered":"2024-01-30T08:08:49.062313+0000","last_clean":"2024-01-30T08:08:49.062313+0000","last_became_active":"2024-01-30T08:08:41.280257+0000","last_became_peered":"2024-01-30T08:08:41.280257+0000","last_unstale":"2024-01-30T08:08:49.062313+0000","last_undegraded":"2024-01-30T08:08:49.062313+0000","last_fullsized":"2024-01-30T08:08:49.062313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063823+0000","last_change":"2024-01-30T08:08:46.564137+0000","last_active":"2024-01-30T08:08:49.063823+0000","last_peered":"2024-01-30T08:08:49.063823+0000","last_clean":"2024-01-30T08:08:49.063823+0000","last_became_active":"2024-01-30T08:08:46.563422+0000","last_became_peered":"2024-01-30T08:08:46.563422+0000","last_unstale":"2024-01-30T08:08:49.063823+0000","last_undegraded":"2024-01-30T08:08:49.063823+0000","last_fullsized":"2024-01-30T08:08:49.063823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:53.755351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305710+0000","last_change":"2024-01-30T08:08:42.271792+0000","last_active":"2024-01-30T08:08:47.305710+0000","last_peered":"2024-01-30T08:08:47.305710+0000","last_clean":"2024-01-30T08:08:47.305710+0000","last_became_active":"2024-01-30T08:08:42.271488+0000","last_became_peered":"2024-01-30T08:08:42.271488+0000","last_unstale":"2024-01-30T08:08:47.305710+0000","last_undegraded":"2024-01-30T08:08:47.305710+0000","last_fullsized":"2024-01-30T08:08:47.305710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:43.028344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060650+0000","last_change":"2024-01-30T08:08:41.289206+0000","last_active":"2024-01-30T08:08:49.060650+0000","last_peered":"2024-01-30T08:08:49.060650+0000","last_clean":"2024-01-30T08:08:49.060650+0000","last_became_active":"2024-01-30T08:08:41.288158+0000","last_became_peered":"2024-01-30T08:08:41.288158+0000","last_unstale":"2024-01-30T08:08:49.060650+0000","last_undegraded":"2024-01-30T08:08:49.060650+0000","last_fullsized":"2024-01-30T08:08:49.060650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306652+0000","last_change":"2024-01-30T08:08:46.315546+0000","last_active":"2024-01-30T08:08:47.306652+0000","last_peered":"2024-01-30T08:08:47.306652+0000","last_clean":"2024-01-30T08:08:47.306652+0000","last_became_active":"2024-01-30T08:08:46.314665+0000","last_became_peered":"2024-01-30T08:08:46.314665+0000","last_unstale":"2024-01-30T08:08:47.306652+0000","last_undegraded":"2024-01-30T08:08:47.306652+0000","last_fullsized":"2024-01-30T08:08:47.306652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062963+0000","last_change":"2024-01-30T08:08:42.278495+0000","last_active":"2024-01-30T08:08:49.062963+0000","last_peered":"2024-01-30T08:08:49.062963+0000","last_clean":"2024-01-30T08:08:49.062963+0000","last_became_active":"2024-01-30T08:08:42.278239+0000","last_became_peered":"2024-01-30T08:08:42.278239+0000","last_unstale":"2024-01-30T08:08:49.062963+0000","last_undegraded":"2024-01-30T08:08:49.062963+0000","last_fullsized":"2024-01-30T08:08:49.062963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:15:30.493486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307419+0000","last_change":"2024-01-30T08:08:41.288843+0000","last_active":"2024-01-30T08:08:47.307419+0000","last_peered":"2024-01-30T08:08:47.307419+0000","last_clean":"2024-01-30T08:08:47.307419+0000","last_became_active":"2024-01-30T08:08:41.287058+0000","last_became_peered":"2024-01-30T08:08:41.287058+0000","last_unstale":"2024-01-30T08:08:47.307419+0000","last_undegraded":"2024-01-30T08:08:47.307419+0000","last_fullsized":"2024-01-30T08:08:47.307419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305476+0000","last_change":"2024-01-30T08:08:46.561858+0000","last_active":"2024-01-30T08:08:47.305476+0000","last_peered":"2024-01-30T08:08:47.305476+0000","last_clean":"2024-01-30T08:08:47.305476+0000","last_became_active":"2024-01-30T08:08:46.561473+0000","last_became_peered":"2024-01-30T08:08:46.561473+0000","last_unstale":"2024-01-30T08:08:47.305476+0000","last_undegraded":"2024-01-30T08:08:47.305476+0000","last_fullsized":"2024-01-30T08:08:47.305476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:55.086903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:42.292374+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:42.292083+0000","last_became_peered":"2024-01-30T08:08:42.292083+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063796+0000","last_change":"2024-01-30T08:08:41.277386+0000","last_active":"2024-01-30T08:08:49.063796+0000","last_peered":"2024-01-30T08:08:49.063796+0000","last_clean":"2024-01-30T08:08:49.063796+0000","last_became_active":"2024-01-30T08:08:41.276132+0000","last_became_peered":"2024-01-30T08:08:41.276132+0000","last_unstale":"2024-01-30T08:08:49.063796+0000","last_undegraded":"2024-01-30T08:08:49.063796+0000","last_fullsized":"2024-01-30T08:08:49.063796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.566162+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.565660+0000","last_became_peered":"2024-01-30T08:08:46.565660+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063508+0000","last_change":"2024-01-30T08:08:42.271610+0000","last_active":"2024-01-30T08:08:49.063508+0000","last_peered":"2024-01-30T08:08:49.063508+0000","last_clean":"2024-01-30T08:08:49.063508+0000","last_became_active":"2024-01-30T08:08:42.271325+0000","last_became_peered":"2024-01-30T08:08:42.271325+0000","last_unstale":"2024-01-30T08:08:49.063508+0000","last_undegraded":"2024-01-30T08:08:49.063508+0000","last_fullsized":"2024-01-30T08:08:49.063508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061483+0000","last_change":"2024-01-30T08:08:41.289187+0000","last_active":"2024-01-30T08:08:49.061483+0000","last_peered":"2024-01-30T08:08:49.061483+0000","last_clean":"2024-01-30T08:08:49.061483+0000","last_became_active":"2024-01-30T08:08:41.288137+0000","last_became_peered":"2024-01-30T08:08:41.288137+0000","last_unstale":"2024-01-30T08:08:49.061483+0000","last_undegraded":"2024-01-30T08:08:49.061483+0000","last_fullsized":"2024-01-30T08:08:49.061483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062164+0000","last_change":"2024-01-30T08:08:46.562867+0000","last_active":"2024-01-30T08:08:49.062164+0000","last_peered":"2024-01-30T08:08:49.062164+0000","last_clean":"2024-01-30T08:08:49.062164+0000","last_became_active":"2024-01-30T08:08:46.562382+0000","last_became_peered":"2024-01-30T08:08:46.562382+0000","last_unstale":"2024-01-30T08:08:49.062164+0000","last_undegraded":"2024-01-30T08:08:49.062164+0000","last_fullsized":"2024-01-30T08:08:49.062164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:44.788175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062441+0000","last_change":"2024-01-30T08:08:42.287858+0000","last_active":"2024-01-30T08:08:49.062441+0000","last_peered":"2024-01-30T08:08:49.062441+0000","last_clean":"2024-01-30T08:08:49.062441+0000","last_became_active":"2024-01-30T08:08:42.287567+0000","last_became_peered":"2024-01-30T08:08:42.287567+0000","last_unstale":"2024-01-30T08:08:49.062441+0000","last_undegraded":"2024-01-30T08:08:49.062441+0000","last_fullsized":"2024-01-30T08:08:49.062441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:40.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063597+0000","last_change":"2024-01-30T08:08:41.278170+0000","last_active":"2024-01-30T08:08:49.063597+0000","last_peered":"2024-01-30T08:08:49.063597+0000","last_clean":"2024-01-30T08:08:49.063597+0000","last_became_active":"2024-01-30T08:08:41.277887+0000","last_became_peered":"2024-01-30T08:08:41.277887+0000","last_unstale":"2024-01-30T08:08:49.063597+0000","last_undegraded":"2024-01-30T08:08:49.063597+0000","last_fullsized":"2024-01-30T08:08:49.063597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063213+0000","last_change":"2024-01-30T08:08:46.307067+0000","last_active":"2024-01-30T08:08:49.063213+0000","last_peered":"2024-01-30T08:08:49.063213+0000","last_clean":"2024-01-30T08:08:49.063213+0000","last_became_active":"2024-01-30T08:08:46.306645+0000","last_became_peered":"2024-01-30T08:08:46.306645+0000","last_unstale":"2024-01-30T08:08:49.063213+0000","last_undegraded":"2024-01-30T08:08:49.063213+0000","last_fullsized":"2024-01-30T08:08:49.063213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306470+0000","last_change":"2024-01-30T08:08:42.283427+0000","last_active":"2024-01-30T08:08:47.306470+0000","last_peered":"2024-01-30T08:08:47.306470+0000","last_clean":"2024-01-30T08:08:47.306470+0000","last_became_active":"2024-01-30T08:08:42.281444+0000","last_became_peered":"2024-01-30T08:08:42.281444+0000","last_unstale":"2024-01-30T08:08:47.306470+0000","last_undegraded":"2024-01-30T08:08:47.306470+0000","last_fullsized":"2024-01-30T08:08:47.306470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:42.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062249+0000","last_change":"2024-01-30T08:08:41.275140+0000","last_active":"2024-01-30T08:08:49.062249+0000","last_peered":"2024-01-30T08:08:49.062249+0000","last_clean":"2024-01-30T08:08:49.062249+0000","last_became_active":"2024-01-30T08:08:41.274851+0000","last_became_peered":"2024-01-30T08:08:41.274851+0000","last_unstale":"2024-01-30T08:08:49.062249+0000","last_undegraded":"2024-01-30T08:08:49.062249+0000","last_fullsized":"2024-01-30T08:08:49.062249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:40:25.984103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063589+0000","last_change":"2024-01-30T08:08:46.320651+0000","last_active":"2024-01-30T08:08:49.063589+0000","last_peered":"2024-01-30T08:08:49.063589+0000","last_clean":"2024-01-30T08:08:49.063589+0000","last_became_active":"2024-01-30T08:08:46.320138+0000","last_became_peered":"2024-01-30T08:08:46.320138+0000","last_unstale":"2024-01-30T08:08:49.063589+0000","last_undegraded":"2024-01-30T08:08:49.063589+0000","last_fullsized":"2024-01-30T08:08:49.063589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:08.547055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062056+0000","last_change":"2024-01-30T08:08:42.271482+0000","last_active":"2024-01-30T08:08:49.062056+0000","last_peered":"2024-01-30T08:08:49.062056+0000","last_clean":"2024-01-30T08:08:49.062056+0000","last_became_active":"2024-01-30T08:08:42.271232+0000","last_became_peered":"2024-01-30T08:08:42.271232+0000","last_unstale":"2024-01-30T08:08:49.062056+0000","last_undegraded":"2024-01-30T08:08:49.062056+0000","last_fullsized":"2024-01-30T08:08:49.062056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789511+0000","last_change":"2024-01-30T08:08:41.277419+0000","last_active":"2024-01-30T08:08:47.789511+0000","last_peered":"2024-01-30T08:08:47.789511+0000","last_clean":"2024-01-30T08:08:47.789511+0000","last_became_active":"2024-01-30T08:08:41.277104+0000","last_became_peered":"2024-01-30T08:08:41.277104+0000","last_unstale":"2024-01-30T08:08:47.789511+0000","last_undegraded":"2024-01-30T08:08:47.789511+0000","last_fullsized":"2024-01-30T08:08:47.789511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063871+0000","last_change":"2024-01-30T08:08:46.321512+0000","last_active":"2024-01-30T08:08:49.063871+0000","last_peered":"2024-01-30T08:08:49.063871+0000","last_clean":"2024-01-30T08:08:49.063871+0000","last_became_active":"2024-01-30T08:08:46.320112+0000","last_became_peered":"2024-01-30T08:08:46.320112+0000","last_unstale":"2024-01-30T08:08:49.063871+0000","last_undegraded":"2024-01-30T08:08:49.063871+0000","last_fullsized":"2024-01-30T08:08:49.063871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061695+0000","last_change":"2024-01-30T08:08:42.296060+0000","last_active":"2024-01-30T08:08:49.061695+0000","last_peered":"2024-01-30T08:08:49.061695+0000","last_clean":"2024-01-30T08:08:49.061695+0000","last_became_active":"2024-01-30T08:08:42.295753+0000","last_became_peered":"2024-01-30T08:08:42.295753+0000","last_unstale":"2024-01-30T08:08:49.061695+0000","last_undegraded":"2024-01-30T08:08:49.061695+0000","last_fullsized":"2024-01-30T08:08:49.061695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:29:48.979595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060657+0000","last_change":"2024-01-30T08:08:41.286271+0000","last_active":"2024-01-30T08:08:49.060657+0000","last_peered":"2024-01-30T08:08:49.060657+0000","last_clean":"2024-01-30T08:08:49.060657+0000","last_became_active":"2024-01-30T08:08:41.285958+0000","last_became_peered":"2024-01-30T08:08:41.285958+0000","last_unstale":"2024-01-30T08:08:49.060657+0000","last_undegraded":"2024-01-30T08:08:49.060657+0000","last_fullsized":"2024-01-30T08:08:49.060657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062773+0000","last_change":"2024-01-30T08:08:46.562368+0000","last_active":"2024-01-30T08:08:49.062773+0000","last_peered":"2024-01-30T08:08:49.062773+0000","last_clean":"2024-01-30T08:08:49.062773+0000","last_became_active":"2024-01-30T08:08:46.561511+0000","last_became_peered":"2024-01-30T08:08:46.561511+0000","last_unstale":"2024-01-30T08:08:49.062773+0000","last_undegraded":"2024-01-30T08:08:49.062773+0000","last_fullsized":"2024-01-30T08:08:49.062773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:55.340433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305463+0000","last_change":"2024-01-30T08:08:42.284518+0000","last_active":"2024-01-30T08:08:47.305463+0000","last_peered":"2024-01-30T08:08:47.305463+0000","last_clean":"2024-01-30T08:08:47.305463+0000","last_became_active":"2024-01-30T08:08:42.284043+0000","last_became_peered":"2024-01-30T08:08:42.284043+0000","last_unstale":"2024-01-30T08:08:47.305463+0000","last_undegraded":"2024-01-30T08:08:47.305463+0000","last_fullsized":"2024-01-30T08:08:47.305463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061950+0000","last_change":"2024-01-30T08:08:41.280995+0000","last_active":"2024-01-30T08:08:49.061950+0000","last_peered":"2024-01-30T08:08:49.061950+0000","last_clean":"2024-01-30T08:08:49.061950+0000","last_became_active":"2024-01-30T08:08:41.280455+0000","last_became_peered":"2024-01-30T08:08:41.280455+0000","last_unstale":"2024-01-30T08:08:49.061950+0000","last_undegraded":"2024-01-30T08:08:49.061950+0000","last_fullsized":"2024-01-30T08:08:49.061950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:29.471243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061322+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:08:49.061322+0000","last_peered":"2024-01-30T08:08:49.061322+0000","last_clean":"2024-01-30T08:08:49.061322+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:08:49.061322+0000","last_undegraded":"2024-01-30T08:08:49.061322+0000","last_fullsized":"2024-01-30T08:08:49.061322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307091+0000","last_change":"2024-01-30T08:08:46.565243+0000","last_active":"2024-01-30T08:08:47.307091+0000","last_peered":"2024-01-30T08:08:47.307091+0000","last_clean":"2024-01-30T08:08:47.307091+0000","last_became_active":"2024-01-30T08:08:46.564876+0000","last_became_peered":"2024-01-30T08:08:46.564876+0000","last_unstale":"2024-01-30T08:08:47.307091+0000","last_undegraded":"2024-01-30T08:08:47.307091+0000","last_fullsized":"2024-01-30T08:08:47.307091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061006+0000","last_change":"2024-01-30T08:08:42.296681+0000","last_active":"2024-01-30T08:08:49.061006+0000","last_peered":"2024-01-30T08:08:49.061006+0000","last_clean":"2024-01-30T08:08:49.061006+0000","last_became_active":"2024-01-30T08:08:42.296349+0000","last_became_peered":"2024-01-30T08:08:42.296349+0000","last_unstale":"2024-01-30T08:08:49.061006+0000","last_undegraded":"2024-01-30T08:08:49.061006+0000","last_fullsized":"2024-01-30T08:08:49.061006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:35.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789843+0000","last_change":"2024-01-30T08:08:41.288774+0000","last_active":"2024-01-30T08:08:47.789843+0000","last_peered":"2024-01-30T08:08:47.789843+0000","last_clean":"2024-01-30T08:08:47.789843+0000","last_became_active":"2024-01-30T08:08:41.288519+0000","last_became_peered":"2024-01-30T08:08:41.288519+0000","last_unstale":"2024-01-30T08:08:47.789843+0000","last_undegraded":"2024-01-30T08:08:47.789843+0000","last_fullsized":"2024-01-30T08:08:47.789843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305155+0000","last_change":"2024-01-30T08:08:46.560657+0000","last_active":"2024-01-30T08:08:47.305155+0000","last_peered":"2024-01-30T08:08:47.305155+0000","last_clean":"2024-01-30T08:08:47.305155+0000","last_became_active":"2024-01-30T08:08:46.559970+0000","last_became_peered":"2024-01-30T08:08:46.559970+0000","last_unstale":"2024-01-30T08:08:47.305155+0000","last_undegraded":"2024-01-30T08:08:47.305155+0000","last_fullsized":"2024-01-30T08:08:47.305155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062304+0000","last_change":"2024-01-30T08:08:42.290969+0000","last_active":"2024-01-30T08:08:49.062304+0000","last_peered":"2024-01-30T08:08:49.062304+0000","last_clean":"2024-01-30T08:08:49.062304+0000","last_became_active":"2024-01-30T08:08:42.290605+0000","last_became_peered":"2024-01-30T08:08:42.290605+0000","last_unstale":"2024-01-30T08:08:49.062304+0000","last_undegraded":"2024-01-30T08:08:49.062304+0000","last_fullsized":"2024-01-30T08:08:49.062304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:47:41.957325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063753+0000","last_change":"2024-01-30T08:08:41.283051+0000","last_active":"2024-01-30T08:08:49.063753+0000","last_peered":"2024-01-30T08:08:49.063753+0000","last_clean":"2024-01-30T08:08:49.063753+0000","last_became_active":"2024-01-30T08:08:41.282773+0000","last_became_peered":"2024-01-30T08:08:41.282773+0000","last_unstale":"2024-01-30T08:08:49.063753+0000","last_undegraded":"2024-01-30T08:08:49.063753+0000","last_fullsized":"2024-01-30T08:08:49.063753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062287+0000","last_change":"2024-01-30T08:08:46.311779+0000","last_active":"2024-01-30T08:08:49.062287+0000","last_peered":"2024-01-30T08:08:49.062287+0000","last_clean":"2024-01-30T08:08:49.062287+0000","last_became_active":"2024-01-30T08:08:46.311314+0000","last_became_peered":"2024-01-30T08:08:46.311314+0000","last_unstale":"2024-01-30T08:08:49.062287+0000","last_undegraded":"2024-01-30T08:08:49.062287+0000","last_fullsized":"2024-01-30T08:08:49.062287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:02.056713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061327+0000","last_change":"2024-01-30T08:08:42.305456+0000","last_active":"2024-01-30T08:08:49.061327+0000","last_peered":"2024-01-30T08:08:49.061327+0000","last_clean":"2024-01-30T08:08:49.061327+0000","last_became_active":"2024-01-30T08:08:42.305210+0000","last_became_peered":"2024-01-30T08:08:42.305210+0000","last_unstale":"2024-01-30T08:08:49.061327+0000","last_undegraded":"2024-01-30T08:08:49.061327+0000","last_fullsized":"2024-01-30T08:08:49.061327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:49.726372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789981+0000","last_change":"2024-01-30T08:08:41.267098+0000","last_active":"2024-01-30T08:08:47.789981+0000","last_peered":"2024-01-30T08:08:47.789981+0000","last_clean":"2024-01-30T08:08:47.789981+0000","last_became_active":"2024-01-30T08:08:41.266760+0000","last_became_peered":"2024-01-30T08:08:41.266760+0000","last_unstale":"2024-01-30T08:08:47.789981+0000","last_undegraded":"2024-01-30T08:08:47.789981+0000","last_fullsized":"2024-01-30T08:08:47.789981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060608+0000","last_change":"2024-01-30T08:08:46.564824+0000","last_active":"2024-01-30T08:08:49.060608+0000","last_peered":"2024-01-30T08:08:49.060608+0000","last_clean":"2024-01-30T08:08:49.060608+0000","last_became_active":"2024-01-30T08:08:46.564330+0000","last_became_peered":"2024-01-30T08:08:46.564330+0000","last_unstale":"2024-01-30T08:08:49.060608+0000","last_undegraded":"2024-01-30T08:08:49.060608+0000","last_fullsized":"2024-01-30T08:08:49.060608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:30:28.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061676+0000","last_change":"2024-01-30T08:08:42.305183+0000","last_active":"2024-01-30T08:08:49.061676+0000","last_peered":"2024-01-30T08:08:49.061676+0000","last_clean":"2024-01-30T08:08:49.061676+0000","last_became_active":"2024-01-30T08:08:42.304786+0000","last_became_peered":"2024-01-30T08:08:42.304786+0000","last_unstale":"2024-01-30T08:08:49.061676+0000","last_undegraded":"2024-01-30T08:08:49.061676+0000","last_fullsized":"2024-01-30T08:08:49.061676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:14.376017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305702+0000","last_change":"2024-01-30T08:08:41.277848+0000","last_active":"2024-01-30T08:08:47.305702+0000","last_peered":"2024-01-30T08:08:47.305702+0000","last_clean":"2024-01-30T08:08:47.305702+0000","last_became_active":"2024-01-30T08:08:41.276589+0000","last_became_peered":"2024-01-30T08:08:41.276589+0000","last_unstale":"2024-01-30T08:08:47.305702+0000","last_undegraded":"2024-01-30T08:08:47.305702+0000","last_fullsized":"2024-01-30T08:08:47.305702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305158+0000","last_change":"2024-01-30T08:08:46.307894+0000","last_active":"2024-01-30T08:08:47.305158+0000","last_peered":"2024-01-30T08:08:47.305158+0000","last_clean":"2024-01-30T08:08:47.305158+0000","last_became_active":"2024-01-30T08:08:46.307456+0000","last_became_peered":"2024-01-30T08:08:46.307456+0000","last_unstale":"2024-01-30T08:08:47.305158+0000","last_undegraded":"2024-01-30T08:08:47.305158+0000","last_fullsized":"2024-01-30T08:08:47.305158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:29.212048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060944+0000","last_change":"2024-01-30T08:08:42.300225+0000","last_active":"2024-01-30T08:08:49.060944+0000","last_peered":"2024-01-30T08:08:49.060944+0000","last_clean":"2024-01-30T08:08:49.060944+0000","last_became_active":"2024-01-30T08:08:42.299982+0000","last_became_peered":"2024-01-30T08:08:42.299982+0000","last_unstale":"2024-01-30T08:08:49.060944+0000","last_undegraded":"2024-01-30T08:08:49.060944+0000","last_fullsized":"2024-01-30T08:08:49.060944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789401+0000","last_change":"2024-01-30T08:08:41.281155+0000","last_active":"2024-01-30T08:08:47.789401+0000","last_peered":"2024-01-30T08:08:47.789401+0000","last_clean":"2024-01-30T08:08:47.789401+0000","last_became_active":"2024-01-30T08:08:41.280684+0000","last_became_peered":"2024-01-30T08:08:41.280684+0000","last_unstale":"2024-01-30T08:08:47.789401+0000","last_undegraded":"2024-01-30T08:08:47.789401+0000","last_fullsized":"2024-01-30T08:08:47.789401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062626+0000","last_change":"2024-01-30T08:08:46.312867+0000","last_active":"2024-01-30T08:08:49.062626+0000","last_peered":"2024-01-30T08:08:49.062626+0000","last_clean":"2024-01-30T08:08:49.062626+0000","last_became_active":"2024-01-30T08:08:46.312450+0000","last_became_peered":"2024-01-30T08:08:46.312450+0000","last_unstale":"2024-01-30T08:08:49.062626+0000","last_undegraded":"2024-01-30T08:08:49.062626+0000","last_fullsized":"2024-01-30T08:08:49.062626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:01.538569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305554+0000","last_change":"2024-01-30T08:08:42.277590+0000","last_active":"2024-01-30T08:08:47.305554+0000","last_peered":"2024-01-30T08:08:47.305554+0000","last_clean":"2024-01-30T08:08:47.305554+0000","last_became_active":"2024-01-30T08:08:42.277197+0000","last_became_peered":"2024-01-30T08:08:42.277197+0000","last_unstale":"2024-01-30T08:08:47.305554+0000","last_undegraded":"2024-01-30T08:08:47.305554+0000","last_fullsized":"2024-01-30T08:08:47.305554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305769+0000","last_change":"2024-01-30T08:08:41.282399+0000","last_active":"2024-01-30T08:08:47.305769+0000","last_peered":"2024-01-30T08:08:47.305769+0000","last_clean":"2024-01-30T08:08:47.305769+0000","last_became_active":"2024-01-30T08:08:41.282056+0000","last_became_peered":"2024-01-30T08:08:41.282056+0000","last_unstale":"2024-01-30T08:08:47.305769+0000","last_undegraded":"2024-01-30T08:08:47.305769+0000","last_fullsized":"2024-01-30T08:08:47.305769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306153+0000","last_change":"2024-01-30T08:08:46.564745+0000","last_active":"2024-01-30T08:08:47.306153+0000","last_peered":"2024-01-30T08:08:47.306153+0000","last_clean":"2024-01-30T08:08:47.306153+0000","last_became_active":"2024-01-30T08:08:46.562228+0000","last_became_peered":"2024-01-30T08:08:46.562228+0000","last_unstale":"2024-01-30T08:08:47.306153+0000","last_undegraded":"2024-01-30T08:08:47.306153+0000","last_fullsized":"2024-01-30T08:08:47.306153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:13.466128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061539+0000","last_change":"2024-01-30T08:08:42.305622+0000","last_active":"2024-01-30T08:08:49.061539+0000","last_peered":"2024-01-30T08:08:49.061539+0000","last_clean":"2024-01-30T08:08:49.061539+0000","last_became_active":"2024-01-30T08:08:42.305341+0000","last_became_peered":"2024-01-30T08:08:42.305341+0000","last_unstale":"2024-01-30T08:08:49.061539+0000","last_undegraded":"2024-01-30T08:08:49.061539+0000","last_fullsized":"2024-01-30T08:08:49.061539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062120+0000","last_change":"2024-01-30T08:08:41.283528+0000","last_active":"2024-01-30T08:08:49.062120+0000","last_peered":"2024-01-30T08:08:49.062120+0000","last_clean":"2024-01-30T08:08:49.062120+0000","last_became_active":"2024-01-30T08:08:41.283251+0000","last_became_peered":"2024-01-30T08:08:41.283251+0000","last_unstale":"2024-01-30T08:08:49.062120+0000","last_undegraded":"2024-01-30T08:08:49.062120+0000","last_fullsized":"2024-01-30T08:08:49.062120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:48:28.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306255+0000","last_change":"2024-01-30T08:08:46.562419+0000","last_active":"2024-01-30T08:08:47.306255+0000","last_peered":"2024-01-30T08:08:47.306255+0000","last_clean":"2024-01-30T08:08:47.306255+0000","last_became_active":"2024-01-30T08:08:46.562016+0000","last_became_peered":"2024-01-30T08:08:46.562016+0000","last_unstale":"2024-01-30T08:08:47.306255+0000","last_undegraded":"2024-01-30T08:08:47.306255+0000","last_fullsized":"2024-01-30T08:08:47.306255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:52.532600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061999+0000","last_change":"2024-01-30T08:08:42.286331+0000","last_active":"2024-01-30T08:08:49.061999+0000","last_peered":"2024-01-30T08:08:49.061999+0000","last_clean":"2024-01-30T08:08:49.061999+0000","last_became_active":"2024-01-30T08:08:42.286070+0000","last_became_peered":"2024-01-30T08:08:42.286070+0000","last_unstale":"2024-01-30T08:08:49.061999+0000","last_undegraded":"2024-01-30T08:08:49.061999+0000","last_fullsized":"2024-01-30T08:08:49.061999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:49:29.159312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062387+0000","last_change":"2024-01-30T08:08:41.279978+0000","last_active":"2024-01-30T08:08:49.062387+0000","last_peered":"2024-01-30T08:08:49.062387+0000","last_clean":"2024-01-30T08:08:49.062387+0000","last_became_active":"2024-01-30T08:08:41.279673+0000","last_became_peered":"2024-01-30T08:08:41.279673+0000","last_unstale":"2024-01-30T08:08:49.062387+0000","last_undegraded":"2024-01-30T08:08:49.062387+0000","last_fullsized":"2024-01-30T08:08:49.062387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:24.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062307+0000","last_change":"2024-01-30T08:08:46.561776+0000","last_active":"2024-01-30T08:08:49.062307+0000","last_peered":"2024-01-30T08:08:49.062307+0000","last_clean":"2024-01-30T08:08:49.062307+0000","last_became_active":"2024-01-30T08:08:46.561227+0000","last_became_peered":"2024-01-30T08:08:46.561227+0000","last_unstale":"2024-01-30T08:08:49.062307+0000","last_undegraded":"2024-01-30T08:08:49.062307+0000","last_fullsized":"2024-01-30T08:08:49.062307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:07.684344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060787+0000","last_change":"2024-01-30T08:08:42.289925+0000","last_active":"2024-01-30T08:08:49.060787+0000","last_peered":"2024-01-30T08:08:49.060787+0000","last_clean":"2024-01-30T08:08:49.060787+0000","last_became_active":"2024-01-30T08:08:42.289634+0000","last_became_peered":"2024-01-30T08:08:42.289634+0000","last_unstale":"2024-01-30T08:08:49.060787+0000","last_undegraded":"2024-01-30T08:08:49.060787+0000","last_fullsized":"2024-01-30T08:08:49.060787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:57.307398+0000","last_change":"2024-01-30T08:08:41.274369+0000","last_active":"2024-01-30T08:08:57.307398+0000","last_peered":"2024-01-30T08:08:57.307398+0000","last_clean":"2024-01-30T08:08:57.307398+0000","last_became_active":"2024-01-30T08:08:41.274054+0000","last_became_peered":"2024-01-30T08:08:41.274054+0000","last_unstale":"2024-01-30T08:08:57.307398+0000","last_undegraded":"2024-01-30T08:08:57.307398+0000","last_fullsized":"2024-01-30T08:08:57.307398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063316+0000","last_change":"2024-01-30T08:08:46.309278+0000","last_active":"2024-01-30T08:08:49.063316+0000","last_peered":"2024-01-30T08:08:49.063316+0000","last_clean":"2024-01-30T08:08:49.063316+0000","last_became_active":"2024-01-30T08:08:46.308827+0000","last_became_peered":"2024-01-30T08:08:46.308827+0000","last_unstale":"2024-01-30T08:08:49.063316+0000","last_undegraded":"2024-01-30T08:08:49.063316+0000","last_fullsized":"2024-01-30T08:08:49.063316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:18.404996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306375+0000","last_change":"2024-01-30T08:08:42.295489+0000","last_active":"2024-01-30T08:08:47.306375+0000","last_peered":"2024-01-30T08:08:47.306375+0000","last_clean":"2024-01-30T08:08:47.306375+0000","last_became_active":"2024-01-30T08:08:42.295174+0000","last_became_peered":"2024-01-30T08:08:42.295174+0000","last_unstale":"2024-01-30T08:08:47.306375+0000","last_undegraded":"2024-01-30T08:08:47.306375+0000","last_fullsized":"2024-01-30T08:08:47.306375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:45.352887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063672+0000","last_change":"2024-01-30T08:08:41.285933+0000","last_active":"2024-01-30T08:08:49.063672+0000","last_peered":"2024-01-30T08:08:49.063672+0000","last_clean":"2024-01-30T08:08:49.063672+0000","last_became_active":"2024-01-30T08:08:41.285666+0000","last_became_peered":"2024-01-30T08:08:41.285666+0000","last_unstale":"2024-01-30T08:08:49.063672+0000","last_undegraded":"2024-01-30T08:08:49.063672+0000","last_fullsized":"2024-01-30T08:08:49.063672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306259+0000","last_change":"2024-01-30T08:08:46.309394+0000","last_active":"2024-01-30T08:08:47.306259+0000","last_peered":"2024-01-30T08:08:47.306259+0000","last_clean":"2024-01-30T08:08:47.306259+0000","last_became_active":"2024-01-30T08:08:46.308580+0000","last_became_peered":"2024-01-30T08:08:46.308580+0000","last_unstale":"2024-01-30T08:08:47.306259+0000","last_undegraded":"2024-01-30T08:08:47.306259+0000","last_fullsized":"2024-01-30T08:08:47.306259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062825+0000","last_change":"2024-01-30T08:08:42.278568+0000","last_active":"2024-01-30T08:08:49.062825+0000","last_peered":"2024-01-30T08:08:49.062825+0000","last_clean":"2024-01-30T08:08:49.062825+0000","last_became_active":"2024-01-30T08:08:42.278276+0000","last_became_peered":"2024-01-30T08:08:42.278276+0000","last_unstale":"2024-01-30T08:08:49.062825+0000","last_undegraded":"2024-01-30T08:08:49.062825+0000","last_fullsized":"2024-01-30T08:08:49.062825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:58:32.360625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062543+0000","last_change":"2024-01-30T08:08:41.282653+0000","last_active":"2024-01-30T08:08:49.062543+0000","last_peered":"2024-01-30T08:08:49.062543+0000","last_clean":"2024-01-30T08:08:49.062543+0000","last_became_active":"2024-01-30T08:08:41.282366+0000","last_became_peered":"2024-01-30T08:08:41.282366+0000","last_unstale":"2024-01-30T08:08:49.062543+0000","last_undegraded":"2024-01-30T08:08:49.062543+0000","last_fullsized":"2024-01-30T08:08:49.062543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:46:13.875970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305335+0000","last_change":"2024-01-30T08:08:46.315140+0000","last_active":"2024-01-30T08:08:47.305335+0000","last_peered":"2024-01-30T08:08:47.305335+0000","last_clean":"2024-01-30T08:08:47.305335+0000","last_became_active":"2024-01-30T08:08:46.314739+0000","last_became_peered":"2024-01-30T08:08:46.314739+0000","last_unstale":"2024-01-30T08:08:47.305335+0000","last_undegraded":"2024-01-30T08:08:47.305335+0000","last_fullsized":"2024-01-30T08:08:47.305335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:44:48.427798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062325+0000","last_change":"2024-01-30T08:08:42.291387+0000","last_active":"2024-01-30T08:08:49.062325+0000","last_peered":"2024-01-30T08:08:49.062325+0000","last_clean":"2024-01-30T08:08:49.062325+0000","last_became_active":"2024-01-30T08:08:42.290925+0000","last_became_peered":"2024-01-30T08:08:42.290925+0000","last_unstale":"2024-01-30T08:08:49.062325+0000","last_undegraded":"2024-01-30T08:08:49.062325+0000","last_fullsized":"2024-01-30T08:08:49.062325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:18:35.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307293+0000","last_change":"2024-01-30T08:08:41.287404+0000","last_active":"2024-01-30T08:08:47.307293+0000","last_peered":"2024-01-30T08:08:47.307293+0000","last_clean":"2024-01-30T08:08:47.307293+0000","last_became_active":"2024-01-30T08:08:41.287106+0000","last_became_peered":"2024-01-30T08:08:41.287106+0000","last_unstale":"2024-01-30T08:08:47.307293+0000","last_undegraded":"2024-01-30T08:08:47.307293+0000","last_fullsized":"2024-01-30T08:08:47.307293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305221+0000","last_change":"2024-01-30T08:08:46.565452+0000","last_active":"2024-01-30T08:08:47.305221+0000","last_peered":"2024-01-30T08:08:47.305221+0000","last_clean":"2024-01-30T08:08:47.305221+0000","last_became_active":"2024-01-30T08:08:46.564941+0000","last_became_peered":"2024-01-30T08:08:46.564941+0000","last_unstale":"2024-01-30T08:08:47.305221+0000","last_undegraded":"2024-01-30T08:08:47.305221+0000","last_fullsized":"2024-01-30T08:08:47.305221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:02:06.216545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062488+0000","last_change":"2024-01-30T08:08:46.561905+0000","last_active":"2024-01-30T08:08:49.062488+0000","last_peered":"2024-01-30T08:08:49.062488+0000","last_clean":"2024-01-30T08:08:49.062488+0000","last_became_active":"2024-01-30T08:08:46.561585+0000","last_became_peered":"2024-01-30T08:08:46.561585+0000","last_unstale":"2024-01-30T08:08:49.062488+0000","last_undegraded":"2024-01-30T08:08:49.062488+0000","last_fullsized":"2024-01-30T08:08:49.062488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:30.023145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061874+0000","last_change":"2024-01-30T08:08:42.268086+0000","last_active":"2024-01-30T08:08:49.061874+0000","last_peered":"2024-01-30T08:08:49.061874+0000","last_clean":"2024-01-30T08:08:49.061874+0000","last_became_active":"2024-01-30T08:08:42.267843+0000","last_became_peered":"2024-01-30T08:08:42.267843+0000","last_unstale":"2024-01-30T08:08:49.061874+0000","last_undegraded":"2024-01-30T08:08:49.061874+0000","last_fullsized":"2024-01-30T08:08:49.061874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060969+0000","last_change":"2024-01-30T08:08:41.286334+0000","last_active":"2024-01-30T08:08:49.060969+0000","last_peered":"2024-01-30T08:08:49.060969+0000","last_clean":"2024-01-30T08:08:49.060969+0000","last_became_active":"2024-01-30T08:08:41.286076+0000","last_became_peered":"2024-01-30T08:08:41.286076+0000","last_unstale":"2024-01-30T08:08:49.060969+0000","last_undegraded":"2024-01-30T08:08:49.060969+0000","last_fullsized":"2024-01-30T08:08:49.060969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:28:13.810152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307178+0000","last_change":"2024-01-30T08:08:46.310557+0000","last_active":"2024-01-30T08:08:47.307178+0000","last_peered":"2024-01-30T08:08:47.307178+0000","last_clean":"2024-01-30T08:08:47.307178+0000","last_became_active":"2024-01-30T08:08:46.310122+0000","last_became_peered":"2024-01-30T08:08:46.310122+0000","last_unstale":"2024-01-30T08:08:47.307178+0000","last_undegraded":"2024-01-30T08:08:47.307178+0000","last_fullsized":"2024-01-30T08:08:47.307178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305285+0000","last_change":"2024-01-30T08:08:42.287557+0000","last_active":"2024-01-30T08:08:47.305285+0000","last_peered":"2024-01-30T08:08:47.305285+0000","last_clean":"2024-01-30T08:08:47.305285+0000","last_became_active":"2024-01-30T08:08:42.287258+0000","last_became_peered":"2024-01-30T08:08:42.287258+0000","last_unstale":"2024-01-30T08:08:47.305285+0000","last_undegraded":"2024-01-30T08:08:47.305285+0000","last_fullsized":"2024-01-30T08:08:47.305285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305479+0000","last_change":"2024-01-30T08:08:41.275268+0000","last_active":"2024-01-30T08:08:47.305479+0000","last_peered":"2024-01-30T08:08:47.305479+0000","last_clean":"2024-01-30T08:08:47.305479+0000","last_became_active":"2024-01-30T08:08:41.274599+0000","last_became_peered":"2024-01-30T08:08:41.274599+0000","last_unstale":"2024-01-30T08:08:47.305479+0000","last_undegraded":"2024-01-30T08:08:47.305479+0000","last_fullsized":"2024-01-30T08:08:47.305479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306322+0000","last_change":"2024-01-30T08:08:41.278792+0000","last_active":"2024-01-30T08:08:47.306322+0000","last_peered":"2024-01-30T08:08:47.306322+0000","last_clean":"2024-01-30T08:08:47.306322+0000","last_became_active":"2024-01-30T08:08:41.278539+0000","last_became_peered":"2024-01-30T08:08:41.278539+0000","last_unstale":"2024-01-30T08:08:47.306322+0000","last_undegraded":"2024-01-30T08:08:47.306322+0000","last_fullsized":"2024-01-30T08:08:47.306322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062352+0000","last_change":"2024-01-30T08:08:42.297069+0000","last_active":"2024-01-30T08:08:49.062352+0000","last_peered":"2024-01-30T08:08:49.062352+0000","last_clean":"2024-01-30T08:08:49.062352+0000","last_became_active":"2024-01-30T08:08:42.296723+0000","last_became_peered":"2024-01-30T08:08:42.296723+0000","last_unstale":"2024-01-30T08:08:49.062352+0000","last_undegraded":"2024-01-30T08:08:49.062352+0000","last_fullsized":"2024-01-30T08:08:49.062352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789787+0000","last_change":"2024-01-30T08:08:46.310759+0000","last_active":"2024-01-30T08:08:47.789787+0000","last_peered":"2024-01-30T08:08:47.789787+0000","last_clean":"2024-01-30T08:08:47.789787+0000","last_became_active":"2024-01-30T08:08:46.310380+0000","last_became_peered":"2024-01-30T08:08:46.310380+0000","last_unstale":"2024-01-30T08:08:47.789787+0000","last_undegraded":"2024-01-30T08:08:47.789787+0000","last_fullsized":"2024-01-30T08:08:47.789787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:24.682030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305625+0000","last_change":"2024-01-30T08:08:41.283970+0000","last_active":"2024-01-30T08:08:47.305625+0000","last_peered":"2024-01-30T08:08:47.305625+0000","last_clean":"2024-01-30T08:08:47.305625+0000","last_became_active":"2024-01-30T08:08:41.283694+0000","last_became_peered":"2024-01-30T08:08:41.283694+0000","last_unstale":"2024-01-30T08:08:47.305625+0000","last_undegraded":"2024-01-30T08:08:47.305625+0000","last_fullsized":"2024-01-30T08:08:47.305625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:41:46.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306325+0000","last_change":"2024-01-30T08:08:42.274162+0000","last_active":"2024-01-30T08:08:47.306325+0000","last_peered":"2024-01-30T08:08:47.306325+0000","last_clean":"2024-01-30T08:08:47.306325+0000","last_became_active":"2024-01-30T08:08:42.273902+0000","last_became_peered":"2024-01-30T08:08:42.273902+0000","last_unstale":"2024-01-30T08:08:47.306325+0000","last_undegraded":"2024-01-30T08:08:47.306325+0000","last_fullsized":"2024-01-30T08:08:47.306325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:53.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305982+0000","last_change":"2024-01-30T08:08:46.314987+0000","last_active":"2024-01-30T08:08:47.305982+0000","last_peered":"2024-01-30T08:08:47.305982+0000","last_clean":"2024-01-30T08:08:47.305982+0000","last_became_active":"2024-01-30T08:08:46.314692+0000","last_became_peered":"2024-01-30T08:08:46.314692+0000","last_unstale":"2024-01-30T08:08:47.305982+0000","last_undegraded":"2024-01-30T08:08:47.305982+0000","last_fullsized":"2024-01-30T08:08:47.305982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:49:27.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305354+0000","last_change":"2024-01-30T08:08:42.282230+0000","last_active":"2024-01-30T08:08:47.305354+0000","last_peered":"2024-01-30T08:08:47.305354+0000","last_clean":"2024-01-30T08:08:47.305354+0000","last_became_active":"2024-01-30T08:08:42.281857+0000","last_became_peered":"2024-01-30T08:08:42.281857+0000","last_unstale":"2024-01-30T08:08:47.305354+0000","last_undegraded":"2024-01-30T08:08:47.305354+0000","last_fullsized":"2024-01-30T08:08:47.305354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789483+0000","last_change":"2024-01-30T08:08:42.272404+0000","last_active":"2024-01-30T08:08:47.789483+0000","last_peered":"2024-01-30T08:08:47.789483+0000","last_clean":"2024-01-30T08:08:47.789483+0000","last_became_active":"2024-01-30T08:08:42.272041+0000","last_became_peered":"2024-01-30T08:08:42.272041+0000","last_unstale":"2024-01-30T08:08:47.789483+0000","last_undegraded":"2024-01-30T08:08:47.789483+0000","last_fullsized":"2024-01-30T08:08:47.789483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:50.188325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062098+0000","last_change":"2024-01-30T08:08:42.288942+0000","last_active":"2024-01-30T08:08:49.062098+0000","last_peered":"2024-01-30T08:08:49.062098+0000","last_clean":"2024-01-30T08:08:49.062098+0000","last_became_active":"2024-01-30T08:08:42.288707+0000","last_became_peered":"2024-01-30T08:08:42.288707+0000","last_unstale":"2024-01-30T08:08:49.062098+0000","last_undegraded":"2024-01-30T08:08:49.062098+0000","last_fullsized":"2024-01-30T08:08:49.062098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:51:37.937923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062259+0000","last_change":"2024-01-30T08:08:42.286293+0000","last_active":"2024-01-30T08:08:49.062259+0000","last_peered":"2024-01-30T08:08:49.062259+0000","last_clean":"2024-01-30T08:08:49.062259+0000","last_became_active":"2024-01-30T08:08:42.285945+0000","last_became_peered":"2024-01-30T08:08:42.285945+0000","last_unstale":"2024-01-30T08:08:49.062259+0000","last_undegraded":"2024-01-30T08:08:49.062259+0000","last_fullsized":"2024-01-30T08:08:49.062259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:54:46.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306359+0000","last_change":"2024-01-30T08:08:42.288572+0000","last_active":"2024-01-30T08:08:47.306359+0000","last_peered":"2024-01-30T08:08:47.306359+0000","last_clean":"2024-01-30T08:08:47.306359+0000","last_became_active":"2024-01-30T08:08:42.288269+0000","last_became_peered":"2024-01-30T08:08:42.288269+0000","last_unstale":"2024-01-30T08:08:47.306359+0000","last_undegraded":"2024-01-30T08:08:47.306359+0000","last_fullsized":"2024-01-30T08:08:47.306359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063564+0000","last_change":"2024-01-30T08:08:42.266640+0000","last_active":"2024-01-30T08:08:49.063564+0000","last_peered":"2024-01-30T08:08:49.063564+0000","last_clean":"2024-01-30T08:08:49.063564+0000","last_became_active":"2024-01-30T08:08:42.266344+0000","last_became_peered":"2024-01-30T08:08:42.266344+0000","last_unstale":"2024-01-30T08:08:49.063564+0000","last_undegraded":"2024-01-30T08:08:49.063564+0000","last_fullsized":"2024-01-30T08:08:49.063564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307432+0000","last_change":"2024-01-30T08:08:42.292452+0000","last_active":"2024-01-30T08:08:47.307432+0000","last_peered":"2024-01-30T08:08:47.307432+0000","last_clean":"2024-01-30T08:08:47.307432+0000","last_became_active":"2024-01-30T08:08:42.291993+0000","last_became_peered":"2024-01-30T08:08:42.291993+0000","last_unstale":"2024-01-30T08:08:47.307432+0000","last_undegraded":"2024-01-30T08:08:47.307432+0000","last_fullsized":"2024-01-30T08:08:47.307432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306131+0000","last_change":"2024-01-30T08:08:42.284303+0000","last_active":"2024-01-30T08:08:47.306131+0000","last_peered":"2024-01-30T08:08:47.306131+0000","last_clean":"2024-01-30T08:08:47.306131+0000","last_became_active":"2024-01-30T08:08:42.283629+0000","last_became_peered":"2024-01-30T08:08:42.283629+0000","last_unstale":"2024-01-30T08:08:47.306131+0000","last_undegraded":"2024-01-30T08:08:47.306131+0000","last_fullsized":"2024-01-30T08:08:47.306131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060891+0000","last_change":"2024-01-30T08:08:42.289085+0000","last_active":"2024-01-30T08:08:49.060891+0000","last_peered":"2024-01-30T08:08:49.060891+0000","last_clean":"2024-01-30T08:08:49.060891+0000","last_became_active":"2024-01-30T08:08:42.288819+0000","last_became_peered":"2024-01-30T08:08:42.288819+0000","last_unstale":"2024-01-30T08:08:49.060891+0000","last_undegraded":"2024-01-30T08:08:49.060891+0000","last_fullsized":"2024-01-30T08:08:49.060891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:25:34.589630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305290+0000","last_change":"2024-01-30T08:08:42.285165+0000","last_active":"2024-01-30T08:08:47.305290+0000","last_peered":"2024-01-30T08:08:47.305290+0000","last_clean":"2024-01-30T08:08:47.305290+0000","last_became_active":"2024-01-30T08:08:42.284761+0000","last_became_peered":"2024-01-30T08:08:42.284761+0000","last_unstale":"2024-01-30T08:08:47.305290+0000","last_undegraded":"2024-01-30T08:08:47.305290+0000","last_fullsized":"2024-01-30T08:08:47.305290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061938+0000","last_change":"2024-01-30T08:08:42.284896+0000","last_active":"2024-01-30T08:08:49.061938+0000","last_peered":"2024-01-30T08:08:49.061938+0000","last_clean":"2024-01-30T08:08:49.061938+0000","last_became_active":"2024-01-30T08:08:42.284608+0000","last_became_peered":"2024-01-30T08:08:42.284608+0000","last_unstale":"2024-01-30T08:08:49.061938+0000","last_undegraded":"2024-01-30T08:08:49.061938+0000","last_fullsized":"2024-01-30T08:08:49.061938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:02:49.552868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062131+0000","last_change":"2024-01-30T08:08:42.287556+0000","last_active":"2024-01-30T08:08:49.062131+0000","last_peered":"2024-01-30T08:08:49.062131+0000","last_clean":"2024-01-30T08:08:49.062131+0000","last_became_active":"2024-01-30T08:08:42.287220+0000","last_became_peered":"2024-01-30T08:08:42.287220+0000","last_unstale":"2024-01-30T08:08:49.062131+0000","last_undegraded":"2024-01-30T08:08:49.062131+0000","last_fullsized":"2024-01-30T08:08:49.062131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:26:23.553412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306921+0000","last_change":"2024-01-30T08:08:42.279526+0000","last_active":"2024-01-30T08:08:47.306921+0000","last_peered":"2024-01-30T08:08:47.306921+0000","last_clean":"2024-01-30T08:08:47.306921+0000","last_became_active":"2024-01-30T08:08:42.279278+0000","last_became_peered":"2024-01-30T08:08:42.279278+0000","last_unstale":"2024-01-30T08:08:47.306921+0000","last_undegraded":"2024-01-30T08:08:47.306921+0000","last_fullsized":"2024-01-30T08:08:47.306921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061442+0000","last_change":"2024-01-30T08:08:42.289284+0000","last_active":"2024-01-30T08:08:49.061442+0000","last_peered":"2024-01-30T08:08:49.061442+0000","last_clean":"2024-01-30T08:08:49.061442+0000","last_became_active":"2024-01-30T08:08:42.289033+0000","last_became_peered":"2024-01-30T08:08:42.289033+0000","last_unstale":"2024-01-30T08:08:49.061442+0000","last_undegraded":"2024-01-30T08:08:49.061442+0000","last_fullsized":"2024-01-30T08:08:49.061442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:50.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789921+0000","last_change":"2024-01-30T08:08:42.275565+0000","last_active":"2024-01-30T08:08:47.789921+0000","last_peered":"2024-01-30T08:08:47.789921+0000","last_clean":"2024-01-30T08:08:47.789921+0000","last_became_active":"2024-01-30T08:08:42.275279+0000","last_became_peered":"2024-01-30T08:08:42.275279+0000","last_unstale":"2024-01-30T08:08:47.789921+0000","last_undegraded":"2024-01-30T08:08:47.789921+0000","last_fullsized":"2024-01-30T08:08:47.789921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:19.520174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062744+0000","last_change":"2024-01-30T08:08:42.300035+0000","last_active":"2024-01-30T08:08:49.062744+0000","last_peered":"2024-01-30T08:08:49.062744+0000","last_clean":"2024-01-30T08:08:49.062744+0000","last_became_active":"2024-01-30T08:08:42.299735+0000","last_became_peered":"2024-01-30T08:08:42.299735+0000","last_unstale":"2024-01-30T08:08:49.062744+0000","last_undegraded":"2024-01-30T08:08:49.062744+0000","last_fullsized":"2024-01-30T08:08:49.062744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:16:58.027734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060796+0000","last_change":"2024-01-30T08:08:42.274180+0000","last_active":"2024-01-30T08:08:49.060796+0000","last_peered":"2024-01-30T08:08:49.060796+0000","last_clean":"2024-01-30T08:08:49.060796+0000","last_became_active":"2024-01-30T08:08:42.273798+0000","last_became_peered":"2024-01-30T08:08:42.273798+0000","last_unstale":"2024-01-30T08:08:49.060796+0000","last_undegraded":"2024-01-30T08:08:49.060796+0000","last_fullsized":"2024-01-30T08:08:49.060796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062221+0000","last_change":"2024-01-30T08:08:42.272239+0000","last_active":"2024-01-30T08:08:49.062221+0000","last_peered":"2024-01-30T08:08:49.062221+0000","last_clean":"2024-01-30T08:08:49.062221+0000","last_became_active":"2024-01-30T08:08:42.270429+0000","last_became_peered":"2024-01-30T08:08:42.270429+0000","last_unstale":"2024-01-30T08:08:49.062221+0000","last_undegraded":"2024-01-30T08:08:49.062221+0000","last_fullsized":"2024-01-30T08:08:49.062221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061945+0000","last_change":"2024-01-30T08:08:42.279383+0000","last_active":"2024-01-30T08:08:49.061945+0000","last_peered":"2024-01-30T08:08:49.061945+0000","last_clean":"2024-01-30T08:08:49.061945+0000","last_became_active":"2024-01-30T08:08:42.279081+0000","last_became_peered":"2024-01-30T08:08:42.279081+0000","last_unstale":"2024-01-30T08:08:49.061945+0000","last_undegraded":"2024-01-30T08:08:49.061945+0000","last_fullsized":"2024-01-30T08:08:49.061945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:11:44.572777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305417+0000","last_change":"2024-01-30T08:08:42.277550+0000","last_active":"2024-01-30T08:08:47.305417+0000","last_peered":"2024-01-30T08:08:47.305417+0000","last_clean":"2024-01-30T08:08:47.305417+0000","last_became_active":"2024-01-30T08:08:42.276237+0000","last_became_peered":"2024-01-30T08:08:42.276237+0000","last_unstale":"2024-01-30T08:08:47.305417+0000","last_undegraded":"2024-01-30T08:08:47.305417+0000","last_fullsized":"2024-01-30T08:08:47.305417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306274+0000","last_change":"2024-01-30T08:08:42.282127+0000","last_active":"2024-01-30T08:08:47.306274+0000","last_peered":"2024-01-30T08:08:47.306274+0000","last_clean":"2024-01-30T08:08:47.306274+0000","last_became_active":"2024-01-30T08:08:42.281546+0000","last_became_peered":"2024-01-30T08:08:42.281546+0000","last_unstale":"2024-01-30T08:08:47.306274+0000","last_undegraded":"2024-01-30T08:08:47.306274+0000","last_fullsized":"2024-01-30T08:08:47.306274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:48.497646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307235+0000","last_change":"2024-01-30T08:08:42.280580+0000","last_active":"2024-01-30T08:08:47.307235+0000","last_peered":"2024-01-30T08:08:47.307235+0000","last_clean":"2024-01-30T08:08:47.307235+0000","last_became_active":"2024-01-30T08:08:42.280215+0000","last_became_peered":"2024-01-30T08:08:42.280215+0000","last_unstale":"2024-01-30T08:08:47.307235+0000","last_undegraded":"2024-01-30T08:08:47.307235+0000","last_fullsized":"2024-01-30T08:08:47.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307392+0000","last_change":"2024-01-30T08:08:42.274307+0000","last_active":"2024-01-30T08:08:47.307392+0000","last_peered":"2024-01-30T08:08:47.307392+0000","last_clean":"2024-01-30T08:08:47.307392+0000","last_became_active":"2024-01-30T08:08:42.273219+0000","last_became_peered":"2024-01-30T08:08:42.273219+0000","last_unstale":"2024-01-30T08:08:47.307392+0000","last_undegraded":"2024-01-30T08:08:47.307392+0000","last_fullsized":"2024-01-30T08:08:47.307392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061291+0000","last_change":"2024-01-30T08:08:42.298549+0000","last_active":"2024-01-30T08:08:49.061291+0000","last_peered":"2024-01-30T08:08:49.061291+0000","last_clean":"2024-01-30T08:08:49.061291+0000","last_became_active":"2024-01-30T08:08:42.298085+0000","last_became_peered":"2024-01-30T08:08:42.298085+0000","last_unstale":"2024-01-30T08:08:49.061291+0000","last_undegraded":"2024-01-30T08:08:49.061291+0000","last_fullsized":"2024-01-30T08:08:49.061291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:04.518076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305168+0000","last_change":"2024-01-30T08:08:42.278935+0000","last_active":"2024-01-30T08:08:47.305168+0000","last_peered":"2024-01-30T08:08:47.305168+0000","last_clean":"2024-01-30T08:08:47.305168+0000","last_became_active":"2024-01-30T08:08:42.278462+0000","last_became_peered":"2024-01-30T08:08:42.278462+0000","last_unstale":"2024-01-30T08:08:47.305168+0000","last_undegraded":"2024-01-30T08:08:47.305168+0000","last_fullsized":"2024-01-30T08:08:47.305168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060808+0000","last_change":"2024-01-30T08:08:42.287564+0000","last_active":"2024-01-30T08:08:49.060808+0000","last_peered":"2024-01-30T08:08:49.060808+0000","last_clean":"2024-01-30T08:08:49.060808+0000","last_became_active":"2024-01-30T08:08:42.287236+0000","last_became_peered":"2024-01-30T08:08:42.287236+0000","last_unstale":"2024-01-30T08:08:49.060808+0000","last_undegraded":"2024-01-30T08:08:49.060808+0000","last_fullsized":"2024-01-30T08:08:49.060808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061935+0000","last_change":"2024-01-30T08:08:42.273849+0000","last_active":"2024-01-30T08:08:49.061935+0000","last_peered":"2024-01-30T08:08:49.061935+0000","last_clean":"2024-01-30T08:08:49.061935+0000","last_became_active":"2024-01-30T08:08:42.273535+0000","last_became_peered":"2024-01-30T08:08:42.273535+0000","last_unstale":"2024-01-30T08:08:49.061935+0000","last_undegraded":"2024-01-30T08:08:49.061935+0000","last_fullsized":"2024-01-30T08:08:49.061935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:05:19.851128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061350+0000","last_change":"2024-01-30T08:08:42.290524+0000","last_active":"2024-01-30T08:08:49.061350+0000","last_peered":"2024-01-30T08:08:49.061350+0000","last_clean":"2024-01-30T08:08:49.061350+0000","last_became_active":"2024-01-30T08:08:42.290271+0000","last_became_peered":"2024-01-30T08:08:42.290271+0000","last_unstale":"2024-01-30T08:08:49.061350+0000","last_undegraded":"2024-01-30T08:08:49.061350+0000","last_fullsized":"2024-01-30T08:08:49.061350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:19.978105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062197+0000","last_change":"2024-01-30T08:08:42.291250+0000","last_active":"2024-01-30T08:08:49.062197+0000","last_peered":"2024-01-30T08:08:49.062197+0000","last_clean":"2024-01-30T08:08:49.062197+0000","last_became_active":"2024-01-30T08:08:42.290996+0000","last_became_peered":"2024-01-30T08:08:42.290996+0000","last_unstale":"2024-01-30T08:08:49.062197+0000","last_undegraded":"2024-01-30T08:08:49.062197+0000","last_fullsized":"2024-01-30T08:08:49.062197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:25.994167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062296+0000","last_change":"2024-01-30T08:08:42.274737+0000","last_active":"2024-01-30T08:08:49.062296+0000","last_peered":"2024-01-30T08:08:49.062296+0000","last_clean":"2024-01-30T08:08:49.062296+0000","last_became_active":"2024-01-30T08:08:42.274400+0000","last_became_peered":"2024-01-30T08:08:42.274400+0000","last_unstale":"2024-01-30T08:08:49.062296+0000","last_undegraded":"2024-01-30T08:08:49.062296+0000","last_fullsized":"2024-01-30T08:08:49.062296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:30:39.631576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063741+0000","last_change":"2024-01-30T08:08:42.279330+0000","last_active":"2024-01-30T08:08:49.063741+0000","last_peered":"2024-01-30T08:08:49.063741+0000","last_clean":"2024-01-30T08:08:49.063741+0000","last_became_active":"2024-01-30T08:08:42.279149+0000","last_became_peered":"2024-01-30T08:08:42.279149+0000","last_unstale":"2024-01-30T08:08:49.063741+0000","last_undegraded":"2024-01-30T08:08:49.063741+0000","last_fullsized":"2024-01-30T08:08:49.063741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061155+0000","last_change":"2024-01-30T08:08:42.293738+0000","last_active":"2024-01-30T08:08:49.061155+0000","last_peered":"2024-01-30T08:08:49.061155+0000","last_clean":"2024-01-30T08:08:49.061155+0000","last_became_active":"2024-01-30T08:08:42.293398+0000","last_became_peered":"2024-01-30T08:08:42.293398+0000","last_unstale":"2024-01-30T08:08:49.061155+0000","last_undegraded":"2024-01-30T08:08:49.061155+0000","last_fullsized":"2024-01-30T08:08:49.061155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:43.542616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":694227,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":694283,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:09:07.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda11200640 1 Processor -- start 2024-01-30T08:09:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda11200640 1 -- start start 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda11200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda0c0a7120 0x7fda0c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda11200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c0c7b40 con 0x7fda0c06de40 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda11200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c155730 con 0x7fda0c06e220 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda11200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0a7770 con 0x7fda0c0a7120 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda09400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda0c0a7120 0x7fda0c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda09400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda0c0a7120 0x7fda0c1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59088/0 (socket says 172.21.15.50:59088) 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda09e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fda0c06de40 0x7fda0c157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37000/0 (socket says 172.21.15.50:37000) 2024-01-30T08:09:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda09400640 1 -- 172.21.15.50:0/4086500985 learned_addr learned my addr 172.21.15.50:0/4086500985 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda09400640 1 -- 172.21.15.50:0/4086500985 >> v1:172.21.15.125:6789/0 conn(0x7fda0c06e220 legacy=0x7fda0c15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda09400640 1 -- 172.21.15.50:0/4086500985 >> v1:172.21.15.50:6789/0 conn(0x7fda0c06de40 legacy=0x7fda0c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda09400640 1 -- 172.21.15.50:0/4086500985 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c06ec20 con 0x7fda0c0a7120 2024-01-30T08:09:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.467+0000 7fda08a00640 1 -- 172.21.15.50:0/4086500985 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296109862 0 0) 0x7fd9fc001120 con 0x7fda0c06de40 2024-01-30T08:09:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda09400640 1 --2- 172.21.15.50:0/4086500985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1584a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009870 tx=0x7fd9f401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8594778196533b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda08a00640 1 -- 172.21.15.50:0/4086500985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40ab600 con 0x7fda0c0a7120 2024-01-30T08:09:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda08a00640 1 -- 172.21.15.50:0/4086500985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f40a7050 con 0x7fda0c0a7120 2024-01-30T08:09:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda08a00640 1 -- 172.21.15.50:0/4086500985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40ab980 con 0x7fda0c0a7120 2024-01-30T08:09:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda11200640 1 -- 172.21.15.50:0/4086500985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 msgr2=0x7fda0c1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda11200640 1 --2- 172.21.15.50:0/4086500985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1584a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009870 tx=0x7fd9f401c540 comp rx=0 tx=0).stop 2024-01-30T08:09:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda11200640 1 -- 172.21.15.50:0/4086500985 shutdown_connections 2024-01-30T08:09:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda11200640 1 --2- 172.21.15.50:0/4086500985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1584a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda11200640 1 -- 172.21.15.50:0/4086500985 >> 172.21.15.50:0/4086500985 conn(0x7fda0c0c4830 msgr2=0x7fda0c0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda11200640 1 -- 172.21.15.50:0/4086500985 shutdown_connections 2024-01-30T08:09:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.471+0000 7fda11200640 1 -- 172.21.15.50:0/4086500985 wait complete. 2024-01-30T08:09:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 Processor -- start 2024-01-30T08:09:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 -- start start 2024-01-30T08:09:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda0c06de40 0x7fda0c0a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda0c06e220 0x7fda0c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c155310 con 0x7fda0c0a7120 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c157c40 con 0x7fda0c06de40 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c156670 con 0x7fda0c06e220 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda09e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda0c06de40 0x7fda0c0a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59100/0 (socket says 172.21.15.50:59100) 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 -- 172.21.15.50:0/712020733 learned_addr learned my addr 172.21.15.50:0/712020733 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda09400640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda0c06e220 0x7fda0c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 -- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda0c06e220 msgr2=0x7fda0c0aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda0c06e220 0x7fda0c0aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 -- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda0c06de40 msgr2=0x7fda0c0a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda0c06de40 0x7fda0c0a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 -- 172.21.15.50:0/712020733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40094d0 con 0x7fda0c0a7120 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda0a800640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1f1010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fda0400c7a0 tx=0x7fda0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda02000640 1 -- 172.21.15.50:0/712020733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04003b80 con 0x7fda0c0a7120 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda02000640 1 -- 172.21.15.50:0/712020733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda04003ce0 con 0x7fda0c0a7120 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0aa870 con 0x7fda0c0a7120 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda02000640 1 -- 172.21.15.50:0/712020733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400aa90 con 0x7fda0c0a7120 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.475+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c156fc0 con 0x7fda0c0a7120 2024-01-30T08:09:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.479+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c157d80 con 0x7fda0c0a7120 2024-01-30T08:09:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.479+0000 7fda02000640 1 -- 172.21.15.50:0/712020733 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fda0400abf0 con 0x7fda0c0a7120 2024-01-30T08:09:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.479+0000 7fda02000640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd9e4066500 0x7fd9e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.479+0000 7fda02000640 1 -- 172.21.15.50:0/712020733 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda04083d50 con 0x7fda0c0a7120 2024-01-30T08:09:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.479+0000 7fda09e00640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd9e4066500 0x7fd9e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.479+0000 7fda09e00640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd9e4066500 0x7fd9e40689c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc007e00 tx=0x7fd9fc007d90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.483+0000 7fda02000640 1 -- 172.21.15.50:0/712020733 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fda04050da0 con 0x7fda0c0a7120 2024-01-30T08:09:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.643+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda0c1520a0 con 0x7fd9e4066500 2024-01-30T08:09:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.651+0000 7fda02000640 1 -- 172.21.15.50:0/712020733 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345383 (secure 0 0 0) 0x7fd9fc0071e0 con 0x7fd9e4066500 2024-01-30T08:09:07.657 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd9e4066500 msgr2=0x7fd9e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd9e4066500 0x7fd9e40689c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc007e00 tx=0x7fd9fc007d90 comp rx=0 tx=0).stop 2024-01-30T08:09:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 msgr2=0x7fda0c1f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1f1010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fda0400c7a0 tx=0x7fda0400cc60 comp rx=0 tx=0).stop 2024-01-30T08:09:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 shutdown_connections 2024-01-30T08:09:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd9e4066500 0x7fd9e40689c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0c0a7120 0x7fda0c1f1010 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda0c06e220 0x7fda0c0aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 --2- 172.21.15.50:0/712020733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda0c06de40 0x7fda0c0a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 >> 172.21.15.50:0/712020733 conn(0x7fda0c0c4830 msgr2=0x7fda0c0bccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 shutdown_connections 2024-01-30T08:09:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.655+0000 7fda11200640 1 -- 172.21.15.50:0/712020733 wait complete. 2024-01-30T08:09:07.678 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-01-30T08:09:07.055186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218404,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756316,"statfs":{"total":773094113280,"available":772870467584,"internally_reserved":0,"allocated":2293760,"data_stored":2016230,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003522"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062910+0000","last_change":"2024-01-30T08:08:41.284386+0000","last_active":"2024-01-30T08:08:49.062910+0000","last_peered":"2024-01-30T08:08:49.062910+0000","last_clean":"2024-01-30T08:08:49.062910+0000","last_became_active":"2024-01-30T08:08:41.284070+0000","last_became_peered":"2024-01-30T08:08:41.284070+0000","last_unstale":"2024-01-30T08:08:49.062910+0000","last_undegraded":"2024-01-30T08:08:49.062910+0000","last_fullsized":"2024-01-30T08:08:49.062910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:49:56.992264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305887+0000","last_change":"2024-01-30T08:08:42.279355+0000","last_active":"2024-01-30T08:08:47.305887+0000","last_peered":"2024-01-30T08:08:47.305887+0000","last_clean":"2024-01-30T08:08:47.305887+0000","last_became_active":"2024-01-30T08:08:42.276213+0000","last_became_peered":"2024-01-30T08:08:42.276213+0000","last_unstale":"2024-01-30T08:08:47.305887+0000","last_undegraded":"2024-01-30T08:08:47.305887+0000","last_fullsized":"2024-01-30T08:08:47.305887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.562412+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.561547+0000","last_became_peered":"2024-01-30T08:08:46.561547+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:25.519672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306121+0000","last_change":"2024-01-30T08:08:41.277142+0000","last_active":"2024-01-30T08:08:47.306121+0000","last_peered":"2024-01-30T08:08:47.306121+0000","last_clean":"2024-01-30T08:08:47.306121+0000","last_became_active":"2024-01-30T08:08:41.276876+0000","last_became_peered":"2024-01-30T08:08:41.276876+0000","last_unstale":"2024-01-30T08:08:47.306121+0000","last_undegraded":"2024-01-30T08:08:47.306121+0000","last_fullsized":"2024-01-30T08:08:47.306121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062659+0000","last_change":"2024-01-30T08:08:42.289777+0000","last_active":"2024-01-30T08:08:49.062659+0000","last_peered":"2024-01-30T08:08:49.062659+0000","last_clean":"2024-01-30T08:08:49.062659+0000","last_became_active":"2024-01-30T08:08:42.288789+0000","last_became_peered":"2024-01-30T08:08:42.288789+0000","last_unstale":"2024-01-30T08:08:49.062659+0000","last_undegraded":"2024-01-30T08:08:49.062659+0000","last_fullsized":"2024-01-30T08:08:49.062659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:47:56.164414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305170+0000","last_change":"2024-01-30T08:08:46.315655+0000","last_active":"2024-01-30T08:08:47.305170+0000","last_peered":"2024-01-30T08:08:47.305170+0000","last_clean":"2024-01-30T08:08:47.305170+0000","last_became_active":"2024-01-30T08:08:46.314644+0000","last_became_peered":"2024-01-30T08:08:46.314644+0000","last_unstale":"2024-01-30T08:08:47.305170+0000","last_undegraded":"2024-01-30T08:08:47.305170+0000","last_fullsized":"2024-01-30T08:08:47.305170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:15.180621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061282+0000","last_change":"2024-01-30T08:08:41.289340+0000","last_active":"2024-01-30T08:08:49.061282+0000","last_peered":"2024-01-30T08:08:49.061282+0000","last_clean":"2024-01-30T08:08:49.061282+0000","last_became_active":"2024-01-30T08:08:41.288491+0000","last_became_peered":"2024-01-30T08:08:41.288491+0000","last_unstale":"2024-01-30T08:08:49.061282+0000","last_undegraded":"2024-01-30T08:08:49.061282+0000","last_fullsized":"2024-01-30T08:08:49.061282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062248+0000","last_change":"2024-01-30T08:08:42.297915+0000","last_active":"2024-01-30T08:08:49.062248+0000","last_peered":"2024-01-30T08:08:49.062248+0000","last_clean":"2024-01-30T08:08:49.062248+0000","last_became_active":"2024-01-30T08:08:42.297662+0000","last_became_peered":"2024-01-30T08:08:42.297662+0000","last_unstale":"2024-01-30T08:08:49.062248+0000","last_undegraded":"2024-01-30T08:08:49.062248+0000","last_fullsized":"2024-01-30T08:08:49.062248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:59:23.741905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306032+0000","last_change":"2024-01-30T08:08:46.308032+0000","last_active":"2024-01-30T08:08:47.306032+0000","last_peered":"2024-01-30T08:08:47.306032+0000","last_clean":"2024-01-30T08:08:47.306032+0000","last_became_active":"2024-01-30T08:08:46.307399+0000","last_became_peered":"2024-01-30T08:08:46.307399+0000","last_unstale":"2024-01-30T08:08:47.306032+0000","last_undegraded":"2024-01-30T08:08:47.306032+0000","last_fullsized":"2024-01-30T08:08:47.306032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:00.921167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060898+0000","last_change":"2024-01-30T08:08:41.291632+0000","last_active":"2024-01-30T08:08:49.060898+0000","last_peered":"2024-01-30T08:08:49.060898+0000","last_clean":"2024-01-30T08:08:49.060898+0000","last_became_active":"2024-01-30T08:08:41.291202+0000","last_became_peered":"2024-01-30T08:08:41.291202+0000","last_unstale":"2024-01-30T08:08:49.060898+0000","last_undegraded":"2024-01-30T08:08:49.060898+0000","last_fullsized":"2024-01-30T08:08:49.060898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062453+0000","last_change":"2024-01-30T08:08:42.295783+0000","last_active":"2024-01-30T08:08:49.062453+0000","last_peered":"2024-01-30T08:08:49.062453+0000","last_clean":"2024-01-30T08:08:49.062453+0000","last_became_active":"2024-01-30T08:08:42.295323+0000","last_became_peered":"2024-01-30T08:08:42.295323+0000","last_unstale":"2024-01-30T08:08:49.062453+0000","last_undegraded":"2024-01-30T08:08:49.062453+0000","last_fullsized":"2024-01-30T08:08:49.062453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:19:42.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306102+0000","last_change":"2024-01-30T08:08:46.315845+0000","last_active":"2024-01-30T08:08:47.306102+0000","last_peered":"2024-01-30T08:08:47.306102+0000","last_clean":"2024-01-30T08:08:47.306102+0000","last_became_active":"2024-01-30T08:08:46.315351+0000","last_became_peered":"2024-01-30T08:08:46.315351+0000","last_unstale":"2024-01-30T08:08:47.306102+0000","last_undegraded":"2024-01-30T08:08:47.306102+0000","last_fullsized":"2024-01-30T08:08:47.306102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:05.115925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306123+0000","last_change":"2024-01-30T08:08:42.276052+0000","last_active":"2024-01-30T08:08:47.306123+0000","last_peered":"2024-01-30T08:08:47.306123+0000","last_clean":"2024-01-30T08:08:47.306123+0000","last_became_active":"2024-01-30T08:08:42.275642+0000","last_became_peered":"2024-01-30T08:08:42.275642+0000","last_unstale":"2024-01-30T08:08:47.306123+0000","last_undegraded":"2024-01-30T08:08:47.306123+0000","last_fullsized":"2024-01-30T08:08:47.306123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:38.647109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061678+0000","last_change":"2024-01-30T08:08:41.284716+0000","last_active":"2024-01-30T08:08:49.061678+0000","last_peered":"2024-01-30T08:08:49.061678+0000","last_clean":"2024-01-30T08:08:49.061678+0000","last_became_active":"2024-01-30T08:08:41.284434+0000","last_became_peered":"2024-01-30T08:08:41.284434+0000","last_unstale":"2024-01-30T08:08:49.061678+0000","last_undegraded":"2024-01-30T08:08:49.061678+0000","last_fullsized":"2024-01-30T08:08:49.061678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:49.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306435+0000","last_change":"2024-01-30T08:08:46.304711+0000","last_active":"2024-01-30T08:08:47.306435+0000","last_peered":"2024-01-30T08:08:47.306435+0000","last_clean":"2024-01-30T08:08:47.306435+0000","last_became_active":"2024-01-30T08:08:46.304246+0000","last_became_peered":"2024-01-30T08:08:46.304246+0000","last_unstale":"2024-01-30T08:08:47.306435+0000","last_undegraded":"2024-01-30T08:08:47.306435+0000","last_fullsized":"2024-01-30T08:08:47.306435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305525+0000","last_change":"2024-01-30T08:08:42.284398+0000","last_active":"2024-01-30T08:08:47.305525+0000","last_peered":"2024-01-30T08:08:47.305525+0000","last_clean":"2024-01-30T08:08:47.305525+0000","last_became_active":"2024-01-30T08:08:42.284058+0000","last_became_peered":"2024-01-30T08:08:42.284058+0000","last_unstale":"2024-01-30T08:08:47.305525+0000","last_undegraded":"2024-01-30T08:08:47.305525+0000","last_fullsized":"2024-01-30T08:08:47.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063365+0000","last_change":"2024-01-30T08:08:41.283040+0000","last_active":"2024-01-30T08:08:49.063365+0000","last_peered":"2024-01-30T08:08:49.063365+0000","last_clean":"2024-01-30T08:08:49.063365+0000","last_became_active":"2024-01-30T08:08:41.275704+0000","last_became_peered":"2024-01-30T08:08:41.275704+0000","last_unstale":"2024-01-30T08:08:49.063365+0000","last_undegraded":"2024-01-30T08:08:49.063365+0000","last_fullsized":"2024-01-30T08:08:49.063365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:46.318981+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:46.318487+0000","last_became_peered":"2024-01-30T08:08:46.318487+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305403+0000","last_change":"2024-01-30T08:08:42.276779+0000","last_active":"2024-01-30T08:08:47.305403+0000","last_peered":"2024-01-30T08:08:47.305403+0000","last_clean":"2024-01-30T08:08:47.305403+0000","last_became_active":"2024-01-30T08:08:42.276293+0000","last_became_peered":"2024-01-30T08:08:42.276293+0000","last_unstale":"2024-01-30T08:08:47.305403+0000","last_undegraded":"2024-01-30T08:08:47.305403+0000","last_fullsized":"2024-01-30T08:08:47.305403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062313+0000","last_change":"2024-01-30T08:08:41.280606+0000","last_active":"2024-01-30T08:08:49.062313+0000","last_peered":"2024-01-30T08:08:49.062313+0000","last_clean":"2024-01-30T08:08:49.062313+0000","last_became_active":"2024-01-30T08:08:41.280257+0000","last_became_peered":"2024-01-30T08:08:41.280257+0000","last_unstale":"2024-01-30T08:08:49.062313+0000","last_undegraded":"2024-01-30T08:08:49.062313+0000","last_fullsized":"2024-01-30T08:08:49.062313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063823+0000","last_change":"2024-01-30T08:08:46.564137+0000","last_active":"2024-01-30T08:08:49.063823+0000","last_peered":"2024-01-30T08:08:49.063823+0000","last_clean":"2024-01-30T08:08:49.063823+0000","last_became_active":"2024-01-30T08:08:46.563422+0000","last_became_peered":"2024-01-30T08:08:46.563422+0000","last_unstale":"2024-01-30T08:08:49.063823+0000","last_undegraded":"2024-01-30T08:08:49.063823+0000","last_fullsized":"2024-01-30T08:08:49.063823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:53.755351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305710+0000","last_change":"2024-01-30T08:08:42.271792+0000","last_active":"2024-01-30T08:08:47.305710+0000","last_peered":"2024-01-30T08:08:47.305710+0000","last_clean":"2024-01-30T08:08:47.305710+0000","last_became_active":"2024-01-30T08:08:42.271488+0000","last_became_peered":"2024-01-30T08:08:42.271488+0000","last_unstale":"2024-01-30T08:08:47.305710+0000","last_undegraded":"2024-01-30T08:08:47.305710+0000","last_fullsized":"2024-01-30T08:08:47.305710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:43.028344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060650+0000","last_change":"2024-01-30T08:08:41.289206+0000","last_active":"2024-01-30T08:08:49.060650+0000","last_peered":"2024-01-30T08:08:49.060650+0000","last_clean":"2024-01-30T08:08:49.060650+0000","last_became_active":"2024-01-30T08:08:41.288158+0000","last_became_peered":"2024-01-30T08:08:41.288158+0000","last_unstale":"2024-01-30T08:08:49.060650+0000","last_undegraded":"2024-01-30T08:08:49.060650+0000","last_fullsized":"2024-01-30T08:08:49.060650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306652+0000","last_change":"2024-01-30T08:08:46.315546+0000","last_active":"2024-01-30T08:08:47.306652+0000","last_peered":"2024-01-30T08:08:47.306652+0000","last_clean":"2024-01-30T08:08:47.306652+0000","last_became_active":"2024-01-30T08:08:46.314665+0000","last_became_peered":"2024-01-30T08:08:46.314665+0000","last_unstale":"2024-01-30T08:08:47.306652+0000","last_undegraded":"2024-01-30T08:08:47.306652+0000","last_fullsized":"2024-01-30T08:08:47.306652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062963+0000","last_change":"2024-01-30T08:08:42.278495+0000","last_active":"2024-01-30T08:08:49.062963+0000","last_peered":"2024-01-30T08:08:49.062963+0000","last_clean":"2024-01-30T08:08:49.062963+0000","last_became_active":"2024-01-30T08:08:42.278239+0000","last_became_peered":"2024-01-30T08:08:42.278239+0000","last_unstale":"2024-01-30T08:08:49.062963+0000","last_undegraded":"2024-01-30T08:08:49.062963+0000","last_fullsized":"2024-01-30T08:08:49.062963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:15:30.493486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307419+0000","last_change":"2024-01-30T08:08:41.288843+0000","last_active":"2024-01-30T08:08:47.307419+0000","last_peered":"2024-01-30T08:08:47.307419+0000","last_clean":"2024-01-30T08:08:47.307419+0000","last_became_active":"2024-01-30T08:08:41.287058+0000","last_became_peered":"2024-01-30T08:08:41.287058+0000","last_unstale":"2024-01-30T08:08:47.307419+0000","last_undegraded":"2024-01-30T08:08:47.307419+0000","last_fullsized":"2024-01-30T08:08:47.307419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305476+0000","last_change":"2024-01-30T08:08:46.561858+0000","last_active":"2024-01-30T08:08:47.305476+0000","last_peered":"2024-01-30T08:08:47.305476+0000","last_clean":"2024-01-30T08:08:47.305476+0000","last_became_active":"2024-01-30T08:08:46.561473+0000","last_became_peered":"2024-01-30T08:08:46.561473+0000","last_unstale":"2024-01-30T08:08:47.305476+0000","last_undegraded":"2024-01-30T08:08:47.305476+0000","last_fullsized":"2024-01-30T08:08:47.305476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:55.086903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:42.292374+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:42.292083+0000","last_became_peered":"2024-01-30T08:08:42.292083+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063796+0000","last_change":"2024-01-30T08:08:41.277386+0000","last_active":"2024-01-30T08:08:49.063796+0000","last_peered":"2024-01-30T08:08:49.063796+0000","last_clean":"2024-01-30T08:08:49.063796+0000","last_became_active":"2024-01-30T08:08:41.276132+0000","last_became_peered":"2024-01-30T08:08:41.276132+0000","last_unstale":"2024-01-30T08:08:49.063796+0000","last_undegraded":"2024-01-30T08:08:49.063796+0000","last_fullsized":"2024-01-30T08:08:49.063796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.566162+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.565660+0000","last_became_peered":"2024-01-30T08:08:46.565660+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063508+0000","last_change":"2024-01-30T08:08:42.271610+0000","last_active":"2024-01-30T08:08:49.063508+0000","last_peered":"2024-01-30T08:08:49.063508+0000","last_clean":"2024-01-30T08:08:49.063508+0000","last_became_active":"2024-01-30T08:08:42.271325+0000","last_became_peered":"2024-01-30T08:08:42.271325+0000","last_unstale":"2024-01-30T08:08:49.063508+0000","last_undegraded":"2024-01-30T08:08:49.063508+0000","last_fullsized":"2024-01-30T08:08:49.063508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061483+0000","last_change":"2024-01-30T08:08:41.289187+0000","last_active":"2024-01-30T08:08:49.061483+0000","last_peered":"2024-01-30T08:08:49.061483+0000","last_clean":"2024-01-30T08:08:49.061483+0000","last_became_active":"2024-01-30T08:08:41.288137+0000","last_became_peered":"2024-01-30T08:08:41.288137+0000","last_unstale":"2024-01-30T08:08:49.061483+0000","last_undegraded":"2024-01-30T08:08:49.061483+0000","last_fullsized":"2024-01-30T08:08:49.061483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062164+0000","last_change":"2024-01-30T08:08:46.562867+0000","last_active":"2024-01-30T08:08:49.062164+0000","last_peered":"2024-01-30T08:08:49.062164+0000","last_clean":"2024-01-30T08:08:49.062164+0000","last_became_active":"2024-01-30T08:08:46.562382+0000","last_became_peered":"2024-01-30T08:08:46.562382+0000","last_unstale":"2024-01-30T08:08:49.062164+0000","last_undegraded":"2024-01-30T08:08:49.062164+0000","last_fullsized":"2024-01-30T08:08:49.062164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:44.788175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062441+0000","last_change":"2024-01-30T08:08:42.287858+0000","last_active":"2024-01-30T08:08:49.062441+0000","last_peered":"2024-01-30T08:08:49.062441+0000","last_clean":"2024-01-30T08:08:49.062441+0000","last_became_active":"2024-01-30T08:08:42.287567+0000","last_became_peered":"2024-01-30T08:08:42.287567+0000","last_unstale":"2024-01-30T08:08:49.062441+0000","last_undegraded":"2024-01-30T08:08:49.062441+0000","last_fullsized":"2024-01-30T08:08:49.062441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:40.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063597+0000","last_change":"2024-01-30T08:08:41.278170+0000","last_active":"2024-01-30T08:08:49.063597+0000","last_peered":"2024-01-30T08:08:49.063597+0000","last_clean":"2024-01-30T08:08:49.063597+0000","last_became_active":"2024-01-30T08:08:41.277887+0000","last_became_peered":"2024-01-30T08:08:41.277887+0000","last_unstale":"2024-01-30T08:08:49.063597+0000","last_undegraded":"2024-01-30T08:08:49.063597+0000","last_fullsized":"2024-01-30T08:08:49.063597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063213+0000","last_change":"2024-01-30T08:08:46.307067+0000","last_active":"2024-01-30T08:08:49.063213+0000","last_peered":"2024-01-30T08:08:49.063213+0000","last_clean":"2024-01-30T08:08:49.063213+0000","last_became_active":"2024-01-30T08:08:46.306645+0000","last_became_peered":"2024-01-30T08:08:46.306645+0000","last_unstale":"2024-01-30T08:08:49.063213+0000","last_undegraded":"2024-01-30T08:08:49.063213+0000","last_fullsized":"2024-01-30T08:08:49.063213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306470+0000","last_change":"2024-01-30T08:08:42.283427+0000","last_active":"2024-01-30T08:08:47.306470+0000","last_peered":"2024-01-30T08:08:47.306470+0000","last_clean":"2024-01-30T08:08:47.306470+0000","last_became_active":"2024-01-30T08:08:42.281444+0000","last_became_peered":"2024-01-30T08:08:42.281444+0000","last_unstale":"2024-01-30T08:08:47.306470+0000","last_undegraded":"2024-01-30T08:08:47.306470+0000","last_fullsized":"2024-01-30T08:08:47.306470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:42.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062249+0000","last_change":"2024-01-30T08:08:41.275140+0000","last_active":"2024-01-30T08:08:49.062249+0000","last_peered":"2024-01-30T08:08:49.062249+0000","last_clean":"2024-01-30T08:08:49.062249+0000","last_became_active":"2024-01-30T08:08:41.274851+0000","last_became_peered":"2024-01-30T08:08:41.274851+0000","last_unstale":"2024-01-30T08:08:49.062249+0000","last_undegraded":"2024-01-30T08:08:49.062249+0000","last_fullsized":"2024-01-30T08:08:49.062249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:40:25.984103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063589+0000","last_change":"2024-01-30T08:08:46.320651+0000","last_active":"2024-01-30T08:08:49.063589+0000","last_peered":"2024-01-30T08:08:49.063589+0000","last_clean":"2024-01-30T08:08:49.063589+0000","last_became_active":"2024-01-30T08:08:46.320138+0000","last_became_peered":"2024-01-30T08:08:46.320138+0000","last_unstale":"2024-01-30T08:08:49.063589+0000","last_undegraded":"2024-01-30T08:08:49.063589+0000","last_fullsized":"2024-01-30T08:08:49.063589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:08.547055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062056+0000","last_change":"2024-01-30T08:08:42.271482+0000","last_active":"2024-01-30T08:08:49.062056+0000","last_peered":"2024-01-30T08:08:49.062056+0000","last_clean":"2024-01-30T08:08:49.062056+0000","last_became_active":"2024-01-30T08:08:42.271232+0000","last_became_peered":"2024-01-30T08:08:42.271232+0000","last_unstale":"2024-01-30T08:08:49.062056+0000","last_undegraded":"2024-01-30T08:08:49.062056+0000","last_fullsized":"2024-01-30T08:08:49.062056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789511+0000","last_change":"2024-01-30T08:08:41.277419+0000","last_active":"2024-01-30T08:08:47.789511+0000","last_peered":"2024-01-30T08:08:47.789511+0000","last_clean":"2024-01-30T08:08:47.789511+0000","last_became_active":"2024-01-30T08:08:41.277104+0000","last_became_peered":"2024-01-30T08:08:41.277104+0000","last_unstale":"2024-01-30T08:08:47.789511+0000","last_undegraded":"2024-01-30T08:08:47.789511+0000","last_fullsized":"2024-01-30T08:08:47.789511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063871+0000","last_change":"2024-01-30T08:08:46.321512+0000","last_active":"2024-01-30T08:08:49.063871+0000","last_peered":"2024-01-30T08:08:49.063871+0000","last_clean":"2024-01-30T08:08:49.063871+0000","last_became_active":"2024-01-30T08:08:46.320112+0000","last_became_peered":"2024-01-30T08:08:46.320112+0000","last_unstale":"2024-01-30T08:08:49.063871+0000","last_undegraded":"2024-01-30T08:08:49.063871+0000","last_fullsized":"2024-01-30T08:08:49.063871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061695+0000","last_change":"2024-01-30T08:08:42.296060+0000","last_active":"2024-01-30T08:08:49.061695+0000","last_peered":"2024-01-30T08:08:49.061695+0000","last_clean":"2024-01-30T08:08:49.061695+0000","last_became_active":"2024-01-30T08:08:42.295753+0000","last_became_peered":"2024-01-30T08:08:42.295753+0000","last_unstale":"2024-01-30T08:08:49.061695+0000","last_undegraded":"2024-01-30T08:08:49.061695+0000","last_fullsized":"2024-01-30T08:08:49.061695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:29:48.979595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060657+0000","last_change":"2024-01-30T08:08:41.286271+0000","last_active":"2024-01-30T08:08:49.060657+0000","last_peered":"2024-01-30T08:08:49.060657+0000","last_clean":"2024-01-30T08:08:49.060657+0000","last_became_active":"2024-01-30T08:08:41.285958+0000","last_became_peered":"2024-01-30T08:08:41.285958+0000","last_unstale":"2024-01-30T08:08:49.060657+0000","last_undegraded":"2024-01-30T08:08:49.060657+0000","last_fullsized":"2024-01-30T08:08:49.060657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062773+0000","last_change":"2024-01-30T08:08:46.562368+0000","last_active":"2024-01-30T08:08:49.062773+0000","last_peered":"2024-01-30T08:08:49.062773+0000","last_clean":"2024-01-30T08:08:49.062773+0000","last_became_active":"2024-01-30T08:08:46.561511+0000","last_became_peered":"2024-01-30T08:08:46.561511+0000","last_unstale":"2024-01-30T08:08:49.062773+0000","last_undegraded":"2024-01-30T08:08:49.062773+0000","last_fullsized":"2024-01-30T08:08:49.062773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:55.340433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305463+0000","last_change":"2024-01-30T08:08:42.284518+0000","last_active":"2024-01-30T08:08:47.305463+0000","last_peered":"2024-01-30T08:08:47.305463+0000","last_clean":"2024-01-30T08:08:47.305463+0000","last_became_active":"2024-01-30T08:08:42.284043+0000","last_became_peered":"2024-01-30T08:08:42.284043+0000","last_unstale":"2024-01-30T08:08:47.305463+0000","last_undegraded":"2024-01-30T08:08:47.305463+0000","last_fullsized":"2024-01-30T08:08:47.305463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061950+0000","last_change":"2024-01-30T08:08:41.280995+0000","last_active":"2024-01-30T08:08:49.061950+0000","last_peered":"2024-01-30T08:08:49.061950+0000","last_clean":"2024-01-30T08:08:49.061950+0000","last_became_active":"2024-01-30T08:08:41.280455+0000","last_became_peered":"2024-01-30T08:08:41.280455+0000","last_unstale":"2024-01-30T08:08:49.061950+0000","last_undegraded":"2024-01-30T08:08:49.061950+0000","last_fullsized":"2024-01-30T08:08:49.061950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:29.471243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061322+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:08:49.061322+0000","last_peered":"2024-01-30T08:08:49.061322+0000","last_clean":"2024-01-30T08:08:49.061322+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:08:49.061322+0000","last_undegraded":"2024-01-30T08:08:49.061322+0000","last_fullsized":"2024-01-30T08:08:49.061322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307091+0000","last_change":"2024-01-30T08:08:46.565243+0000","last_active":"2024-01-30T08:08:47.307091+0000","last_peered":"2024-01-30T08:08:47.307091+0000","last_clean":"2024-01-30T08:08:47.307091+0000","last_became_active":"2024-01-30T08:08:46.564876+0000","last_became_peered":"2024-01-30T08:08:46.564876+0000","last_unstale":"2024-01-30T08:08:47.307091+0000","last_undegraded":"2024-01-30T08:08:47.307091+0000","last_fullsized":"2024-01-30T08:08:47.307091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061006+0000","last_change":"2024-01-30T08:08:42.296681+0000","last_active":"2024-01-30T08:08:49.061006+0000","last_peered":"2024-01-30T08:08:49.061006+0000","last_clean":"2024-01-30T08:08:49.061006+0000","last_became_active":"2024-01-30T08:08:42.296349+0000","last_became_peered":"2024-01-30T08:08:42.296349+0000","last_unstale":"2024-01-30T08:08:49.061006+0000","last_undegraded":"2024-01-30T08:08:49.061006+0000","last_fullsized":"2024-01-30T08:08:49.061006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:35.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789843+0000","last_change":"2024-01-30T08:08:41.288774+0000","last_active":"2024-01-30T08:08:47.789843+0000","last_peered":"2024-01-30T08:08:47.789843+0000","last_clean":"2024-01-30T08:08:47.789843+0000","last_became_active":"2024-01-30T08:08:41.288519+0000","last_became_peered":"2024-01-30T08:08:41.288519+0000","last_unstale":"2024-01-30T08:08:47.789843+0000","last_undegraded":"2024-01-30T08:08:47.789843+0000","last_fullsized":"2024-01-30T08:08:47.789843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305155+0000","last_change":"2024-01-30T08:08:46.560657+0000","last_active":"2024-01-30T08:08:47.305155+0000","last_peered":"2024-01-30T08:08:47.305155+0000","last_clean":"2024-01-30T08:08:47.305155+0000","last_became_active":"2024-01-30T08:08:46.559970+0000","last_became_peered":"2024-01-30T08:08:46.559970+0000","last_unstale":"2024-01-30T08:08:47.305155+0000","last_undegraded":"2024-01-30T08:08:47.305155+0000","last_fullsized":"2024-01-30T08:08:47.305155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062304+0000","last_change":"2024-01-30T08:08:42.290969+0000","last_active":"2024-01-30T08:08:49.062304+0000","last_peered":"2024-01-30T08:08:49.062304+0000","last_clean":"2024-01-30T08:08:49.062304+0000","last_became_active":"2024-01-30T08:08:42.290605+0000","last_became_peered":"2024-01-30T08:08:42.290605+0000","last_unstale":"2024-01-30T08:08:49.062304+0000","last_undegraded":"2024-01-30T08:08:49.062304+0000","last_fullsized":"2024-01-30T08:08:49.062304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:47:41.957325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063753+0000","last_change":"2024-01-30T08:08:41.283051+0000","last_active":"2024-01-30T08:08:49.063753+0000","last_peered":"2024-01-30T08:08:49.063753+0000","last_clean":"2024-01-30T08:08:49.063753+0000","last_became_active":"2024-01-30T08:08:41.282773+0000","last_became_peered":"2024-01-30T08:08:41.282773+0000","last_unstale":"2024-01-30T08:08:49.063753+0000","last_undegraded":"2024-01-30T08:08:49.063753+0000","last_fullsized":"2024-01-30T08:08:49.063753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062287+0000","last_change":"2024-01-30T08:08:46.311779+0000","last_active":"2024-01-30T08:08:49.062287+0000","last_peered":"2024-01-30T08:08:49.062287+0000","last_clean":"2024-01-30T08:08:49.062287+0000","last_became_active":"2024-01-30T08:08:46.311314+0000","last_became_peered":"2024-01-30T08:08:46.311314+0000","last_unstale":"2024-01-30T08:08:49.062287+0000","last_undegraded":"2024-01-30T08:08:49.062287+0000","last_fullsized":"2024-01-30T08:08:49.062287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:02.056713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061327+0000","last_change":"2024-01-30T08:08:42.305456+0000","last_active":"2024-01-30T08:08:49.061327+0000","last_peered":"2024-01-30T08:08:49.061327+0000","last_clean":"2024-01-30T08:08:49.061327+0000","last_became_active":"2024-01-30T08:08:42.305210+0000","last_became_peered":"2024-01-30T08:08:42.305210+0000","last_unstale":"2024-01-30T08:08:49.061327+0000","last_undegraded":"2024-01-30T08:08:49.061327+0000","last_fullsized":"2024-01-30T08:08:49.061327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:49.726372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789981+0000","last_change":"2024-01-30T08:08:41.267098+0000","last_active":"2024-01-30T08:08:47.789981+0000","last_peered":"2024-01-30T08:08:47.789981+0000","last_clean":"2024-01-30T08:08:47.789981+0000","last_became_active":"2024-01-30T08:08:41.266760+0000","last_became_peered":"2024-01-30T08:08:41.266760+0000","last_unstale":"2024-01-30T08:08:47.789981+0000","last_undegraded":"2024-01-30T08:08:47.789981+0000","last_fullsized":"2024-01-30T08:08:47.789981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060608+0000","last_change":"2024-01-30T08:08:46.564824+0000","last_active":"2024-01-30T08:08:49.060608+0000","last_peered":"2024-01-30T08:08:49.060608+0000","last_clean":"2024-01-30T08:08:49.060608+0000","last_became_active":"2024-01-30T08:08:46.564330+0000","last_became_peered":"2024-01-30T08:08:46.564330+0000","last_unstale":"2024-01-30T08:08:49.060608+0000","last_undegraded":"2024-01-30T08:08:49.060608+0000","last_fullsized":"2024-01-30T08:08:49.060608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:30:28.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061676+0000","last_change":"2024-01-30T08:08:42.305183+0000","last_active":"2024-01-30T08:08:49.061676+0000","last_peered":"2024-01-30T08:08:49.061676+0000","last_clean":"2024-01-30T08:08:49.061676+0000","last_became_active":"2024-01-30T08:08:42.304786+0000","last_became_peered":"2024-01-30T08:08:42.304786+0000","last_unstale":"2024-01-30T08:08:49.061676+0000","last_undegraded":"2024-01-30T08:08:49.061676+0000","last_fullsized":"2024-01-30T08:08:49.061676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:14.376017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305702+0000","last_change":"2024-01-30T08:08:41.277848+0000","last_active":"2024-01-30T08:08:47.305702+0000","last_peered":"2024-01-30T08:08:47.305702+0000","last_clean":"2024-01-30T08:08:47.305702+0000","last_became_active":"2024-01-30T08:08:41.276589+0000","last_became_peered":"2024-01-30T08:08:41.276589+0000","last_unstale":"2024-01-30T08:08:47.305702+0000","last_undegraded":"2024-01-30T08:08:47.305702+0000","last_fullsized":"2024-01-30T08:08:47.305702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305158+0000","last_change":"2024-01-30T08:08:46.307894+0000","last_active":"2024-01-30T08:08:47.305158+0000","last_peered":"2024-01-30T08:08:47.305158+0000","last_clean":"2024-01-30T08:08:47.305158+0000","last_became_active":"2024-01-30T08:08:46.307456+0000","last_became_peered":"2024-01-30T08:08:46.307456+0000","last_unstale":"2024-01-30T08:08:47.305158+0000","last_undegraded":"2024-01-30T08:08:47.305158+0000","last_fullsized":"2024-01-30T08:08:47.305158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:29.212048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060944+0000","last_change":"2024-01-30T08:08:42.300225+0000","last_active":"2024-01-30T08:08:49.060944+0000","last_peered":"2024-01-30T08:08:49.060944+0000","last_clean":"2024-01-30T08:08:49.060944+0000","last_became_active":"2024-01-30T08:08:42.299982+0000","last_became_peered":"2024-01-30T08:08:42.299982+0000","last_unstale":"2024-01-30T08:08:49.060944+0000","last_undegraded":"2024-01-30T08:08:49.060944+0000","last_fullsized":"2024-01-30T08:08:49.060944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789401+0000","last_change":"2024-01-30T08:08:41.281155+0000","last_active":"2024-01-30T08:08:47.789401+0000","last_peered":"2024-01-30T08:08:47.789401+0000","last_clean":"2024-01-30T08:08:47.789401+0000","last_became_active":"2024-01-30T08:08:41.280684+0000","last_became_peered":"2024-01-30T08:08:41.280684+0000","last_unstale":"2024-01-30T08:08:47.789401+0000","last_undegraded":"2024-01-30T08:08:47.789401+0000","last_fullsized":"2024-01-30T08:08:47.789401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062626+0000","last_change":"2024-01-30T08:08:46.312867+0000","last_active":"2024-01-30T08:08:49.062626+0000","last_peered":"2024-01-30T08:08:49.062626+0000","last_clean":"2024-01-30T08:08:49.062626+0000","last_became_active":"2024-01-30T08:08:46.312450+0000","last_became_peered":"2024-01-30T08:08:46.312450+0000","last_unstale":"2024-01-30T08:08:49.062626+0000","last_undegraded":"2024-01-30T08:08:49.062626+0000","last_fullsized":"2024-01-30T08:08:49.062626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:01.538569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305554+0000","last_change":"2024-01-30T08:08:42.277590+0000","last_active":"2024-01-30T08:08:47.305554+0000","last_peered":"2024-01-30T08:08:47.305554+0000","last_clean":"2024-01-30T08:08:47.305554+0000","last_became_active":"2024-01-30T08:08:42.277197+0000","last_became_peered":"2024-01-30T08:08:42.277197+0000","last_unstale":"2024-01-30T08:08:47.305554+0000","last_undegraded":"2024-01-30T08:08:47.305554+0000","last_fullsized":"2024-01-30T08:08:47.305554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305769+0000","last_change":"2024-01-30T08:08:41.282399+0000","last_active":"2024-01-30T08:08:47.305769+0000","last_peered":"2024-01-30T08:08:47.305769+0000","last_clean":"2024-01-30T08:08:47.305769+0000","last_became_active":"2024-01-30T08:08:41.282056+0000","last_became_peered":"2024-01-30T08:08:41.282056+0000","last_unstale":"2024-01-30T08:08:47.305769+0000","last_undegraded":"2024-01-30T08:08:47.305769+0000","last_fullsized":"2024-01-30T08:08:47.305769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306153+0000","last_change":"2024-01-30T08:08:46.564745+0000","last_active":"2024-01-30T08:08:47.306153+0000","last_peered":"2024-01-30T08:08:47.306153+0000","last_clean":"2024-01-30T08:08:47.306153+0000","last_became_active":"2024-01-30T08:08:46.562228+0000","last_became_peered":"2024-01-30T08:08:46.562228+0000","last_unstale":"2024-01-30T08:08:47.306153+0000","last_undegraded":"2024-01-30T08:08:47.306153+0000","last_fullsized":"2024-01-30T08:08:47.306153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:13.466128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061539+0000","last_change":"2024-01-30T08:08:42.305622+0000","last_active":"2024-01-30T08:08:49.061539+0000","last_peered":"2024-01-30T08:08:49.061539+0000","last_clean":"2024-01-30T08:08:49.061539+0000","last_became_active":"2024-01-30T08:08:42.305341+0000","last_became_peered":"2024-01-30T08:08:42.305341+0000","last_unstale":"2024-01-30T08:08:49.061539+0000","last_undegraded":"2024-01-30T08:08:49.061539+0000","last_fullsized":"2024-01-30T08:08:49.061539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062120+0000","last_change":"2024-01-30T08:08:41.283528+0000","last_active":"2024-01-30T08:08:49.062120+0000","last_peered":"2024-01-30T08:08:49.062120+0000","last_clean":"2024-01-30T08:08:49.062120+0000","last_became_active":"2024-01-30T08:08:41.283251+0000","last_became_peered":"2024-01-30T08:08:41.283251+0000","last_unstale":"2024-01-30T08:08:49.062120+0000","last_undegraded":"2024-01-30T08:08:49.062120+0000","last_fullsized":"2024-01-30T08:08:49.062120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:48:28.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306255+0000","last_change":"2024-01-30T08:08:46.562419+0000","last_active":"2024-01-30T08:08:47.306255+0000","last_peered":"2024-01-30T08:08:47.306255+0000","last_clean":"2024-01-30T08:08:47.306255+0000","last_became_active":"2024-01-30T08:08:46.562016+0000","last_became_peered":"2024-01-30T08:08:46.562016+0000","last_unstale":"2024-01-30T08:08:47.306255+0000","last_undegraded":"2024-01-30T08:08:47.306255+0000","last_fullsized":"2024-01-30T08:08:47.306255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:52.532600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061999+0000","last_change":"2024-01-30T08:08:42.286331+0000","last_active":"2024-01-30T08:08:49.061999+0000","last_peered":"2024-01-30T08:08:49.061999+0000","last_clean":"2024-01-30T08:08:49.061999+0000","last_became_active":"2024-01-30T08:08:42.286070+0000","last_became_peered":"2024-01-30T08:08:42.286070+0000","last_unstale":"2024-01-30T08:08:49.061999+0000","last_undegraded":"2024-01-30T08:08:49.061999+0000","last_fullsized":"2024-01-30T08:08:49.061999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:49:29.159312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062387+0000","last_change":"2024-01-30T08:08:41.279978+0000","last_active":"2024-01-30T08:08:49.062387+0000","last_peered":"2024-01-30T08:08:49.062387+0000","last_clean":"2024-01-30T08:08:49.062387+0000","last_became_active":"2024-01-30T08:08:41.279673+0000","last_became_peered":"2024-01-30T08:08:41.279673+0000","last_unstale":"2024-01-30T08:08:49.062387+0000","last_undegraded":"2024-01-30T08:08:49.062387+0000","last_fullsized":"2024-01-30T08:08:49.062387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:24.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062307+0000","last_change":"2024-01-30T08:08:46.561776+0000","last_active":"2024-01-30T08:08:49.062307+0000","last_peered":"2024-01-30T08:08:49.062307+0000","last_clean":"2024-01-30T08:08:49.062307+0000","last_became_active":"2024-01-30T08:08:46.561227+0000","last_became_peered":"2024-01-30T08:08:46.561227+0000","last_unstale":"2024-01-30T08:08:49.062307+0000","last_undegraded":"2024-01-30T08:08:49.062307+0000","last_fullsized":"2024-01-30T08:08:49.062307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:07.684344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060787+0000","last_change":"2024-01-30T08:08:42.289925+0000","last_active":"2024-01-30T08:08:49.060787+0000","last_peered":"2024-01-30T08:08:49.060787+0000","last_clean":"2024-01-30T08:08:49.060787+0000","last_became_active":"2024-01-30T08:08:42.289634+0000","last_became_peered":"2024-01-30T08:08:42.289634+0000","last_unstale":"2024-01-30T08:08:49.060787+0000","last_undegraded":"2024-01-30T08:08:49.060787+0000","last_fullsized":"2024-01-30T08:08:49.060787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:57.307398+0000","last_change":"2024-01-30T08:08:41.274369+0000","last_active":"2024-01-30T08:08:57.307398+0000","last_peered":"2024-01-30T08:08:57.307398+0000","last_clean":"2024-01-30T08:08:57.307398+0000","last_became_active":"2024-01-30T08:08:41.274054+0000","last_became_peered":"2024-01-30T08:08:41.274054+0000","last_unstale":"2024-01-30T08:08:57.307398+0000","last_undegraded":"2024-01-30T08:08:57.307398+0000","last_fullsized":"2024-01-30T08:08:57.307398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063316+0000","last_change":"2024-01-30T08:08:46.309278+0000","last_active":"2024-01-30T08:08:49.063316+0000","last_peered":"2024-01-30T08:08:49.063316+0000","last_clean":"2024-01-30T08:08:49.063316+0000","last_became_active":"2024-01-30T08:08:46.308827+0000","last_became_peered":"2024-01-30T08:08:46.308827+0000","last_unstale":"2024-01-30T08:08:49.063316+0000","last_undegraded":"2024-01-30T08:08:49.063316+0000","last_fullsized":"2024-01-30T08:08:49.063316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:18.404996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306375+0000","last_change":"2024-01-30T08:08:42.295489+0000","last_active":"2024-01-30T08:08:47.306375+0000","last_peered":"2024-01-30T08:08:47.306375+0000","last_clean":"2024-01-30T08:08:47.306375+0000","last_became_active":"2024-01-30T08:08:42.295174+0000","last_became_peered":"2024-01-30T08:08:42.295174+0000","last_unstale":"2024-01-30T08:08:47.306375+0000","last_undegraded":"2024-01-30T08:08:47.306375+0000","last_fullsized":"2024-01-30T08:08:47.306375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:45.352887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063672+0000","last_change":"2024-01-30T08:08:41.285933+0000","last_active":"2024-01-30T08:08:49.063672+0000","last_peered":"2024-01-30T08:08:49.063672+0000","last_clean":"2024-01-30T08:08:49.063672+0000","last_became_active":"2024-01-30T08:08:41.285666+0000","last_became_peered":"2024-01-30T08:08:41.285666+0000","last_unstale":"2024-01-30T08:08:49.063672+0000","last_undegraded":"2024-01-30T08:08:49.063672+0000","last_fullsized":"2024-01-30T08:08:49.063672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306259+0000","last_change":"2024-01-30T08:08:46.309394+0000","last_active":"2024-01-30T08:08:47.306259+0000","last_peered":"2024-01-30T08:08:47.306259+0000","last_clean":"2024-01-30T08:08:47.306259+0000","last_became_active":"2024-01-30T08:08:46.308580+0000","last_became_peered":"2024-01-30T08:08:46.308580+0000","last_unstale":"2024-01-30T08:08:47.306259+0000","last_undegraded":"2024-01-30T08:08:47.306259+0000","last_fullsized":"2024-01-30T08:08:47.306259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062825+0000","last_change":"2024-01-30T08:08:42.278568+0000","last_active":"2024-01-30T08:08:49.062825+0000","last_peered":"2024-01-30T08:08:49.062825+0000","last_clean":"2024-01-30T08:08:49.062825+0000","last_became_active":"2024-01-30T08:08:42.278276+0000","last_became_peered":"2024-01-30T08:08:42.278276+0000","last_unstale":"2024-01-30T08:08:49.062825+0000","last_undegraded":"2024-01-30T08:08:49.062825+0000","last_fullsized":"2024-01-30T08:08:49.062825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:58:32.360625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062543+0000","last_change":"2024-01-30T08:08:41.282653+0000","last_active":"2024-01-30T08:08:49.062543+0000","last_peered":"2024-01-30T08:08:49.062543+0000","last_clean":"2024-01-30T08:08:49.062543+0000","last_became_active":"2024-01-30T08:08:41.282366+0000","last_became_peered":"2024-01-30T08:08:41.282366+0000","last_unstale":"2024-01-30T08:08:49.062543+0000","last_undegraded":"2024-01-30T08:08:49.062543+0000","last_fullsized":"2024-01-30T08:08:49.062543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:46:13.875970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305335+0000","last_change":"2024-01-30T08:08:46.315140+0000","last_active":"2024-01-30T08:08:47.305335+0000","last_peered":"2024-01-30T08:08:47.305335+0000","last_clean":"2024-01-30T08:08:47.305335+0000","last_became_active":"2024-01-30T08:08:46.314739+0000","last_became_peered":"2024-01-30T08:08:46.314739+0000","last_unstale":"2024-01-30T08:08:47.305335+0000","last_undegraded":"2024-01-30T08:08:47.305335+0000","last_fullsized":"2024-01-30T08:08:47.305335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:44:48.427798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062325+0000","last_change":"2024-01-30T08:08:42.291387+0000","last_active":"2024-01-30T08:08:49.062325+0000","last_peered":"2024-01-30T08:08:49.062325+0000","last_clean":"2024-01-30T08:08:49.062325+0000","last_became_active":"2024-01-30T08:08:42.290925+0000","last_became_peered":"2024-01-30T08:08:42.290925+0000","last_unstale":"2024-01-30T08:08:49.062325+0000","last_undegraded":"2024-01-30T08:08:49.062325+0000","last_fullsized":"2024-01-30T08:08:49.062325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:18:35.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307293+0000","last_change":"2024-01-30T08:08:41.287404+0000","last_active":"2024-01-30T08:08:47.307293+0000","last_peered":"2024-01-30T08:08:47.307293+0000","last_clean":"2024-01-30T08:08:47.307293+0000","last_became_active":"2024-01-30T08:08:41.287106+0000","last_became_peered":"2024-01-30T08:08:41.287106+0000","last_unstale":"2024-01-30T08:08:47.307293+0000","last_undegraded":"2024-01-30T08:08:47.307293+0000","last_fullsized":"2024-01-30T08:08:47.307293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305221+0000","last_change":"2024-01-30T08:08:46.565452+0000","last_active":"2024-01-30T08:08:47.305221+0000","last_peered":"2024-01-30T08:08:47.305221+0000","last_clean":"2024-01-30T08:08:47.305221+0000","last_became_active":"2024-01-30T08:08:46.564941+0000","last_became_peered":"2024-01-30T08:08:46.564941+0000","last_unstale":"2024-01-30T08:08:47.305221+0000","last_undegraded":"2024-01-30T08:08:47.305221+0000","last_fullsized":"2024-01-30T08:08:47.305221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:02:06.216545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062488+0000","last_change":"2024-01-30T08:08:46.561905+0000","last_active":"2024-01-30T08:08:49.062488+0000","last_peered":"2024-01-30T08:08:49.062488+0000","last_clean":"2024-01-30T08:08:49.062488+0000","last_became_active":"2024-01-30T08:08:46.561585+0000","last_became_peered":"2024-01-30T08:08:46.561585+0000","last_unstale":"2024-01-30T08:08:49.062488+0000","last_undegraded":"2024-01-30T08:08:49.062488+0000","last_fullsized":"2024-01-30T08:08:49.062488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:30.023145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061874+0000","last_change":"2024-01-30T08:08:42.268086+0000","last_active":"2024-01-30T08:08:49.061874+0000","last_peered":"2024-01-30T08:08:49.061874+0000","last_clean":"2024-01-30T08:08:49.061874+0000","last_became_active":"2024-01-30T08:08:42.267843+0000","last_became_peered":"2024-01-30T08:08:42.267843+0000","last_unstale":"2024-01-30T08:08:49.061874+0000","last_undegraded":"2024-01-30T08:08:49.061874+0000","last_fullsized":"2024-01-30T08:08:49.061874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060969+0000","last_change":"2024-01-30T08:08:41.286334+0000","last_active":"2024-01-30T08:08:49.060969+0000","last_peered":"2024-01-30T08:08:49.060969+0000","last_clean":"2024-01-30T08:08:49.060969+0000","last_became_active":"2024-01-30T08:08:41.286076+0000","last_became_peered":"2024-01-30T08:08:41.286076+0000","last_unstale":"2024-01-30T08:08:49.060969+0000","last_undegraded":"2024-01-30T08:08:49.060969+0000","last_fullsized":"2024-01-30T08:08:49.060969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:28:13.810152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307178+0000","last_change":"2024-01-30T08:08:46.310557+0000","last_active":"2024-01-30T08:08:47.307178+0000","last_peered":"2024-01-30T08:08:47.307178+0000","last_clean":"2024-01-30T08:08:47.307178+0000","last_became_active":"2024-01-30T08:08:46.310122+0000","last_became_peered":"2024-01-30T08:08:46.310122+0000","last_unstale":"2024-01-30T08:08:47.307178+0000","last_undegraded":"2024-01-30T08:08:47.307178+0000","last_fullsized":"2024-01-30T08:08:47.307178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305285+0000","last_change":"2024-01-30T08:08:42.287557+0000","last_active":"2024-01-30T08:08:47.305285+0000","last_peered":"2024-01-30T08:08:47.305285+0000","last_clean":"2024-01-30T08:08:47.305285+0000","last_became_active":"2024-01-30T08:08:42.287258+0000","last_became_peered":"2024-01-30T08:08:42.287258+0000","last_unstale":"2024-01-30T08:08:47.305285+0000","last_undegraded":"2024-01-30T08:08:47.305285+0000","last_fullsized":"2024-01-30T08:08:47.305285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305479+0000","last_change":"2024-01-30T08:08:41.275268+0000","last_active":"2024-01-30T08:08:47.305479+0000","last_peered":"2024-01-30T08:08:47.305479+0000","last_clean":"2024-01-30T08:08:47.305479+0000","last_became_active":"2024-01-30T08:08:41.274599+0000","last_became_peered":"2024-01-30T08:08:41.274599+0000","last_unstale":"2024-01-30T08:08:47.305479+0000","last_undegraded":"2024-01-30T08:08:47.305479+0000","last_fullsized":"2024-01-30T08:08:47.305479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306322+0000","last_change":"2024-01-30T08:08:41.278792+0000","last_active":"2024-01-30T08:08:47.306322+0000","last_peered":"2024-01-30T08:08:47.306322+0000","last_clean":"2024-01-30T08:08:47.306322+0000","last_became_active":"2024-01-30T08:08:41.278539+0000","last_became_peered":"2024-01-30T08:08:41.278539+0000","last_unstale":"2024-01-30T08:08:47.306322+0000","last_undegraded":"2024-01-30T08:08:47.306322+0000","last_fullsized":"2024-01-30T08:08:47.306322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062352+0000","last_change":"2024-01-30T08:08:42.297069+0000","last_active":"2024-01-30T08:08:49.062352+0000","last_peered":"2024-01-30T08:08:49.062352+0000","last_clean":"2024-01-30T08:08:49.062352+0000","last_became_active":"2024-01-30T08:08:42.296723+0000","last_became_peered":"2024-01-30T08:08:42.296723+0000","last_unstale":"2024-01-30T08:08:49.062352+0000","last_undegraded":"2024-01-30T08:08:49.062352+0000","last_fullsized":"2024-01-30T08:08:49.062352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789787+0000","last_change":"2024-01-30T08:08:46.310759+0000","last_active":"2024-01-30T08:08:47.789787+0000","last_peered":"2024-01-30T08:08:47.789787+0000","last_clean":"2024-01-30T08:08:47.789787+0000","last_became_active":"2024-01-30T08:08:46.310380+0000","last_became_peered":"2024-01-30T08:08:46.310380+0000","last_unstale":"2024-01-30T08:08:47.789787+0000","last_undegraded":"2024-01-30T08:08:47.789787+0000","last_fullsized":"2024-01-30T08:08:47.789787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:24.682030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305625+0000","last_change":"2024-01-30T08:08:41.283970+0000","last_active":"2024-01-30T08:08:47.305625+0000","last_peered":"2024-01-30T08:08:47.305625+0000","last_clean":"2024-01-30T08:08:47.305625+0000","last_became_active":"2024-01-30T08:08:41.283694+0000","last_became_peered":"2024-01-30T08:08:41.283694+0000","last_unstale":"2024-01-30T08:08:47.305625+0000","last_undegraded":"2024-01-30T08:08:47.305625+0000","last_fullsized":"2024-01-30T08:08:47.305625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:41:46.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306325+0000","last_change":"2024-01-30T08:08:42.274162+0000","last_active":"2024-01-30T08:08:47.306325+0000","last_peered":"2024-01-30T08:08:47.306325+0000","last_clean":"2024-01-30T08:08:47.306325+0000","last_became_active":"2024-01-30T08:08:42.273902+0000","last_became_peered":"2024-01-30T08:08:42.273902+0000","last_unstale":"2024-01-30T08:08:47.306325+0000","last_undegraded":"2024-01-30T08:08:47.306325+0000","last_fullsized":"2024-01-30T08:08:47.306325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:53.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305982+0000","last_change":"2024-01-30T08:08:46.314987+0000","last_active":"2024-01-30T08:08:47.305982+0000","last_peered":"2024-01-30T08:08:47.305982+0000","last_clean":"2024-01-30T08:08:47.305982+0000","last_became_active":"2024-01-30T08:08:46.314692+0000","last_became_peered":"2024-01-30T08:08:46.314692+0000","last_unstale":"2024-01-30T08:08:47.305982+0000","last_undegraded":"2024-01-30T08:08:47.305982+0000","last_fullsized":"2024-01-30T08:08:47.305982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:49:27.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305354+0000","last_change":"2024-01-30T08:08:42.282230+0000","last_active":"2024-01-30T08:08:47.305354+0000","last_peered":"2024-01-30T08:08:47.305354+0000","last_clean":"2024-01-30T08:08:47.305354+0000","last_became_active":"2024-01-30T08:08:42.281857+0000","last_became_peered":"2024-01-30T08:08:42.281857+0000","last_unstale":"2024-01-30T08:08:47.305354+0000","last_undegraded":"2024-01-30T08:08:47.305354+0000","last_fullsized":"2024-01-30T08:08:47.305354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789483+0000","last_change":"2024-01-30T08:08:42.272404+0000","last_active":"2024-01-30T08:08:47.789483+0000","last_peered":"2024-01-30T08:08:47.789483+0000","last_clean":"2024-01-30T08:08:47.789483+0000","last_became_active":"2024-01-30T08:08:42.272041+0000","last_became_peered":"2024-01-30T08:08:42.272041+0000","last_unstale":"2024-01-30T08:08:47.789483+0000","last_undegraded":"2024-01-30T08:08:47.789483+0000","last_fullsized":"2024-01-30T08:08:47.789483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:50.188325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062098+0000","last_change":"2024-01-30T08:08:42.288942+0000","last_active":"2024-01-30T08:08:49.062098+0000","last_peered":"2024-01-30T08:08:49.062098+0000","last_clean":"2024-01-30T08:08:49.062098+0000","last_became_active":"2024-01-30T08:08:42.288707+0000","last_became_peered":"2024-01-30T08:08:42.288707+0000","last_unstale":"2024-01-30T08:08:49.062098+0000","last_undegraded":"2024-01-30T08:08:49.062098+0000","last_fullsized":"2024-01-30T08:08:49.062098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:51:37.937923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062259+0000","last_change":"2024-01-30T08:08:42.286293+0000","last_active":"2024-01-30T08:08:49.062259+0000","last_peered":"2024-01-30T08:08:49.062259+0000","last_clean":"2024-01-30T08:08:49.062259+0000","last_became_active":"2024-01-30T08:08:42.285945+0000","last_became_peered":"2024-01-30T08:08:42.285945+0000","last_unstale":"2024-01-30T08:08:49.062259+0000","last_undegraded":"2024-01-30T08:08:49.062259+0000","last_fullsized":"2024-01-30T08:08:49.062259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:54:46.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306359+0000","last_change":"2024-01-30T08:08:42.288572+0000","last_active":"2024-01-30T08:08:47.306359+0000","last_peered":"2024-01-30T08:08:47.306359+0000","last_clean":"2024-01-30T08:08:47.306359+0000","last_became_active":"2024-01-30T08:08:42.288269+0000","last_became_peered":"2024-01-30T08:08:42.288269+0000","last_unstale":"2024-01-30T08:08:47.306359+0000","last_undegraded":"2024-01-30T08:08:47.306359+0000","last_fullsized":"2024-01-30T08:08:47.306359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063564+0000","last_change":"2024-01-30T08:08:42.266640+0000","last_active":"2024-01-30T08:08:49.063564+0000","last_peered":"2024-01-30T08:08:49.063564+0000","last_clean":"2024-01-30T08:08:49.063564+0000","last_became_active":"2024-01-30T08:08:42.266344+0000","last_became_peered":"2024-01-30T08:08:42.266344+0000","last_unstale":"2024-01-30T08:08:49.063564+0000","last_undegraded":"2024-01-30T08:08:49.063564+0000","last_fullsized":"2024-01-30T08:08:49.063564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307432+0000","last_change":"2024-01-30T08:08:42.292452+0000","last_active":"2024-01-30T08:08:47.307432+0000","last_peered":"2024-01-30T08:08:47.307432+0000","last_clean":"2024-01-30T08:08:47.307432+0000","last_became_active":"2024-01-30T08:08:42.291993+0000","last_became_peered":"2024-01-30T08:08:42.291993+0000","last_unstale":"2024-01-30T08:08:47.307432+0000","last_undegraded":"2024-01-30T08:08:47.307432+0000","last_fullsized":"2024-01-30T08:08:47.307432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306131+0000","last_change":"2024-01-30T08:08:42.284303+0000","last_active":"2024-01-30T08:08:47.306131+0000","last_peered":"2024-01-30T08:08:47.306131+0000","last_clean":"2024-01-30T08:08:47.306131+0000","last_became_active":"2024-01-30T08:08:42.283629+0000","last_became_peered":"2024-01-30T08:08:42.283629+0000","last_unstale":"2024-01-30T08:08:47.306131+0000","last_undegraded":"2024-01-30T08:08:47.306131+0000","last_fullsized":"2024-01-30T08:08:47.306131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060891+0000","last_change":"2024-01-30T08:08:42.289085+0000","last_active":"2024-01-30T08:08:49.060891+0000","last_peered":"2024-01-30T08:08:49.060891+0000","last_clean":"2024-01-30T08:08:49.060891+0000","last_became_active":"2024-01-30T08:08:42.288819+0000","last_became_peered":"2024-01-30T08:08:42.288819+0000","last_unstale":"2024-01-30T08:08:49.060891+0000","last_undegraded":"2024-01-30T08:08:49.060891+0000","last_fullsized":"2024-01-30T08:08:49.060891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:25:34.589630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305290+0000","last_change":"2024-01-30T08:08:42.285165+0000","last_active":"2024-01-30T08:08:47.305290+0000","last_peered":"2024-01-30T08:08:47.305290+0000","last_clean":"2024-01-30T08:08:47.305290+0000","last_became_active":"2024-01-30T08:08:42.284761+0000","last_became_peered":"2024-01-30T08:08:42.284761+0000","last_unstale":"2024-01-30T08:08:47.305290+0000","last_undegraded":"2024-01-30T08:08:47.305290+0000","last_fullsized":"2024-01-30T08:08:47.305290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061938+0000","last_change":"2024-01-30T08:08:42.284896+0000","last_active":"2024-01-30T08:08:49.061938+0000","last_peered":"2024-01-30T08:08:49.061938+0000","last_clean":"2024-01-30T08:08:49.061938+0000","last_became_active":"2024-01-30T08:08:42.284608+0000","last_became_peered":"2024-01-30T08:08:42.284608+0000","last_unstale":"2024-01-30T08:08:49.061938+0000","last_undegraded":"2024-01-30T08:08:49.061938+0000","last_fullsized":"2024-01-30T08:08:49.061938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:02:49.552868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062131+0000","last_change":"2024-01-30T08:08:42.287556+0000","last_active":"2024-01-30T08:08:49.062131+0000","last_peered":"2024-01-30T08:08:49.062131+0000","last_clean":"2024-01-30T08:08:49.062131+0000","last_became_active":"2024-01-30T08:08:42.287220+0000","last_became_peered":"2024-01-30T08:08:42.287220+0000","last_unstale":"2024-01-30T08:08:49.062131+0000","last_undegraded":"2024-01-30T08:08:49.062131+0000","last_fullsized":"2024-01-30T08:08:49.062131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:26:23.553412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306921+0000","last_change":"2024-01-30T08:08:42.279526+0000","last_active":"2024-01-30T08:08:47.306921+0000","last_peered":"2024-01-30T08:08:47.306921+0000","last_clean":"2024-01-30T08:08:47.306921+0000","last_became_active":"2024-01-30T08:08:42.279278+0000","last_became_peered":"2024-01-30T08:08:42.279278+0000","last_unstale":"2024-01-30T08:08:47.306921+0000","last_undegraded":"2024-01-30T08:08:47.306921+0000","last_fullsized":"2024-01-30T08:08:47.306921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061442+0000","last_change":"2024-01-30T08:08:42.289284+0000","last_active":"2024-01-30T08:08:49.061442+0000","last_peered":"2024-01-30T08:08:49.061442+0000","last_clean":"2024-01-30T08:08:49.061442+0000","last_became_active":"2024-01-30T08:08:42.289033+0000","last_became_peered":"2024-01-30T08:08:42.289033+0000","last_unstale":"2024-01-30T08:08:49.061442+0000","last_undegraded":"2024-01-30T08:08:49.061442+0000","last_fullsized":"2024-01-30T08:08:49.061442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:50.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789921+0000","last_change":"2024-01-30T08:08:42.275565+0000","last_active":"2024-01-30T08:08:47.789921+0000","last_peered":"2024-01-30T08:08:47.789921+0000","last_clean":"2024-01-30T08:08:47.789921+0000","last_became_active":"2024-01-30T08:08:42.275279+0000","last_became_peered":"2024-01-30T08:08:42.275279+0000","last_unstale":"2024-01-30T08:08:47.789921+0000","last_undegraded":"2024-01-30T08:08:47.789921+0000","last_fullsized":"2024-01-30T08:08:47.789921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:19.520174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062744+0000","last_change":"2024-01-30T08:08:42.300035+0000","last_active":"2024-01-30T08:08:49.062744+0000","last_peered":"2024-01-30T08:08:49.062744+0000","last_clean":"2024-01-30T08:08:49.062744+0000","last_became_active":"2024-01-30T08:08:42.299735+0000","last_became_peered":"2024-01-30T08:08:42.299735+0000","last_unstale":"2024-01-30T08:08:49.062744+0000","last_undegraded":"2024-01-30T08:08:49.062744+0000","last_fullsized":"2024-01-30T08:08:49.062744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:16:58.027734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060796+0000","last_change":"2024-01-30T08:08:42.274180+0000","last_active":"2024-01-30T08:08:49.060796+0000","last_peered":"2024-01-30T08:08:49.060796+0000","last_clean":"2024-01-30T08:08:49.060796+0000","last_became_active":"2024-01-30T08:08:42.273798+0000","last_became_peered":"2024-01-30T08:08:42.273798+0000","last_unstale":"2024-01-30T08:08:49.060796+0000","last_undegraded":"2024-01-30T08:08:49.060796+0000","last_fullsized":"2024-01-30T08:08:49.060796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062221+0000","last_change":"2024-01-30T08:08:42.272239+0000","last_active":"2024-01-30T08:08:49.062221+0000","last_peered":"2024-01-30T08:08:49.062221+0000","last_clean":"2024-01-30T08:08:49.062221+0000","last_became_active":"2024-01-30T08:08:42.270429+0000","last_became_peered":"2024-01-30T08:08:42.270429+0000","last_unstale":"2024-01-30T08:08:49.062221+0000","last_undegraded":"2024-01-30T08:08:49.062221+0000","last_fullsized":"2024-01-30T08:08:49.062221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061945+0000","last_change":"2024-01-30T08:08:42.279383+0000","last_active":"2024-01-30T08:08:49.061945+0000","last_peered":"2024-01-30T08:08:49.061945+0000","last_clean":"2024-01-30T08:08:49.061945+0000","last_became_active":"2024-01-30T08:08:42.279081+0000","last_became_peered":"2024-01-30T08:08:42.279081+0000","last_unstale":"2024-01-30T08:08:49.061945+0000","last_undegraded":"2024-01-30T08:08:49.061945+0000","last_fullsized":"2024-01-30T08:08:49.061945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:11:44.572777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305417+0000","last_change":"2024-01-30T08:08:42.277550+0000","last_active":"2024-01-30T08:08:47.305417+0000","last_peered":"2024-01-30T08:08:47.305417+0000","last_clean":"2024-01-30T08:08:47.305417+0000","last_became_active":"2024-01-30T08:08:42.276237+0000","last_became_peered":"2024-01-30T08:08:42.276237+0000","last_unstale":"2024-01-30T08:08:47.305417+0000","last_undegraded":"2024-01-30T08:08:47.305417+0000","last_fullsized":"2024-01-30T08:08:47.305417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306274+0000","last_change":"2024-01-30T08:08:42.282127+0000","last_active":"2024-01-30T08:08:47.306274+0000","last_peered":"2024-01-30T08:08:47.306274+0000","last_clean":"2024-01-30T08:08:47.306274+0000","last_became_active":"2024-01-30T08:08:42.281546+0000","last_became_peered":"2024-01-30T08:08:42.281546+0000","last_unstale":"2024-01-30T08:08:47.306274+0000","last_undegraded":"2024-01-30T08:08:47.306274+0000","last_fullsized":"2024-01-30T08:08:47.306274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:48.497646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307235+0000","last_change":"2024-01-30T08:08:42.280580+0000","last_active":"2024-01-30T08:08:47.307235+0000","last_peered":"2024-01-30T08:08:47.307235+0000","last_clean":"2024-01-30T08:08:47.307235+0000","last_became_active":"2024-01-30T08:08:42.280215+0000","last_became_peered":"2024-01-30T08:08:42.280215+0000","last_unstale":"2024-01-30T08:08:47.307235+0000","last_undegraded":"2024-01-30T08:08:47.307235+0000","last_fullsized":"2024-01-30T08:08:47.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307392+0000","last_change":"2024-01-30T08:08:42.274307+0000","last_active":"2024-01-30T08:08:47.307392+0000","last_peered":"2024-01-30T08:08:47.307392+0000","last_clean":"2024-01-30T08:08:47.307392+0000","last_became_active":"2024-01-30T08:08:42.273219+0000","last_became_peered":"2024-01-30T08:08:42.273219+0000","last_unstale":"2024-01-30T08:08:47.307392+0000","last_undegraded":"2024-01-30T08:08:47.307392+0000","last_fullsized":"2024-01-30T08:08:47.307392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061291+0000","last_change":"2024-01-30T08:08:42.298549+0000","last_active":"2024-01-30T08:08:49.061291+0000","last_peered":"2024-01-30T08:08:49.061291+0000","last_clean":"2024-01-30T08:08:49.061291+0000","last_became_active":"2024-01-30T08:08:42.298085+0000","last_became_peered":"2024-01-30T08:08:42.298085+0000","last_unstale":"2024-01-30T08:08:49.061291+0000","last_undegraded":"2024-01-30T08:08:49.061291+0000","last_fullsized":"2024-01-30T08:08:49.061291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:04.518076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305168+0000","last_change":"2024-01-30T08:08:42.278935+0000","last_active":"2024-01-30T08:08:47.305168+0000","last_peered":"2024-01-30T08:08:47.305168+0000","last_clean":"2024-01-30T08:08:47.305168+0000","last_became_active":"2024-01-30T08:08:42.278462+0000","last_became_peered":"2024-01-30T08:08:42.278462+0000","last_unstale":"2024-01-30T08:08:47.305168+0000","last_undegraded":"2024-01-30T08:08:47.305168+0000","last_fullsized":"2024-01-30T08:08:47.305168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060808+0000","last_change":"2024-01-30T08:08:42.287564+0000","last_active":"2024-01-30T08:08:49.060808+0000","last_peered":"2024-01-30T08:08:49.060808+0000","last_clean":"2024-01-30T08:08:49.060808+0000","last_became_active":"2024-01-30T08:08:42.287236+0000","last_became_peered":"2024-01-30T08:08:42.287236+0000","last_unstale":"2024-01-30T08:08:49.060808+0000","last_undegraded":"2024-01-30T08:08:49.060808+0000","last_fullsized":"2024-01-30T08:08:49.060808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061935+0000","last_change":"2024-01-30T08:08:42.273849+0000","last_active":"2024-01-30T08:08:49.061935+0000","last_peered":"2024-01-30T08:08:49.061935+0000","last_clean":"2024-01-30T08:08:49.061935+0000","last_became_active":"2024-01-30T08:08:42.273535+0000","last_became_peered":"2024-01-30T08:08:42.273535+0000","last_unstale":"2024-01-30T08:08:49.061935+0000","last_undegraded":"2024-01-30T08:08:49.061935+0000","last_fullsized":"2024-01-30T08:08:49.061935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:05:19.851128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061350+0000","last_change":"2024-01-30T08:08:42.290524+0000","last_active":"2024-01-30T08:08:49.061350+0000","last_peered":"2024-01-30T08:08:49.061350+0000","last_clean":"2024-01-30T08:08:49.061350+0000","last_became_active":"2024-01-30T08:08:42.290271+0000","last_became_peered":"2024-01-30T08:08:42.290271+0000","last_unstale":"2024-01-30T08:08:49.061350+0000","last_undegraded":"2024-01-30T08:08:49.061350+0000","last_fullsized":"2024-01-30T08:08:49.061350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:19.978105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062197+0000","last_change":"2024-01-30T08:08:42.291250+0000","last_active":"2024-01-30T08:08:49.062197+0000","last_peered":"2024-01-30T08:08:49.062197+0000","last_clean":"2024-01-30T08:08:49.062197+0000","last_became_active":"2024-01-30T08:08:42.290996+0000","last_became_peered":"2024-01-30T08:08:42.290996+0000","last_unstale":"2024-01-30T08:08:49.062197+0000","last_undegraded":"2024-01-30T08:08:49.062197+0000","last_fullsized":"2024-01-30T08:08:49.062197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:25.994167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062296+0000","last_change":"2024-01-30T08:08:42.274737+0000","last_active":"2024-01-30T08:08:49.062296+0000","last_peered":"2024-01-30T08:08:49.062296+0000","last_clean":"2024-01-30T08:08:49.062296+0000","last_became_active":"2024-01-30T08:08:42.274400+0000","last_became_peered":"2024-01-30T08:08:42.274400+0000","last_unstale":"2024-01-30T08:08:49.062296+0000","last_undegraded":"2024-01-30T08:08:49.062296+0000","last_fullsized":"2024-01-30T08:08:49.062296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:30:39.631576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063741+0000","last_change":"2024-01-30T08:08:42.279330+0000","last_active":"2024-01-30T08:08:49.063741+0000","last_peered":"2024-01-30T08:08:49.063741+0000","last_clean":"2024-01-30T08:08:49.063741+0000","last_became_active":"2024-01-30T08:08:42.279149+0000","last_became_peered":"2024-01-30T08:08:42.279149+0000","last_unstale":"2024-01-30T08:08:49.063741+0000","last_undegraded":"2024-01-30T08:08:49.063741+0000","last_fullsized":"2024-01-30T08:08:49.063741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061155+0000","last_change":"2024-01-30T08:08:42.293738+0000","last_active":"2024-01-30T08:08:49.061155+0000","last_peered":"2024-01-30T08:08:49.061155+0000","last_clean":"2024-01-30T08:08:49.061155+0000","last_became_active":"2024-01-30T08:08:42.293398+0000","last_became_peered":"2024-01-30T08:08:42.293398+0000","last_unstale":"2024-01-30T08:08:49.061155+0000","last_undegraded":"2024-01-30T08:08:49.061155+0000","last_fullsized":"2024-01-30T08:08:49.061155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:43.542616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":694227,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":694283,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:09:07.683 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-30T08:09:07.683 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-30T08:09:07.683 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-30T08:09:07.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-30T08:09:07.684 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-30T08:09:07.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa25cc00640 1 Processor -- start 2024-01-30T08:09:07.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa25cc00640 1 -- start start 2024-01-30T08:09:07.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa25cc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2580a4e50 0x7fa2580729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa25cc00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2580c3e40 con 0x7fa258158a00 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa25cc00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2580a8c20 con 0x7fa2580c4e00 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa25cc00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2580c42d0 con 0x7fa2580a4e50 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa255400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2580a4e50 0x7fa2580729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa256800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa258158a00 0x7fa25815adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37002/0 (socket says 172.21.15.50:37002) 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa255400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2580a4e50 0x7fa2580729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59108/0 (socket says 172.21.15.50:59108) 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa256800640 1 -- 172.21.15.50:0/3012157100 learned_addr learned my addr 172.21.15.50:0/3012157100 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa255e00640 1 --1- 172.21.15.50:0/3012157100 >> v1:172.21.15.125:6789/0 conn(0x7fa2580c4e00 0x7fa2580a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:54862/0 (socket says 172.21.15.50:54862) 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa255400640 1 -- 172.21.15.50:0/3012157100 >> v1:172.21.15.125:6789/0 conn(0x7fa2580c4e00 legacy=0x7fa2580a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa255400640 1 -- 172.21.15.50:0/3012157100 >> v1:172.21.15.50:6789/0 conn(0x7fa258158a00 legacy=0x7fa25815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa254a00640 1 -- 172.21.15.50:0/3012157100 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898030533 0 0) 0x7fa2580a8c20 con 0x7fa2580c4e00 2024-01-30T08:09:07.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.859+0000 7fa255400640 1 -- 172.21.15.50:0/3012157100 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580c3b10 con 0x7fa2580a4e50 2024-01-30T08:09:07.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa255400640 1 --2- 172.21.15.50:0/3012157100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580a4e50 0x7fa2580729a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa24000ba90 tx=0x7fa24001eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b6dd389c1082bd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa254a00640 1 -- 172.21.15.50:0/3012157100 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400a7b30 con 0x7fa2580a4e50 2024-01-30T08:09:07.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa254a00640 1 -- 172.21.15.50:0/3012157100 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400a7c90 con 0x7fa2580a4e50 2024-01-30T08:09:07.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa254a00640 1 -- 172.21.15.50:0/3012157100 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400af440 con 0x7fa2580a4e50 2024-01-30T08:09:07.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa25cc00640 1 -- 172.21.15.50:0/3012157100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580a4e50 msgr2=0x7fa2580729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa25cc00640 1 --2- 172.21.15.50:0/3012157100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580a4e50 0x7fa2580729a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa24000ba90 tx=0x7fa24001eb20 comp rx=0 tx=0).stop 2024-01-30T08:09:07.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa25cc00640 1 -- 172.21.15.50:0/3012157100 shutdown_connections 2024-01-30T08:09:07.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa25cc00640 1 --2- 172.21.15.50:0/3012157100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580a4e50 0x7fa2580729a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa25cc00640 1 -- 172.21.15.50:0/3012157100 >> 172.21.15.50:0/3012157100 conn(0x7fa2580c5b50 msgr2=0x7fa2580c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:07.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa25cc00640 1 -- 172.21.15.50:0/3012157100 shutdown_connections 2024-01-30T08:09:07.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.863+0000 7fa25cc00640 1 -- 172.21.15.50:0/3012157100 wait complete. 2024-01-30T08:09:07.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 Processor -- start 2024-01-30T08:09:07.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 -- start start 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2580a4e50 0x7fa25806d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580c4e00 0x7fa258149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa258158a00 0x7fa25814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25814bf30 con 0x7fa2580c4e00 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2581516c0 con 0x7fa2580a4e50 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25806dab0 con 0x7fa258158a00 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580c4e00 0x7fa258149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580c4e00 0x7fa258149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59124/0 (socket says 172.21.15.50:59124) 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 -- 172.21.15.50:0/2057314102 learned_addr learned my addr 172.21.15.50:0/2057314102 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255e00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2580a4e50 0x7fa25806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa256800640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa258158a00 0x7fa25814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 -- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa258158a00 msgr2=0x7fa25814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa258158a00 0x7fa25814a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 -- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2580a4e50 msgr2=0x7fa25806d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2580a4e50 0x7fa25806d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 -- 172.21.15.50:0/2057314102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24000b6c0 con 0x7fa2580c4e00 2024-01-30T08:09:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa255400640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580c4e00 0x7fa258149df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa2400b2040 tx=0x7fa24001b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa24e000640 1 -- 172.21.15.50:0/2057314102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400b8460 con 0x7fa2580c4e00 2024-01-30T08:09:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa24e000640 1 -- 172.21.15.50:0/2057314102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400b85e0 con 0x7fa2580c4e00 2024-01-30T08:09:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa258153340 con 0x7fa2580c4e00 2024-01-30T08:09:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa24e000640 1 -- 172.21.15.50:0/2057314102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400b8990 con 0x7fa2580c4e00 2024-01-30T08:09:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.867+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25806d5c0 con 0x7fa2580c4e00 2024-01-30T08:09:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.871+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258151e80 con 0x7fa2580c4e00 2024-01-30T08:09:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.871+0000 7fa24e000640 1 -- 172.21.15.50:0/2057314102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa2400b6070 con 0x7fa2580c4e00 2024-01-30T08:09:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.871+0000 7fa24e000640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa230066500 0x7fa2300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.871+0000 7fa24e000640 1 -- 172.21.15.50:0/2057314102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa24011ef20 con 0x7fa2580c4e00 2024-01-30T08:09:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.871+0000 7fa255e00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa230066500 0x7fa2300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.871+0000 7fa255e00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa230066500 0x7fa2300689c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa248000f70 tx=0x7fa248007240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:07.875+0000 7fa24e000640 1 -- 172.21.15.50:0/2057314102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa258151e80 con 0x7fa2580c4e00 2024-01-30T08:09:08.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.071+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa258151e80 con 0x7fa2580c4e00 2024-01-30T08:09:08.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.075+0000 7fa24e000640 1 -- 172.21.15.50:0/2057314102 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164184 (secure 0 0 0) 0x7fa258151e80 con 0x7fa2580c4e00 2024-01-30T08:09:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa230066500 msgr2=0x7fa2300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa230066500 0x7fa2300689c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa248000f70 tx=0x7fa248007240 comp rx=0 tx=0).stop 2024-01-30T08:09:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580c4e00 msgr2=0x7fa258149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580c4e00 0x7fa258149df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa2400b2040 tx=0x7fa24001b8c0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 shutdown_connections 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa230066500 0x7fa2300689c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa258158a00 0x7fa25814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2580c4e00 0x7fa258149df0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 --2- 172.21.15.50:0/2057314102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2580a4e50 0x7fa25806d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 >> 172.21.15.50:0/2057314102 conn(0x7fa2580c5b50 msgr2=0x7fa2580c1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 shutdown_connections 2024-01-30T08:09:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.079+0000 7fa25cc00640 1 -- 172.21.15.50:0/2057314102 wait complete. 2024-01-30T08:09:08.103 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2956883845},{"type":"v1","addr":"172.21.15.125:6833","nonce":2956883845}]},"active_addr":"172.21.15.125:6833/2956883845","active_change":"2024-01-30T08:08:29.037331+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":828110968}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":2652487876}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":1632795156}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":836780533}]}]} 2024-01-30T08:09:08.106 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-30T08:09:08.106 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-30T08:09:08.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17f5200640 1 Processor -- start 2024-01-30T08:09:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17f5200640 1 -- start start 2024-01-30T08:09:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17f5200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c4760 0x7f17f006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17f5200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00a8cf0 con 0x7f17f00c5650 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17f5200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f0072a30 con 0x7f17f00c1840 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17f5200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00a8f40 con 0x7f17f00c4760 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17ed400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17f00c5650 0x7f17f006cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37004/0 (socket says 172.21.15.50:37004) 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.243+0000 7f17ed400640 1 -- 172.21.15.50:0/3078140835 learned_addr learned my addr 172.21.15.50:0/3078140835 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17ee800640 1 --2- 172.21.15.50:0/3078140835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c4760 0x7f17f006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17eca00640 1 -- 172.21.15.50:0/3078140835 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166324393 0 0) 0x7f17f00a8cf0 con 0x7f17f00c5650 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17eca00640 1 -- 172.21.15.50:0/3078140835 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d0003530 con 0x7f17f00c5650 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17eca00640 1 -- 172.21.15.50:0/3078140835 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239268835 0 0) 0x7f17f0072a30 con 0x7f17f00c1840 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17eca00640 1 -- 172.21.15.50:0/3078140835 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f00a8cf0 con 0x7f17f00c1840 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17ee800640 1 -- 172.21.15.50:0/3078140835 >> v1:172.21.15.125:6789/0 conn(0x7f17f00c1840 legacy=0x7f17f00a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17ee800640 1 -- 172.21.15.50:0/3078140835 >> v1:172.21.15.50:6789/0 conn(0x7f17f00c5650 legacy=0x7f17f006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17ee800640 1 -- 172.21.15.50:0/3078140835 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0072cd0 con 0x7f17f00c4760 2024-01-30T08:09:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17ee800640 1 --2- 172.21.15.50:0/3078140835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c4760 0x7f17f006d610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009dc0 tx=0x7f17e801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3537e1cffab57003 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:08.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17eca00640 1 -- 172.21.15.50:0/3078140835 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80a59c0 con 0x7f17f00c4760 2024-01-30T08:09:08.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17eca00640 1 -- 172.21.15.50:0/3078140835 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80a5b20 con 0x7f17f00c4760 2024-01-30T08:09:08.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.247+0000 7f17eca00640 1 -- 172.21.15.50:0/3078140835 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80ad440 con 0x7f17f00c4760 2024-01-30T08:09:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- 172.21.15.50:0/3078140835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c4760 msgr2=0x7f17f006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 --2- 172.21.15.50:0/3078140835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c4760 0x7f17f006d610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009dc0 tx=0x7f17e801c8e0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- 172.21.15.50:0/3078140835 shutdown_connections 2024-01-30T08:09:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 --2- 172.21.15.50:0/3078140835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c4760 0x7f17f006d610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- 172.21.15.50:0/3078140835 >> 172.21.15.50:0/3078140835 conn(0x7f17f00c5b50 msgr2=0x7f17f00c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- 172.21.15.50:0/3078140835 shutdown_connections 2024-01-30T08:09:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- 172.21.15.50:0/3078140835 wait complete. 2024-01-30T08:09:08.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 Processor -- start 2024-01-30T08:09:08.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- start start 2024-01-30T08:09:08.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c1840 0x7f17f0154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f00c4760 0x7f17f0149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17f00c5650 0x7f17f0149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0072250 con 0x7f17f00c5650 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f014f8d0 con 0x7f17f00c4760 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17f5200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f014e6e0 con 0x7f17f00c1840 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.251+0000 7f17ee800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17f00c5650 0x7f17f0149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17f00c5650 0x7f17f0149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59134/0 (socket says 172.21.15.50:59134) 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 -- 172.21.15.50:0/2271573379 learned_addr learned my addr 172.21.15.50:0/2271573379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ed400640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f00c4760 0x7f17f0149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ede00640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c1840 0x7f17f0154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 -- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c1840 msgr2=0x7f17f0154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c1840 0x7f17f0154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 -- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f00c4760 msgr2=0x7f17f0149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f00c4760 0x7f17f0149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 -- 172.21.15.50:0/2271573379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8009a70 con 0x7f17f00c5650 2024-01-30T08:09:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ed400640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f00c4760 0x7f17f0149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17ee800640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17f00c5650 0x7f17f0149e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17e80b0040 tx=0x7f17e8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17e6000640 1 -- 172.21.15.50:0/2271573379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80adcc0 con 0x7f17f00c5650 2024-01-30T08:09:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17e6000640 1 -- 172.21.15.50:0/2271573379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80ade40 con 0x7f17f00c5650 2024-01-30T08:09:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17e6000640 1 -- 172.21.15.50:0/2271573379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80b9690 con 0x7f17f00c5650 2024-01-30T08:09:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f0070000 con 0x7f17f00c5650 2024-01-30T08:09:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f01ed330 con 0x7f17f00c5650 2024-01-30T08:09:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0074a20 con 0x7f17f00c5650 2024-01-30T08:09:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.255+0000 7f17e6000640 1 -- 172.21.15.50:0/2271573379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f17e80b97f0 con 0x7f17f00c5650 2024-01-30T08:09:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.259+0000 7f17e6000640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f17c8066500 0x7f17c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.259+0000 7f17e6000640 1 -- 172.21.15.50:0/2271573379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17e811f630 con 0x7f17f00c5650 2024-01-30T08:09:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.259+0000 7f17ede00640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f17c8066500 0x7f17c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.259+0000 7f17ede00640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f17c8066500 0x7f17c80689c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17f01ea570 tx=0x7f17e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.259+0000 7f17e6000640 1 -- 172.21.15.50:0/2271573379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f17e80ec730 con 0x7f17f00c5650 2024-01-30T08:09:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.423+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f00c4540 con 0x7f17f00c5650 2024-01-30T08:09:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.423+0000 7f17e6000640 1 -- 172.21.15.50:0/2271573379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f17e8009450 con 0x7f17f00c5650 2024-01-30T08:09:08.427 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:08.427 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f17c8066500 msgr2=0x7f17c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f17c8066500 0x7f17c80689c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17f01ea570 tx=0x7f17e0009040 comp rx=0 tx=0).stop 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17f00c5650 msgr2=0x7f17f0149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17f00c5650 0x7f17f0149e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17e80b0040 tx=0x7f17e8019680 comp rx=0 tx=0).stop 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 shutdown_connections 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f00c4760 0x7f17f0149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f17c8066500 0x7f17c80689c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17f00c5650 0x7f17f0149e70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 --2- 172.21.15.50:0/2271573379 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f00c1840 0x7f17f0154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 >> 172.21.15.50:0/2271573379 conn(0x7f17f00c5b50 msgr2=0x7f17f00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 shutdown_connections 2024-01-30T08:09:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.427+0000 7f17f5200640 1 -- 172.21.15.50:0/2271573379 wait complete. 2024-01-30T08:09:08.449 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-30T08:09:08.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbcd000640 1 Processor -- start 2024-01-30T08:09:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbcd000640 1 -- start start 2024-01-30T08:09:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbcd000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbc80c4e00 0x7fcbc80729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbcd000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc80a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbcd000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80c3e40 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbcd000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc80c42d0 con 0x7fcbc80c4e00 2024-01-30T08:09:08.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbcd000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80a8c20 con 0x7fcbc80a4e50 2024-01-30T08:09:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbc80c4e00 0x7fcbc80729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbc80c4e00 0x7fcbc80729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59138/0 (socket says 172.21.15.50:59138) 2024-01-30T08:09:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5e00640 1 -- 172.21.15.50:0/3260276480 learned_addr learned my addr 172.21.15.50:0/3260276480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:08.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5400640 1 --2- 172.21.15.50:0/3260276480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc80a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5e00640 1 -- 172.21.15.50:0/3260276480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 msgr2=0x7fcbc80a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5e00640 1 --2- 172.21.15.50:0/3260276480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc80a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5e00640 1 -- 172.21.15.50:0/3260276480 >> v1:172.21.15.50:6789/0 conn(0x7fcbc80a9ad0 legacy=0x7fcbc80c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.587+0000 7fcbc5e00640 1 -- 172.21.15.50:0/3260276480 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80c3b10 con 0x7fcbc80c4e00 2024-01-30T08:09:08.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbc5e00640 1 --2- 172.21.15.50:0/3260276480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80c4e00 0x7fcbc80729a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8006fd0 tx=0x7fcbb801e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb7a16b1ab1ec4 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:08.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbc4a00640 1 -- 172.21.15.50:0/3260276480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8004230 con 0x7fcbc80c4e00 2024-01-30T08:09:08.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbc4a00640 1 -- 172.21.15.50:0/3260276480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb80ab070 con 0x7fcbc80c4e00 2024-01-30T08:09:08.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbc4a00640 1 -- 172.21.15.50:0/3260276480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80a7700 con 0x7fcbc80c4e00 2024-01-30T08:09:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 -- 172.21.15.50:0/3260276480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80c4e00 msgr2=0x7fcbc80729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 --2- 172.21.15.50:0/3260276480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80c4e00 0x7fcbc80729a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8006fd0 tx=0x7fcbb801e9a0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 -- 172.21.15.50:0/3260276480 shutdown_connections 2024-01-30T08:09:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 --2- 172.21.15.50:0/3260276480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc80a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 --2- 172.21.15.50:0/3260276480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80c4e00 0x7fcbc80729a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 -- 172.21.15.50:0/3260276480 >> 172.21.15.50:0/3260276480 conn(0x7fcbc80c5b50 msgr2=0x7fcbc80c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:08.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 -- 172.21.15.50:0/3260276480 shutdown_connections 2024-01-30T08:09:08.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.591+0000 7fcbcd000640 1 -- 172.21.15.50:0/3260276480 wait complete. 2024-01-30T08:09:08.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 Processor -- start 2024-01-30T08:09:08.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 -- start start 2024-01-30T08:09:08.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80a9ad0 0x7fcbc814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbc80c4e00 0x7fcbc814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8156eb0 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8156500 con 0x7fcbc80c4e00 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc814ff10 con 0x7fcbc80a4e50 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80a9ad0 0x7fcbc814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80a9ad0 0x7fcbc814f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59140/0 (socket says 172.21.15.50:59140) 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 -- 172.21.15.50:0/2549779239 learned_addr learned my addr 172.21.15.50:0/2549779239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc6800640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbc80c4e00 0x7fcbc814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 -- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 msgr2=0x7fcbc815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 -- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbc80c4e00 msgr2=0x7fcbc814f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbc80c4e00 0x7fcbc814f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 -- 172.21.15.50:0/2549779239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb800b780 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc6800640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbc80c4e00 0x7fcbc814f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5e00640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbc5400640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80a9ad0 0x7fcbc814f290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000d800 tx=0x7fcbb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbbe000640 1 -- 172.21.15.50:0/2549779239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000b6c0 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbbe000640 1 -- 172.21.15.50:0/2549779239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb000b820 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbbe000640 1 -- 172.21.15.50:0/2549779239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000bb90 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc81570c0 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.595+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc81578c0 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.599+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc8074a20 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.599+0000 7fcbbe000640 1 -- 172.21.15.50:0/2549779239 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcbb000bcf0 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.599+0000 7fcbbe000640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcba0066500 0x7fcba00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:08.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.599+0000 7fcbbe000640 1 -- 172.21.15.50:0/2549779239 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbb0084600 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.599+0000 7fcbc5e00640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcba0066500 0x7fcba00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:08.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.599+0000 7fcbc5e00640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcba0066500 0x7fcba00689c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80b1000 tx=0x7fcbb80a9070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:08.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.603+0000 7fcbbe000640 1 -- 172.21.15.50:0/2549779239 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcbb00515a0 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.763+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbc806e530 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.763+0000 7fcbbe000640 1 -- 172.21.15.50:0/2549779239 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7fcbb0054bc0 con 0x7fcbc80a9ad0 2024-01-30T08:09:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:08.767 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcba0066500 msgr2=0x7fcba00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcba0066500 0x7fcba00689c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80b1000 tx=0x7fcbb80a9070 comp rx=0 tx=0).stop 2024-01-30T08:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80a9ad0 msgr2=0x7fcbc814f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80a9ad0 0x7fcbc814f290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000d800 tx=0x7fcbb000dcc0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 shutdown_connections 2024-01-30T08:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbc80c4e00 0x7fcbc814f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcba0066500 0x7fcba00689c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc80a9ad0 0x7fcbc814f290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 --2- 172.21.15.50:0/2549779239 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbc80a4e50 0x7fcbc815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 >> 172.21.15.50:0/2549779239 conn(0x7fcbc80c5b50 msgr2=0x7fcbc8158490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 shutdown_connections 2024-01-30T08:09:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:08.767+0000 7fcbcd000640 1 -- 172.21.15.50:0/2549779239 wait complete. 2024-01-30T08:09:08.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-30T08:09:08.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-30T08:09:08.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-30T08:09:08.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-30T08:09:08.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-30T08:09:08.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-30T08:09:08.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-30T08:09:08.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-30T08:09:09.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f6521e00640 1 Processor -- start 2024-01-30T08:09:09.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f6521e00640 1 -- start start 2024-01-30T08:09:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f662b200640 1 Processor -- start 2024-01-30T08:09:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f6521e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f651c072320 0x7f651c0c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f6521e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f6521e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651c154740 con 0x7f651c0c6630 2024-01-30T08:09:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f6521e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651c0c3cf0 con 0x7f651c072320 2024-01-30T08:09:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f6521e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c154c70 con 0x7f651c06ac90 2024-01-30T08:09:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f651aa00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f651c0c6630 0x7f651c1535a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37658/0 (socket says 172.21.15.50:37658) 2024-01-30T08:09:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f651aa00640 1 -- 172.21.15.50:0/542457161 learned_addr learned my addr 172.21.15.50:0/542457161 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f651b400640 1 --2- 172.21.15.50:0/542457161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f651b400640 1 -- 172.21.15.50:0/542457161 >> v2:172.21.15.50:3300/0 conn(0x7f651c072320 msgr2=0x7f651c0c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f651b400640 1 --2- 172.21.15.50:0/542457161 >> v2:172.21.15.50:3300/0 conn(0x7f651c072320 0x7f651c0c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f651b400640 1 -- 172.21.15.50:0/542457161 >> v1:172.21.15.50:6789/0 conn(0x7f651c0c6630 legacy=0x7f651c1535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f651b400640 1 -- 172.21.15.50:0/542457161 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c0c5420 con 0x7f651c06ac90 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.035+0000 7f662b200640 1 -- start start 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662b200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 0x7f662c0aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662b200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f662c06e6e0 0x7f662c154620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662b200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662c072410 con 0x7f662c0aae50 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662b200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c0c1cb0 con 0x7f662c06e6e0 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662b200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c154b60 con 0x7f662c0c64f0 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f6629400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f662c0aae50 0x7f662c153f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37660/0 (socket says 172.21.15.50:37660) 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f6629400640 1 -- 172.21.15.50:0/378356588 learned_addr learned my addr 172.21.15.50:0/378356588 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:09.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662a800640 1 --2- 172.21.15.50:0/378356588 >> v2:172.21.15.50:3300/0 conn(0x7f662c06e6e0 0x7f662c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662a800640 1 -- 172.21.15.50:0/378356588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 msgr2=0x7f662c0aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662a800640 1 --2- 172.21.15.50:0/378356588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 0x7f662c0aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662a800640 1 -- 172.21.15.50:0/378356588 >> v1:172.21.15.50:6789/0 conn(0x7f662c0aae50 legacy=0x7f662c153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.039+0000 7f662a800640 1 -- 172.21.15.50:0/378356588 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0c0640 con 0x7f662c06e6e0 2024-01-30T08:09:09.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f651b400640 1 --2- 172.21.15.50:0/542457161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c06b0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65040097c0 tx=0x7f650401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cfc1baa0309b52d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6519600640 1 -- 172.21.15.50:0/542457161 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040ab670 con 0x7f651c06ac90 2024-01-30T08:09:09.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6519600640 1 -- 172.21.15.50:0/542457161 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040ab7d0 con 0x7f651c06ac90 2024-01-30T08:09:09.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6519600640 1 -- 172.21.15.50:0/542457161 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040abb60 con 0x7f651c06ac90 2024-01-30T08:09:09.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6521e00640 1 -- 172.21.15.50:0/542457161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 msgr2=0x7f651c06b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6521e00640 1 --2- 172.21.15.50:0/542457161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c06b0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65040097c0 tx=0x7f650401c450 comp rx=0 tx=0).stop 2024-01-30T08:09:09.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6521e00640 1 -- 172.21.15.50:0/542457161 shutdown_connections 2024-01-30T08:09:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6521e00640 1 --2- 172.21.15.50:0/542457161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c06b0a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.043+0000 7f6521e00640 1 --2- 172.21.15.50:0/542457161 >> v2:172.21.15.50:3300/0 conn(0x7f651c072320 0x7f651c0c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f6521e00640 1 -- 172.21.15.50:0/542457161 >> 172.21.15.50:0/542457161 conn(0x7f651c0c5b10 msgr2=0x7f651c0c5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f6521e00640 1 -- 172.21.15.50:0/542457161 shutdown_connections 2024-01-30T08:09:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f5f33e00640 1 Processor -- start 2024-01-30T08:09:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f6521e00640 1 -- 172.21.15.50:0/542457161 wait complete. 2024-01-30T08:09:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f6521e00640 1 Processor -- start 2024-01-30T08:09:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f5f33e00640 1 -- start start 2024-01-30T08:09:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7faa70e00640 1 Processor -- start 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f6521e00640 1 -- start start 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f389cc00640 1 Processor -- start 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f389cc00640 1 -- start start 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f389cc00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38981561a0 0x7f3898158c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f389cc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38980704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f389cc00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3898159180 con 0x7f3898070a20 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f389cc00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3898159c50 con 0x7f38981561a0 2024-01-30T08:09:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f389cc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389815c4d0 con 0x7f38980c2190 2024-01-30T08:09:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f5f33e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f3406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f662a800640 1 --2- 172.21.15.50:0/378356588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c154620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f662400aea0 tx=0x7f662401da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a72f5f49917e504 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f6628a00640 1 -- 172.21.15.50:0/378356588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400a2d0 con 0x7f662c06e6e0 2024-01-30T08:09:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7f6628a00640 1 -- 172.21.15.50:0/378356588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66240a6910 con 0x7f662c06e6e0 2024-01-30T08:09:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f6628a00640 1 -- 172.21.15.50:0/378356588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240a6ca0 con 0x7f662c06e6e0 2024-01-30T08:09:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38980704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38980704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:55860/0 (socket says 172.21.15.50:55860) 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895400640 1 -- 172.21.15.50:0/1199324151 learned_addr learned my addr 172.21.15.50:0/1199324151 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f6521e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f6521e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f651c072320 0x7f651c142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f6521e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0c6630 0x7f651c142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f6521e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0a88d0 con 0x7f651c072320 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f6521e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0a9040 con 0x7f651c0c6630 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f6521e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0ab8c0 con 0x7f651c06ac90 2024-01-30T08:09:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f32a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f3406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f32a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f3406dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:55856/0 (socket says 172.21.15.50:55856) 2024-01-30T08:09:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895400640 1 -- 172.21.15.50:0/1199324151 >> v2:172.21.15.125:3300/0 conn(0x7f38981561a0 msgr2=0x7f3898158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895e00640 1 --2- 172.21.15.50:0/1199324151 >> v2:172.21.15.125:3300/0 conn(0x7f38981561a0 0x7f3898158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0c6630 0x7f651c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0c6630 0x7f651c142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37134/0 (socket says 172.21.15.50:37134) 2024-01-30T08:09:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 -- 172.21.15.50:0/244727492 learned_addr learned my addr 172.21.15.50:0/244727492 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651aa00640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651a000640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f651c072320 0x7f651c142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895400640 1 --2- 172.21.15.50:0/1199324151 >> v2:172.21.15.125:3300/0 conn(0x7f38981561a0 0x7f3898158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.047+0000 7faa70e00640 1 -- start start 2024-01-30T08:09:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3894a00640 1 -- 172.21.15.50:0/1199324151 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762959449 0 0) 0x7f3898159180 con 0x7f3898070a20 2024-01-30T08:09:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f662b200640 1 -- 172.21.15.50:0/378356588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 msgr2=0x7f662c154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa70e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa6c070ce0 0x7faa6c15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa70e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 0x7faa6c0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f662b200640 1 --2- 172.21.15.50:0/378356588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c154620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f662400aea0 tx=0x7f662401da50 comp rx=0 tx=0).stop 2024-01-30T08:09:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895400640 1 -- 172.21.15.50:0/1199324151 >> v1:172.21.15.50:6789/0 conn(0x7f3898070a20 legacy=0x7f389815c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa70e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c070aa0 con 0x7faa6c152db0 2024-01-30T08:09:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa70e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c0704e0 con 0x7faa6c070ce0 2024-01-30T08:09:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa70e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c15d090 con 0x7faa6c0c2220 2024-01-30T08:09:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 -- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 msgr2=0x7f651c147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06ac90 0x7f651c147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 -- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f651c072320 msgr2=0x7f651c142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f3406cba0 0x7f5f3406d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f32000640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f340677a0 0x7f5f3414a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55074/0 (socket says 172.21.15.50:55074) 2024-01-30T08:09:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f340c28a0 con 0x7f5f340677a0 2024-01-30T08:09:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3406e570 con 0x7f5f3406cba0 2024-01-30T08:09:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34150790 con 0x7f5f340725c0 2024-01-30T08:09:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa6a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 0x7faa6c0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa69400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faa6c070ce0 0x7faa6c15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa69e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa6c152db0 0x7faa6c15c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37678/0 (socket says 172.21.15.50:37678) 2024-01-30T08:09:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa69e00640 1 -- 172.21.15.50:0/1899180104 learned_addr learned my addr 172.21.15.50:0/1899180104 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f651c072320 0x7f651c142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f662b200640 1 -- 172.21.15.50:0/378356588 shutdown_connections 2024-01-30T08:09:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651b400640 1 -- 172.21.15.50:0/244727492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504009420 con 0x7f651c0c6630 2024-01-30T08:09:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f651a000640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f651c072320 0x7f651c142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f32a00640 1 -- 172.21.15.50:0/689090206 learned_addr learned my addr 172.21.15.50:0/689090206 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33400640 1 --2- 172.21.15.50:0/689090206 >> v2:172.21.15.125:3300/0 conn(0x7f5f3406cba0 0x7f5f3406d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f662b200640 1 --2- 172.21.15.50:0/378356588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c154620 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895400640 1 -- 172.21.15.50:0/1199324151 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980710a0 con 0x7f38980c2190 2024-01-30T08:09:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f3895e00640 1 --2- 172.21.15.50:0/1199324151 >> v2:172.21.15.125:3300/0 conn(0x7f38981561a0 0x7f3898158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa6a800640 1 -- 172.21.15.50:0/1899180104 >> v2:172.21.15.125:3300/0 conn(0x7faa6c070ce0 msgr2=0x7faa6c15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa6a800640 1 --2- 172.21.15.50:0/1899180104 >> v2:172.21.15.125:3300/0 conn(0x7faa6c070ce0 0x7faa6c15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa6a800640 1 -- 172.21.15.50:0/1899180104 >> v1:172.21.15.50:6789/0 conn(0x7faa6c152db0 legacy=0x7faa6c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7faa6a800640 1 -- 172.21.15.50:0/1899180104 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c159690 con 0x7faa6c0c2220 2024-01-30T08:09:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f662b200640 1 --2- 172.21.15.50:0/378356588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 0x7f662c0aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f662b200640 1 -- 172.21.15.50:0/378356588 >> 172.21.15.50:0/378356588 conn(0x7f662c0a79f0 msgr2=0x7f662c0a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f4608600640 1 Processor -- start 2024-01-30T08:09:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f651b400640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0c6630 0x7f651c142550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65040ad040 tx=0x7f650401ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f4608600640 1 -- start start 2024-01-30T08:09:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040aa8e0 con 0x7f651c0c6630 2024-01-30T08:09:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f662b200640 1 -- 172.21.15.50:0/378356588 shutdown_connections 2024-01-30T08:09:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040aaa40 con 0x7f651c0c6630 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040aadb0 con 0x7f651c0c6630 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f6521e00640 1 -- 172.21.15.50:0/244727492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651c1484a0 con 0x7f651c0c6630 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f6521e00640 1 -- 172.21.15.50:0/244727492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651c1478d0 con 0x7f651c0c6630 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33400640 1 -- 172.21.15.50:0/689090206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 msgr2=0x7f5f3406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33400640 1 --2- 172.21.15.50:0/689090206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f3406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33400640 1 -- 172.21.15.50:0/689090206 >> v1:172.21.15.125:6789/0 conn(0x7f5f340677a0 legacy=0x7f5f3414a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.051+0000 7f5f33400640 1 -- 172.21.15.50:0/689090206 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34150a70 con 0x7f5f3406cba0 2024-01-30T08:09:09.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f4608600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46000c4a30 0x7f46000ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64e4001040 con 0x7f651c0c6630 2024-01-30T08:09:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.055+0000 7f662b200640 1 -- 172.21.15.50:0/378356588 wait complete. 2024-01-30T08:09:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4608600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46000c7520 con 0x7f46000a7000 2024-01-30T08:09:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4606600640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f460014fe10 0x7f4600155a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55080/0 (socket says 172.21.15.50:55080) 2024-01-30T08:09:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4606600640 1 -- 172.21.15.50:0/2480786238 learned_addr learned my addr 172.21.15.50:0/2480786238 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f5f33400640 1 --2- 172.21.15.50:0/689090206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f3406d050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009d90 tx=0x7f5f2c01c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d80b6ab0cae8d843 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa6a800640 1 --2- 172.21.15.50:0/1899180104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 0x7faa6c0c2650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa64009d90 tx=0x7faa6401c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5002ae09ffd6c58f server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f3895400640 1 --2- 172.21.15.50:0/1199324151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38980704e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f388801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f4f61aeabef2b5b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4608600640 1 -- 172.21.15.50:0/2480786238 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46000c6f10 con 0x7f460014fe10 2024-01-30T08:09:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4605c00640 1 --2- 172.21.15.50:0/2480786238 >> v2:172.21.15.50:3300/0 conn(0x7f46000c4a30 0x7f46000ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4608600640 1 -- 172.21.15.50:0/2480786238 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46000c79b0 con 0x7f46000c4a30 2024-01-30T08:09:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa68a00640 1 -- 172.21.15.50:0/1899180104 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640a6700 con 0x7faa6c0c2220 2024-01-30T08:09:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa68a00640 1 -- 172.21.15.50:0/1899180104 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa640a6860 con 0x7faa6c0c2220 2024-01-30T08:09:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa68a00640 1 -- 172.21.15.50:0/1899180104 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640a6bf0 con 0x7faa6c0c2220 2024-01-30T08:09:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f3894a00640 1 -- 172.21.15.50:0/1199324151 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880ab5f0 con 0x7f38980c2190 2024-01-30T08:09:09.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f3894a00640 1 -- 172.21.15.50:0/1199324151 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38880ab750 con 0x7f38980c2190 2024-01-30T08:09:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f3894a00640 1 -- 172.21.15.50:0/1199324151 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880abae0 con 0x7f38980c2190 2024-01-30T08:09:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125265136 0 0) 0x7f46000c6f10 con 0x7f460014fe10 2024-01-30T08:09:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e0003530 con 0x7f460014fe10 2024-01-30T08:09:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f5f31600640 1 -- 172.21.15.50:0/689090206 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0a6650 con 0x7f5f3406cba0 2024-01-30T08:09:09.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 <== mon.1 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3418795124 0 0) 0x7f45e0003530 con 0x7f460014fe10 2024-01-30T08:09:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 >> v2:172.21.15.50:3300/0 conn(0x7f46000c4a30 msgr2=0x7f46000ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 --2- 172.21.15.50:0/2480786238 >> v2:172.21.15.50:3300/0 conn(0x7f46000c4a30 0x7f46000ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 >> v1:172.21.15.50:6789/0 conn(0x7f46000a7000 legacy=0x7f460014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f5f31600640 1 -- 172.21.15.50:0/689090206 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0a67b0 con 0x7f5f3406cba0 2024-01-30T08:09:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f5f31600640 1 -- 172.21.15.50:0/689090206 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0a6650 con 0x7f5f3406cba0 2024-01-30T08:09:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46000ad990 con 0x7f460014fe10 2024-01-30T08:09:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 <== mon.1 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f45e8001680 con 0x7f460014fe10 2024-01-30T08:09:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 >> v1:172.21.15.125:6789/0 conn(0x7f460014fe10 legacy=0x7f4600155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa70e00640 1 -- 172.21.15.50:0/1899180104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 msgr2=0x7faa6c0c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f65040bf410 con 0x7f651c0c6630 2024-01-30T08:09:09.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa70e00640 1 --2- 172.21.15.50:0/1899180104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 0x7faa6c0c2650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa64009d90 tx=0x7faa6401c830 comp rx=0 tx=0).stop 2024-01-30T08:09:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f389cc00640 1 -- 172.21.15.50:0/1199324151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 msgr2=0x7f38980704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f389cc00640 1 --2- 172.21.15.50:0/1199324151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38980704e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f388801c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa70e00640 1 -- 172.21.15.50:0/1899180104 shutdown_connections 2024-01-30T08:09:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa70e00640 1 --2- 172.21.15.50:0/1899180104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 0x7faa6c0c2650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa70e00640 1 --2- 172.21.15.50:0/1899180104 >> v2:172.21.15.125:3300/0 conn(0x7faa6c070ce0 0x7faa6c15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa70e00640 1 -- 172.21.15.50:0/1899180104 >> 172.21.15.50:0/1899180104 conn(0x7faa6c06cb40 msgr2=0x7faa6c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e0003980 0x7f45e0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e00047d0 0x7f45e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e00052b0 0x7f45e000fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f5f33e00640 1 -- 172.21.15.50:0/689090206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 msgr2=0x7f5f3406d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7faa70e00640 1 -- 172.21.15.50:0/1899180104 shutdown_connections 2024-01-30T08:09:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f5f33e00640 1 --2- 172.21.15.50:0/689090206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f3406d050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009d90 tx=0x7f5f2c01c770 comp rx=0 tx=0).stop 2024-01-30T08:09:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f6513400640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f64f4066600 0x7f64f4068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f650411f560 con 0x7f651c0c6630 2024-01-30T08:09:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f6513400640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7f64f406fc40 0x7f64f4072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 --> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64f4072750 con 0x7f64f406fc40 2024-01-30T08:09:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f650411f910 con 0x7f651c0c6630 2024-01-30T08:09:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f389cc00640 1 -- 172.21.15.50:0/1199324151 shutdown_connections 2024-01-30T08:09:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f389cc00640 1 --2- 172.21.15.50:0/1199324151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38980704e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f651aa00640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f64f4066600 0x7f64f4068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f389cc00640 1 --2- 172.21.15.50:0/1199324151 >> v2:172.21.15.125:3300/0 conn(0x7f38981561a0 0x7f3898158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f389cc00640 1 -- 172.21.15.50:0/1199324151 >> 172.21.15.50:0/1199324151 conn(0x7f389806c890 msgr2=0x7f389806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f389cc00640 1 -- 172.21.15.50:0/1199324151 shutdown_connections 2024-01-30T08:09:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000c79b0 con 0x7f45e0003980 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00105c0 con 0x7f45e00047d0 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0010780 con 0x7f45e00052b0 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4605c00640 1 --2- 172.21.15.50:0/2480786238 >> v2:172.21.15.50:3300/0 conn(0x7f46000c4a30 0x7f46000ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4605200640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e00047d0 0x7f45e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.059+0000 7f4606600640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e00052b0 0x7f45e000fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f4606600640 1 -- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e00047d0 msgr2=0x7f45e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f4606600640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e00047d0 0x7f45e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f4606600640 1 -- 172.21.15.50:0/2480786238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e0003980 msgr2=0x7f45e0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f5f33e00640 1 -- 172.21.15.50:0/689090206 shutdown_connections 2024-01-30T08:09:09.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f389cc00640 1 -- 172.21.15.50:0/1199324151 wait complete. 2024-01-30T08:09:09.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f651a000640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7f64f406fc40 0x7f64f4072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f5f33e00640 1 --2- 172.21.15.50:0/689090206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f3406d050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f5f33e00640 1 --2- 172.21.15.50:0/689090206 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f3406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f5f33e00640 1 -- 172.21.15.50:0/689090206 >> 172.21.15.50:0/689090206 conn(0x7f5f340c6030 msgr2=0x7f5f340c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7faa70e00640 1 -- 172.21.15.50:0/1899180104 wait complete. 2024-01-30T08:09:09.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f4605c00640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e0003980 0x7f45e0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f662b200640 1 Processor -- start 2024-01-30T08:09:09.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f4606600640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e0003980 0x7f45e0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f4606600640 1 -- 172.21.15.50:0/2480786238 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0003530 con 0x7f45e00052b0 2024-01-30T08:09:09.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f5f33e00640 1 -- 172.21.15.50:0/689090206 shutdown_connections 2024-01-30T08:09:09.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f5f33e00640 1 -- 172.21.15.50:0/689090206 wait complete. 2024-01-30T08:09:09.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f4605c00640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e0003980 0x7f45e0003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:09.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7faa70e00640 1 Processor -- start 2024-01-30T08:09:09.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7faa70e00640 1 -- start start 2024-01-30T08:09:09.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7ff292c00640 1 Processor -- start 2024-01-30T08:09:09.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f389cc00640 1 Processor -- start 2024-01-30T08:09:09.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7ff292c00640 1 -- start start 2024-01-30T08:09:09.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f662b200640 1 -- start start 2024-01-30T08:09:09.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.063+0000 7f651aa00640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f64f4066600 0x7f64f4068ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f650c005890 tx=0x7f650c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f5f33e00640 1 Processor -- start 2024-01-30T08:09:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c0a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662b200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f662c0aae50 0x7f662c14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f389cc00640 1 -- start start 2024-01-30T08:09:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa70e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6c070ce0 0x7faa6c1f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa70e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 0x7faa6c0c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f651a000640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7f64f406fc40 0x7f64f4072080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662b200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 0x7f662c14e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff292c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff28c14a880 0x7ff28c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f6629400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f662c0aae50 0x7f662c14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f6629400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f662c0aae50 0x7f662c14dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37174/0 (socket says 172.21.15.50:37174) 2024-01-30T08:09:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa70e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c152db0 0x7faa6c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c152db0 0x7faa6c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c152db0 0x7faa6c15b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49386/0 (socket says 172.21.15.50:49386) 2024-01-30T08:09:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa70e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c3b20 con 0x7faa6c152db0 2024-01-30T08:09:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa70e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c4610 con 0x7faa6c070ce0 2024-01-30T08:09:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa70e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c3d70 con 0x7faa6c0c2220 2024-01-30T08:09:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 -- 172.21.15.50:0/214919000 learned_addr learned my addr 172.21.15.50:0/214919000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff292c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c0c28d0 0x7ff28c0c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f6629e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c0a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f6629e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c0a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49394/0 (socket says 172.21.15.50:49394) 2024-01-30T08:09:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 0x7f662c14e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa69e00640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6c070ce0 0x7faa6c1f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff292c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c154130 con 0x7ff28c070770 2024-01-30T08:09:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f389cc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3898070a20 0x7f389814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f389cc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38981f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff292c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c14ac60 con 0x7ff28c14a880 2024-01-30T08:09:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f389cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38981561a0 0x7f3898151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f389cc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389814ec20 con 0x7f38981561a0 2024-01-30T08:09:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f389cc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389814dc40 con 0x7f3898070a20 2024-01-30T08:09:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff28b400640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff28c070770 0x7ff28c1545c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55088/0 (socket says 172.21.15.50:55088) 2024-01-30T08:09:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f389cc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38981f1fa0 con 0x7f38980c2190 2024-01-30T08:09:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff28b400640 1 -- 172.21.15.50:0/20823722 learned_addr learned my addr 172.21.15.50:0/20823722 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 0x7f662c14e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:55888/0 (socket says 172.21.15.50:55888) 2024-01-30T08:09:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff290c00640 1 --2- 172.21.15.50:0/20823722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c0c28d0 0x7ff28c0c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f6629400640 1 -- 172.21.15.50:0/3774168710 learned_addr learned my addr 172.21.15.50:0/3774168710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff292c00640 1 -- 172.21.15.50:0/20823722 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c151070 con 0x7ff28c0c28d0 2024-01-30T08:09:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1ec810 con 0x7f662c06e6e0 2024-01-30T08:09:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38981561a0 0x7f3898151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38981561a0 0x7f3898151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49406/0 (socket says 172.21.15.50:49406) 2024-01-30T08:09:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 -- 172.21.15.50:0/3816152242 learned_addr learned my addr 172.21.15.50:0/3816152242 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 -- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 msgr2=0x7faa6c0c4fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-30T08:09:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa6c0c2220 0x7faa6c0c4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 -- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6c070ce0 msgr2=0x7faa6c1f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa6c070ce0 0x7faa6c1f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7faa6a800640 1 -- 172.21.15.50:0/214919000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64009a70 con 0x7faa6c152db0 2024-01-30T08:09:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff28be00640 1 --2- 172.21.15.50:0/20823722 >> v2:172.21.15.125:3300/0 conn(0x7ff28c14a880 0x7ff28c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1ecd20 con 0x7f662c0aae50 2024-01-30T08:09:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1eca40 con 0x7f662c0c64f0 2024-01-30T08:09:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 -- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 msgr2=0x7f38981f1750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-30T08:09:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38980c2190 0x7f38981f1750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 -- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3898070a20 msgr2=0x7f389814e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-30T08:09:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3898070a20 0x7f389814e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f3896800640 1 -- 172.21.15.50:0/3816152242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880094d0 con 0x7f38981561a0 2024-01-30T08:09:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f4606600640 1 -- 172.21.15.50:0/2480786238 reap_dead start 2024-01-30T08:09:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff290c00640 1 -- 172.21.15.50:0/20823722 >> v2:172.21.15.125:3300/0 conn(0x7ff28c14a880 msgr2=0x7ff28c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff290c00640 1 --2- 172.21.15.50:0/20823722 >> v2:172.21.15.125:3300/0 conn(0x7ff28c14a880 0x7ff28c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff290c00640 1 -- 172.21.15.50:0/20823722 >> v1:172.21.15.125:6789/0 conn(0x7ff28c070770 legacy=0x7ff28c1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7ff290c00640 1 -- 172.21.15.50:0/20823722 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c151350 con 0x7ff28c0c28d0 2024-01-30T08:09:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7ff28be00640 1 --2- 172.21.15.50:0/20823722 >> v2:172.21.15.125:3300/0 conn(0x7ff28c14a880 0x7ff28c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4606600640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e00052b0 0x7f45e000fda0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45e8007fb0 tx=0x7f45e80251f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194d1e0b46aaed6e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== osd.0 v2:172.21.15.50:6808/2622512062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f64f4072750 con 0x7f64f406fc40 2024-01-30T08:09:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f3896800640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38981561a0 0x7f3898151350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f388000c450 tx=0x7f388000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.067+0000 7f5f33e00640 1 -- start start 2024-01-30T08:09:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f6629e00640 1 -- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 msgr2=0x7f662c14e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f6629e00640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f662c0c64f0 0x7f662c14e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f33e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f340677a0 0x7f5f340c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f33e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f340aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f340677a0 0x7f5f340c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f33e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f340aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f340aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f340aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37190/0 (socket says 172.21.15.50:37190) 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 -- 172.21.15.50:0/1320404324 learned_addr learned my addr 172.21.15.50:0/1320404324 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340aba50 con 0x7f5f340677a0 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f341fdee0 con 0x7f5f3406cba0 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340a9150 con 0x7f5f340725c0 2024-01-30T08:09:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f33400640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f340aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f6629e00640 1 -- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f662c0aae50 msgr2=0x7f662c14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800054e0 con 0x7f38981561a0 2024-01-30T08:09:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38981f2280 con 0x7f38981561a0 2024-01-30T08:09:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389814e1c0 con 0x7f38981561a0 2024-01-30T08:09:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880003600 con 0x7f38981561a0 2024-01-30T08:09:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880003970 con 0x7f38981561a0 2024-01-30T08:09:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3868001040 con 0x7f38981561a0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7faa6a800640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c152db0 0x7faa6c15b2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa6401aee0 tx=0x7faa640195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640b8630 con 0x7faa6c152db0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa640b8790 con 0x7faa6c152db0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640b8b20 con 0x7faa6c152db0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c0c4050 con 0x7faa6c152db0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c15ad90 con 0x7faa6c152db0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80058e0 con 0x7f45e00052b0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e80b0020 con 0x7f45e00052b0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f45ffe00640 1 -- 172.21.15.50:0/2480786238 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80058e0 con 0x7f45e00052b0 2024-01-30T08:09:09.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4608600640 1 -- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e00052b0 msgr2=0x7f45e000fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4608600640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e00052b0 0x7f45e000fda0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45e8007fb0 tx=0x7f45e80251f0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4608600640 1 -- 172.21.15.50:0/2480786238 shutdown_connections 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4608600640 1 --2- 172.21.15.50:0/2480786238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e00052b0 0x7f45e000fda0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4608600640 1 -- 172.21.15.50:0/2480786238 >> 172.21.15.50:0/2480786238 conn(0x7f460006ad40 msgr2=0x7f46000c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4608600640 1 -- 172.21.15.50:0/2480786238 shutdown_connections 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f4608600640 1 -- 172.21.15.50:0/2480786238 wait complete. 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 -- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 msgr2=0x7f5f340aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f340725c0 0x7f5f340aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 -- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f340677a0 msgr2=0x7f5f340c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f340677a0 0x7f5f340c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32000640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009a70 con 0x7f5f3406cba0 2024-01-30T08:09:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.071+0000 7f5f32a00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f340677a0 0x7f5f340c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f5f32000640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f340aa060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c800 tx=0x7f5f2400ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f0309400640 1 Processor -- start 2024-01-30T08:09:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f6629e00640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f662c0aae50 0x7f662c14dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f6629e00640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662400ab80 con 0x7f662c06e6e0 2024-01-30T08:09:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f6629400640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f662c0aae50 0x7f662c14dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:09.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa3c001040 con 0x7faa6c152db0 2024-01-30T08:09:09.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f0309400640 1 -- start start 2024-01-30T08:09:09.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240072d0 con 0x7f5f3406cba0 2024-01-30T08:09:09.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24007430 con 0x7f5f3406cba0 2024-01-30T08:09:09.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f6629e00640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c0a5f00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b410 tx=0x7f661c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7ff290c00640 1 --2- 172.21.15.50:0/20823722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c0c28d0 0x7ff28c0c2d40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff284009b10 tx=0x7ff28401db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70d9d80e18cdd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f340abfa0 con 0x7f5f3406cba0 2024-01-30T08:09:09.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3414a800 con 0x7f5f3406cba0 2024-01-30T08:09:09.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240047f0 con 0x7f5f3406cba0 2024-01-30T08:09:09.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f4608600640 1 Processor -- start 2024-01-30T08:09:09.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f4608600640 1 -- start start 2024-01-30T08:09:09.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c011830 con 0x7f662c06e6e0 2024-01-30T08:09:09.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f34154f40 con 0x7f5f3406cba0 2024-01-30T08:09:09.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c011990 con 0x7f662c06e6e0 2024-01-30T08:09:09.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3880003ad0 con 0x7f38981561a0 2024-01-30T08:09:09.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f0309400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03040c00c0 0x7f030415c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f0309400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040c26c0 con 0x7f030415c390 2024-01-30T08:09:09.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f0309400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030415ccb0 con 0x7f030406dc80 2024-01-30T08:09:09.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f0309400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03040c0e20 con 0x7f03040c00c0 2024-01-30T08:09:09.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c011d40 con 0x7f662c06e6e0 2024-01-30T08:09:09.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c071490 con 0x7f662c06e6e0 2024-01-30T08:09:09.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c0720a0 con 0x7f662c06e6e0 2024-01-30T08:09:09.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4608600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e00052b0 0x7f46001ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7ff28aa00640 1 -- 172.21.15.50:0/20823722 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840a6b60 con 0x7ff28c0c28d0 2024-01-30T08:09:09.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff28aa00640 1 -- 172.21.15.50:0/20823722 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2840a6cc0 con 0x7ff28c0c28d0 2024-01-30T08:09:09.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff28aa00640 1 -- 172.21.15.50:0/20823722 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840ae660 con 0x7ff28c0c28d0 2024-01-30T08:09:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0303400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03040c00c0 0x7f030415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0303400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03040c00c0 0x7f030415c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37192/0 (socket says 172.21.15.50:37192) 2024-01-30T08:09:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0303400640 1 -- 172.21.15.50:0/3212011515 learned_addr learned my addr 172.21.15.50:0/3212011515 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.075+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7faa640cd480 con 0x7faa6c152db0 2024-01-30T08:09:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4608600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46001e8d10 0x7f4600142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f662c0c2060 con 0x7f662c06e6e0 2024-01-30T08:09:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4608600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4600142960 0x7f460013fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4608600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46001e8880 con 0x7f45e00052b0 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4608600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460014d450 con 0x7f46001e8d10 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4608600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4600145610 con 0x7f4600142960 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46001e8d10 0x7f4600142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46001e8d10 0x7f4600142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37198/0 (socket says 172.21.15.50:37198) 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 -- 172.21.15.50:0/2849527301 learned_addr learned my addr 172.21.15.50:0/2849527301 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605c00640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e00052b0 0x7f46001ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4606600640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4600142960 0x7f460013fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5f24004950 con 0x7f5f3406cba0 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 -- 172.21.15.50:0/20823722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c0c28d0 msgr2=0x7ff28c0c2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 --2- 172.21.15.50:0/20823722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c0c28d0 0x7ff28c0c2d40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff284009b10 tx=0x7ff28401db60 comp rx=0 tx=0).stop 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7faa62000640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faa44066550 0x7faa44068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa640aa070 con 0x7faa6c152db0 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7faa62000640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7faa4406fb90 0x7faa44071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 --> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa440726a0 con 0x7faa4406fb90 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa64120240 con 0x7faa6c152db0 2024-01-30T08:09:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7faa69e00640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faa44066550 0x7faa44068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 -- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4600142960 msgr2=0x7f460013fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4600142960 0x7f460013fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 -- 172.21.15.50:0/2849527301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e00052b0 msgr2=0x7f46001ec4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e00052b0 0x7f46001ec4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 -- 172.21.15.50:0/2849527301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46001e8530 con 0x7f46001e8d10 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 -- 172.21.15.50:0/20823722 shutdown_connections 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 --2- 172.21.15.50:0/20823722 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c0c28d0 0x7ff28c0c2d40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 --2- 172.21.15.50:0/20823722 >> v2:172.21.15.125:3300/0 conn(0x7ff28c14a880 0x7ff28c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 -- 172.21.15.50:0/20823722 >> 172.21.15.50:0/20823722 conn(0x7ff28c06cb40 msgr2=0x7ff28c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120861188 0 0) 0x7f030415ccb0 con 0x7f030406dc80 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e4003530 con 0x7f030406dc80 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 <== mon.1 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3105793544 0 0) 0x7f02e4003530 con 0x7f030406dc80 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 >> v2:172.21.15.125:3300/0 conn(0x7f03040c00c0 msgr2=0x7f030415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 --2- 172.21.15.50:0/3212011515 >> v2:172.21.15.125:3300/0 conn(0x7f03040c00c0 0x7f030415c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 >> v1:172.21.15.50:6789/0 conn(0x7f030415c390 legacy=0x7f0304155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040c2f60 con 0x7f030406dc80 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 <== mon.1 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f02fc001930 con 0x7f030406dc80 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 >> v1:172.21.15.125:6789/0 conn(0x7f030406dc80 legacy=0x7f0304158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e40039d0 0x7f02e4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e40047d0 0x7f02e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f02e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040c0e20 con 0x7f02e40039d0 2024-01-30T08:09:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e400c1d0 con 0x7f02e40047d0 2024-01-30T08:09:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e400c390 con 0x7f02e40052b0 2024-01-30T08:09:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0308a00640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f02e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f4605200640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46001e8d10 0x7f4600142420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45f000e440 tx=0x7f45f000e900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7faa69400640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7faa4406fb90 0x7faa44071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 -- 172.21.15.50:0/20823722 shutdown_connections 2024-01-30T08:09:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00052e0 con 0x7f46001e8d10 2024-01-30T08:09:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7ff292c00640 1 -- 172.21.15.50:0/20823722 wait complete. 2024-01-30T08:09:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f388e000640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3870066500 0x7f38700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f2aa00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f0c066550 0x7f5f0c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3880083700 con 0x7f38981561a0 2024-01-30T08:09:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f3895e00640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3870066500 0x7f38700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0005440 con 0x7f46001e8d10 2024-01-30T08:09:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0003840 con 0x7f46001e8d10 2024-01-30T08:09:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f4608600640 1 -- 172.21.15.50:0/2849527301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460014dfc0 con 0x7f46001e8d10 2024-01-30T08:09:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f388e000640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7f387006fb40 0x7f3870071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 --> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3870072650 con 0x7f387006fb40 2024-01-30T08:09:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3880085d20 con 0x7f38981561a0 2024-01-30T08:09:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7faa69400640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7faa4406fb90 0x7faa44071fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7faa69e00640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faa44066550 0x7faa44068a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa54000f70 tx=0x7faa54007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f3895400640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7f387006fb40 0x7f3870071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f4608600640 1 -- 172.21.15.50:0/2849527301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460014e580 con 0x7f46001e8d10 2024-01-30T08:09:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0303400640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e40047d0 0x7f02e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0308a00640 1 -- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e40047d0 msgr2=0x7f02e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0308a00640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02e40047d0 0x7f02e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0308a00640 1 -- 172.21.15.50:0/3212011515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e40039d0 msgr2=0x7f02e4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0308a00640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e40039d0 0x7f02e4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.079+0000 7f0308a00640 1 -- 172.21.15.50:0/3212011515 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040c2f60 con 0x7f02e40052b0 2024-01-30T08:09:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f24083f00 con 0x7f5f3406cba0 2024-01-30T08:09:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f32a00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f0c066550 0x7f5f0c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f2aa00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f5f0c06fb90 0x7f5f0c071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f0c0726a0 con 0x7f5f0c06fb90 2024-01-30T08:09:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f240843a0 con 0x7f5f3406cba0 2024-01-30T08:09:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== osd.4 v2:172.21.15.125:6824/2753947898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faa440726a0 con 0x7faa4406fb90 2024-01-30T08:09:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7ff292c00640 1 Processor -- start 2024-01-30T08:09:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f33400640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f5f0c06fb90 0x7f5f0c071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46000adf40 con 0x7f46001e8d10 2024-01-30T08:09:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f5f32a00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f0c066550 0x7f5f0c068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f34072e90 tx=0x7f5f1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7ff292c00640 1 -- start start 2024-01-30T08:09:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f661c01a400 con 0x7f662c06e6e0 2024-01-30T08:09:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f6622000640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6604066500 0x7f66040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f661c0840b0 con 0x7f662c06e6e0 2024-01-30T08:09:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f6622000640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7f660406fac0 0x7f6604071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66040725d0 con 0x7f660406fac0 2024-01-30T08:09:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.083+0000 7f0308a00640 1 -- 172.21.15.50:0/3212011515 reap_dead start 2024-01-30T08:09:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f3895e00640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3870066500 0x7f38700689c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3890007dd0 tx=0x7f3890007300 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f45f00039a0 con 0x7f46001e8d10 2024-01-30T08:09:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f0308a00640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f02e400b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c510 tx=0x7f02fc01ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2edb03ee9e52e1cd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f6629400640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6604066500 0x7f66040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f662a800640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7f660406fac0 0x7f6604071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f5f33400640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f5f0c06fb90 0x7f5f0c071fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff292c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c070770 0x7ff28c0bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff292c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff28c0c28d0 0x7ff28c148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff292c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff28c14a880 0x7ff28c1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff292c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c150390 con 0x7ff28c0c28d0 2024-01-30T08:09:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff292c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c1497f0 con 0x7ff28c14a880 2024-01-30T08:09:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff292c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c14bd20 con 0x7ff28c070770 2024-01-30T08:09:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0a5cf0 con 0x7f02e40052b0 2024-01-30T08:09:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f6629400640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6604066500 0x7f66040689c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f662c071330 tx=0x7f661400a210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc0a5e70 con 0x7f02e40052b0 2024-01-30T08:09:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f0302a00640 1 -- 172.21.15.50:0/3212011515 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0ad660 con 0x7f02e40052b0 2024-01-30T08:09:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f662a800640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7f660406fac0 0x7f6604071f00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f45fd600640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45d8066600 0x7f45d8068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff28be00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c070770 0x7ff28c0bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f661c011ea0 con 0x7f662c06e6e0 2024-01-30T08:09:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45f0083910 con 0x7f46001e8d10 2024-01-30T08:09:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f3895400640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7f387006fb40 0x7f3870071f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== osd.1 v2:172.21.15.50:6800/1684920044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5f0c0726a0 con 0x7f5f0c06fb90 2024-01-30T08:09:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f4605c00640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45d8066600 0x7f45d8068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f45fd600640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f45d806fc40 0x7f45d8072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 --> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45d8072750 con 0x7f45d806fc40 2024-01-30T08:09:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f00882a0 con 0x7f46001e8d10 2024-01-30T08:09:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff28c14a880 0x7ff28c1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff28c14a880 0x7ff28c1492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37218/0 (socket says 172.21.15.50:37218) 2024-01-30T08:09:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 -- 172.21.15.50:0/795990379 learned_addr learned my addr 172.21.15.50:0/795990379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff28b400640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff28c0c28d0 0x7ff28c148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 -- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c070770 msgr2=0x7ff28c0bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff28c070770 0x7ff28c0bb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 -- 172.21.15.50:0/795990379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff28c0c28d0 msgr2=0x7ff28c148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f0309400640 1 -- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 msgr2=0x7f02e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff28c0c28d0 0x7ff28c148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f0309400640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f02e400b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c510 tx=0x7f02fc01ce10 comp rx=0 tx=0).stop 2024-01-30T08:09:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7f4606600640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f45d806fc40 0x7f45d8072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 -- 172.21.15.50:0/795990379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff284009770 con 0x7ff28c14a880 2024-01-30T08:09:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff290c00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff28c14a880 0x7ff28c1492b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff28401b790 tx=0x7ff28401a900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840a6b60 con 0x7ff28c14a880 2024-01-30T08:09:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2840afbd0 con 0x7ff28c14a880 2024-01-30T08:09:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.087+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840b9440 con 0x7ff28c14a880 2024-01-30T08:09:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c14fcd0 con 0x7ff28c14a880 2024-01-30T08:09:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f0309400640 1 -- 172.21.15.50:0/3212011515 shutdown_connections 2024-01-30T08:09:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f0309400640 1 --2- 172.21.15.50:0/3212011515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f02e400b990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f0309400640 1 -- 172.21.15.50:0/3212011515 >> 172.21.15.50:0/3212011515 conn(0x7f030406a740 msgr2=0x7f030406ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== osd.3 v2:172.21.15.50:6824/116773969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3870072650 con 0x7f387006fb40 2024-01-30T08:09:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f4605c00640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45d8066600 0x7f45d8068ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46000ae0e0 tx=0x7f45f800f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== osd.2 v2:172.21.15.50:6816/2310842832 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f66040725d0 con 0x7f660406fac0 2024-01-30T08:09:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c0bb6f0 con 0x7ff28c14a880 2024-01-30T08:09:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff25c001040 con 0x7ff28c14a880 2024-01-30T08:09:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f4606600640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f45d806fc40 0x7f45d8072080 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== osd.5 v2:172.21.15.125:6800/1470340400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f45d8072750 con 0x7f45d806fc40 2024-01-30T08:09:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff2840b5040 con 0x7ff28c14a880 2024-01-30T08:09:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f0309400640 1 -- 172.21.15.50:0/3212011515 shutdown_connections 2024-01-30T08:09:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f0309400640 1 -- 172.21.15.50:0/3212011515 wait complete. 2024-01-30T08:09:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f0309400640 1 Processor -- start 2024-01-30T08:09:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.091+0000 7f0309400640 1 -- start start 2024-01-30T08:09:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0309400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f0304205960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0309400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0304156450 0x7f0304205ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7ff283e00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff264066600 0x7ff264068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff28411f840 con 0x7ff28c14a880 2024-01-30T08:09:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f0304205960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7ff283e00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7ff26406fc40 0x7ff264072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 --> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff264072750 con 0x7ff26406fc40 2024-01-30T08:09:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff28411fbf0 con 0x7ff28c14a880 2024-01-30T08:09:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f0304205960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:55930/0 (socket says 172.21.15.50:55930) 2024-01-30T08:09:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0304156450 0x7f0304205ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0304156450 0x7f0304205ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49456/0 (socket says 172.21.15.50:49456) 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303e00640 1 -- 172.21.15.50:0/2950799861 learned_addr learned my addr 172.21.15.50:0/2950799861 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0309400640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f030408a420 0x7f030408a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040c6310 con 0x7f0304156450 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0304206510 con 0x7f030408a420 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03040c4240 con 0x7f02e40052b0 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7ff28b400640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7ff26406fc40 0x7ff264072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0308a00640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f030408a420 0x7f030408a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7ff28be00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff264066600 0x7ff264068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7ff28b400640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7ff26406fc40 0x7ff264072080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303400640 1 -- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 msgr2=0x7f0304205960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303400640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02e40052b0 0x7f0304205960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303400640 1 -- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f030408a420 msgr2=0x7f030408a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303400640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f030408a420 0x7f030408a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.095+0000 7f0303400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040c4520 con 0x7f0304156450 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7f0303400640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0304156450 0x7f0304205ea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03040c0510 tx=0x7f02ec0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec004500 con 0x7f0304156450 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec003620 con 0x7f0304156450 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0039d0 con 0x7f0304156450 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03040c4800 con 0x7f0304156450 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03041560d0 con 0x7f0304156450 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== osd.6 v2:172.21.15.125:6809/2977185679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff264072750 con 0x7ff26406fc40 2024-01-30T08:09:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7ff28be00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff264066600 0x7ff264068ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff274006fd0 tx=0x7ff274008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.099+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f030415c770 con 0x7f0304156450 2024-01-30T08:09:09.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 --> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64e4002d40 con 0x7f64f406fc40 2024-01-30T08:09:09.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6513400640 1 -- 172.21.15.50:0/244727492 <== osd.0 v2:172.21.15.50:6808/2622512062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64e4002d40 con 0x7f64f406fc40 2024-01-30T08:09:09.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f02ec003b30 con 0x7f0304156450 2024-01-30T08:09:09.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7f64f406fc40 msgr2=0x7f64f4072080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6510c00640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7f64f406fc40 0x7f64f4072080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f64f4066600 msgr2=0x7f64f4068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f02fbe00640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f02dc066600 0x7f02dc068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02ec084b50 con 0x7f0304156450 2024-01-30T08:09:09.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6510c00640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f64f4066600 0x7f64f4068ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f650c005890 tx=0x7f650c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0c6630 msgr2=0x7f651c142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f02fbe00640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f02dc06fad0 0x7f02dc071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.103+0000 7f6510c00640 1 --2- 172.21.15.50:0/244727492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0c6630 0x7f651c142550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65040ad040 tx=0x7f650401ac90 comp rx=0 tx=0).stop 2024-01-30T08:09:09.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f651b400640 1 -- 172.21.15.50:0/244727492 reap_dead start 2024-01-30T08:09:09.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02dc0725e0 con 0x7f02dc06fad0 2024-01-30T08:09:09.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02ec084f00 con 0x7f0304156450 2024-01-30T08:09:09.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f0303e00640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f02dc066600 0x7f02dc068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f0308a00640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f02dc06fad0 0x7f02dc071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f0308a00640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f02dc06fad0 0x7f02dc071f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 shutdown_connections 2024-01-30T08:09:09.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 >> 172.21.15.50:0/244727492 conn(0x7f651c0c5b10 msgr2=0x7f651c0bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f0303e00640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f02dc066600 0x7f02dc068ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02f4001930 tx=0x7f02f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 shutdown_connections 2024-01-30T08:09:09.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f6510c00640 1 -- 172.21.15.50:0/244727492 wait complete. 2024-01-30T08:09:09.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.107+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== osd.7 v2:172.21.15.125:6808/1793140907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f02dc0725e0 con 0x7f02dc06fad0 2024-01-30T08:09:09.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.115+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 --> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa3c002d40 con 0x7faa4406fb90 2024-01-30T08:09:09.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.115+0000 7faa62000640 1 -- 172.21.15.50:0/214919000 <== osd.4 v2:172.21.15.125:6824/2753947898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa3c002d40 con 0x7faa4406fb90 2024-01-30T08:09:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7faa4406fb90 msgr2=0x7faa44071fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7faa4406fb90 0x7faa44071fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faa44066550 msgr2=0x7faa44068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faa44066550 0x7faa44068a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa54000f70 tx=0x7faa54007e90 comp rx=0 tx=0).stop 2024-01-30T08:09:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c152db0 msgr2=0x7faa6c15b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 --2- 172.21.15.50:0/214919000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c152db0 0x7faa6c15b2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa6401aee0 tx=0x7faa640195d0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 --> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f340ac1e0 con 0x7f5f0c06fb90 2024-01-30T08:09:09.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa6a800640 1 -- 172.21.15.50:0/214919000 reap_dead start 2024-01-30T08:09:09.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 shutdown_connections 2024-01-30T08:09:09.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 >> 172.21.15.50:0/214919000 conn(0x7faa6c06cb40 msgr2=0x7faa6c14ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7f5f2aa00640 1 -- 172.21.15.50:0/1320404324 <== osd.1 v2:172.21.15.50:6800/1684920044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5f340ac1e0 con 0x7f5f0c06fb90 2024-01-30T08:09:09.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 shutdown_connections 2024-01-30T08:09:09.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7faa70e00640 1 -- 172.21.15.50:0/214919000 wait complete. 2024-01-30T08:09:09.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.119+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 --> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f662c06e260 con 0x7f660406fac0 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f5f0c06fb90 msgr2=0x7f5f0c071fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f5f0c06fb90 0x7f5f0c071fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f0c066550 msgr2=0x7f5f0c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f0c066550 0x7f5f0c068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f34072e90 tx=0x7f5f1c008040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 msgr2=0x7f5f340aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 --2- 172.21.15.50:0/1320404324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f3406cba0 0x7f5f340aa060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c800 tx=0x7f5f2400ccc0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33400640 1 -- 172.21.15.50:0/1320404324 reap_dead start 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 shutdown_connections 2024-01-30T08:09:09.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 >> 172.21.15.50:0/1320404324 conn(0x7f5f340c6030 msgr2=0x7f5f340c2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f6622000640 1 -- 172.21.15.50:0/3774168710 <== osd.2 v2:172.21.15.50:6816/2310842832 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f66240a6a80 con 0x7f660406fac0 2024-01-30T08:09:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7f660406fac0 msgr2=0x7f6604071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 --> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f460014e770 con 0x7f45d806fc40 2024-01-30T08:09:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f662b200640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7f660406fac0 0x7f6604071f00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f45fd600640 1 -- 172.21.15.50:0/2849527301 <== osd.5 v2:172.21.15.125:6800/1470340400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f460014e770 con 0x7f45d806fc40 2024-01-30T08:09:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 shutdown_connections 2024-01-30T08:09:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f5f33e00640 1 -- 172.21.15.50:0/1320404324 wait complete. 2024-01-30T08:09:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6604066500 msgr2=0x7f66040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.123+0000 7f662b200640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6604066500 0x7f66040689c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f662c071330 tx=0x7f661400a210 comp rx=0 tx=0).stop 2024-01-30T08:09:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 msgr2=0x7f662c0a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f662b200640 1 --2- 172.21.15.50:0/3774168710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f662c06e6e0 0x7f662c0a5f00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b410 tx=0x7f661c00b810 comp rx=0 tx=0).stop 2024-01-30T08:09:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f662a800640 1 -- 172.21.15.50:0/3774168710 reap_dead start 2024-01-30T08:09:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f45d806fc40 msgr2=0x7f45d8072080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f45f6a00640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f45d806fc40 0x7f45d8072080 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 --> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3868002d40 con 0x7f387006fb40 2024-01-30T08:09:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 shutdown_connections 2024-01-30T08:09:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 >> 172.21.15.50:0/3774168710 conn(0x7f662c0a79f0 msgr2=0x7f662c0c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f388e000640 1 -- 172.21.15.50:0/3816152242 <== osd.3 v2:172.21.15.50:6824/116773969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3868002d40 con 0x7f387006fb40 2024-01-30T08:09:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 shutdown_connections 2024-01-30T08:09:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f662b200640 1 -- 172.21.15.50:0/3774168710 wait complete. 2024-01-30T08:09:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7f387006fb40 msgr2=0x7f3870071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f389cc00640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7f387006fb40 0x7f3870071f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3870066500 msgr2=0x7f38700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f389cc00640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3870066500 0x7f38700689c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3890007dd0 tx=0x7f3890007300 comp rx=0 tx=0).stop 2024-01-30T08:09:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38981561a0 msgr2=0x7f3898151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f389cc00640 1 --2- 172.21.15.50:0/3816152242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38981561a0 0x7f3898151350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f388000c450 tx=0x7f388000c910 comp rx=0 tx=0).stop 2024-01-30T08:09:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.127+0000 7f3896800640 1 -- 172.21.15.50:0/3816152242 reap_dead start 2024-01-30T08:09:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 shutdown_connections 2024-01-30T08:09:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 >> 172.21.15.50:0/3816152242 conn(0x7f389806c890 msgr2=0x7f38981537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 --> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff25c002d40 con 0x7ff26406fc40 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45d8066600 msgr2=0x7f45d8068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45d8066600 0x7f45d8068ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46000ae0e0 tx=0x7f45f800f040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46001e8d10 msgr2=0x7f4600142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 --2- 172.21.15.50:0/2849527301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46001e8d10 0x7f4600142420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45f000e440 tx=0x7f45f000e900 comp rx=0 tx=0).stop 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f4606600640 1 -- 172.21.15.50:0/2849527301 reap_dead start 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 shutdown_connections 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 >> 172.21.15.50:0/2849527301 conn(0x7f460006ad40 msgr2=0x7f46000c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff283e00640 1 -- 172.21.15.50:0/795990379 <== osd.6 v2:172.21.15.125:6809/2977185679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff25c002d40 con 0x7ff26406fc40 2024-01-30T08:09:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 shutdown_connections 2024-01-30T08:09:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f389cc00640 1 -- 172.21.15.50:0/3816152242 wait complete. 2024-01-30T08:09:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 shutdown_connections 2024-01-30T08:09:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7f45f6a00640 1 -- 172.21.15.50:0/2849527301 wait complete. 2024-01-30T08:09:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7ff26406fc40 msgr2=0x7ff264072080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff292c00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7ff26406fc40 0x7ff264072080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff264066600 msgr2=0x7ff264068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff292c00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff264066600 0x7ff264068ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff274006fd0 tx=0x7ff274008040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff28c14a880 msgr2=0x7ff28c1492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff292c00640 1 --2- 172.21.15.50:0/795990379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff28c14a880 0x7ff28c1492b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff28401b790 tx=0x7ff28401a900 comp rx=0 tx=0).stop 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.131+0000 7ff290c00640 1 -- 172.21.15.50:0/795990379 reap_dead start 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.135+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 shutdown_connections 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.135+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 >> 172.21.15.50:0/795990379 conn(0x7ff28c06cb40 msgr2=0x7ff28c0c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.135+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 shutdown_connections 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.135+0000 7ff292c00640 1 -- 172.21.15.50:0/795990379 wait complete. 2024-01-30T08:09:09.158 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-01-30T08:09:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 --> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03040c4cb0 con 0x7f02dc06fad0 2024-01-30T08:09:09.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-30T08:09:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f02fbe00640 1 -- 172.21.15.50:0/2950799861 <== osd.7 v2:172.21.15.125:6808/1793140907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f02fc0a5c30 con 0x7f02dc06fad0 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f02dc06fad0 msgr2=0x7f02dc071f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0309400640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f02dc06fad0 0x7f02dc071f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f02dc066600 msgr2=0x7f02dc068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0309400640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f02dc066600 0x7f02dc068ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02f4001930 tx=0x7f02f4009040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0304156450 msgr2=0x7f0304205ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0309400640 1 --2- 172.21.15.50:0/2950799861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0304156450 0x7f0304205ea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03040c0510 tx=0x7f02ec0119f0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.139+0000 7f0308a00640 1 -- 172.21.15.50:0/2950799861 reap_dead start 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.143+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 shutdown_connections 2024-01-30T08:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.143+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 >> 172.21.15.50:0/2950799861 conn(0x7f030406a740 msgr2=0x7f0304071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.143+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 shutdown_connections 2024-01-30T08:09:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.143+0000 7f0309400640 1 -- 172.21.15.50:0/2950799861 wait complete. 2024-01-30T08:09:09.162 INFO:teuthology.orchestra.run.smithi050.stdout:60129542152 2024-01-30T08:09:09.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-30T08:09:09.166 INFO:teuthology.orchestra.run.smithi050.stdout:60129542152 2024-01-30T08:09:09.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-30T08:09:09.178 INFO:teuthology.orchestra.run.smithi050.stdout:60129542152 2024-01-30T08:09:09.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-30T08:09:09.180 INFO:teuthology.orchestra.run.smithi050.stdout:60129542152 2024-01-30T08:09:09.181 INFO:teuthology.orchestra.run.smithi050.stdout:60129542152 2024-01-30T08:09:09.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-30T08:09:09.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-30T08:09:09.184 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2024-01-30T08:09:09.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-30T08:09:09.190 INFO:teuthology.orchestra.run.smithi050.stdout:60129542152 2024-01-30T08:09:09.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-30T08:09:09.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.403+0000 7f1a67600640 1 Processor -- start 2024-01-30T08:09:09.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.403+0000 7f1a67600640 1 -- start start 2024-01-30T08:09:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a67600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60156030 0x7f1a60158970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a67600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a6006fe80 0x7f1a6006d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a67600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a600c1fc0 0x7f1a600c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a67600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a60158eb0 con 0x7f1a6006fe80 2024-01-30T08:09:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a67600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a60156410 con 0x7f1a600c1fc0 2024-01-30T08:09:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a67600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c71f0 con 0x7f1a60156030 2024-01-30T08:09:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a5fe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a6006fe80 0x7f1a6006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a64c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60156030 0x7f1a60158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a5fe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a6006fe80 0x7f1a6006d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49460/0 (socket says 172.21.15.50:49460) 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a5fe00640 1 -- 172.21.15.50:0/1557338756 learned_addr learned my addr 172.21.15.50:0/1557338756 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a64c00640 1 -- 172.21.15.50:0/1557338756 >> v2:172.21.15.125:3300/0 conn(0x7f1a600c1fc0 msgr2=0x7f1a600c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a64c00640 1 --2- 172.21.15.50:0/1557338756 >> v2:172.21.15.125:3300/0 conn(0x7f1a600c1fc0 0x7f1a600c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a64c00640 1 -- 172.21.15.50:0/1557338756 >> v2:172.21.15.50:3300/0 conn(0x7f1a6006fe80 msgr2=0x7f1a6006d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a64c00640 1 --2- 172.21.15.50:0/1557338756 >> v2:172.21.15.50:3300/0 conn(0x7f1a6006fe80 0x7f1a6006d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f1a64c00640 1 -- 172.21.15.50:0/1557338756 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a600c77b0 con 0x7f1a60156030 2024-01-30T08:09:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f386c800640 1 Processor -- start 2024-01-30T08:09:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f386c800640 1 -- start start 2024-01-30T08:09:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f5134600640 1 Processor -- start 2024-01-30T08:09:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.407+0000 7f5134600640 1 -- start start 2024-01-30T08:09:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386c800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3864156160 0x7f386406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386c800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38640c3f20 0x7f386415c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386c800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38640c3a10 0x7f386415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386c800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38640c1be0 con 0x7f3864156160 2024-01-30T08:09:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386c800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386415cfa0 con 0x7f38640c3a10 2024-01-30T08:09:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386c800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386415c090 con 0x7f38640c3f20 2024-01-30T08:09:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f5134600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c06aae0 0x7f512c06af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f5134600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f512c15c190 0x7f512c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386a800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38640c3a10 0x7f386415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f3869e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3864156160 0x7f386406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386a800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38640c3a10 0x7f386415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37258/0 (socket says 172.21.15.50:37258) 2024-01-30T08:09:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386a800640 1 -- 172.21.15.50:0/1256672998 learned_addr learned my addr 172.21.15.50:0/1256672998 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f3869400640 1 --2- 172.21.15.50:0/1256672998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38640c3f20 0x7f386415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f5131200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c06aae0 0x7f512c06af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f3869e00640 1 -- 172.21.15.50:0/1256672998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38640c3f20 msgr2=0x7f386415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f3869e00640 1 --2- 172.21.15.50:0/1256672998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38640c3f20 0x7f386415c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f3869e00640 1 -- 172.21.15.50:0/1256672998 >> v2:172.21.15.125:3300/0 conn(0x7f38640c3a10 msgr2=0x7f386415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f3869e00640 1 --2- 172.21.15.50:0/1256672998 >> v2:172.21.15.125:3300/0 conn(0x7f38640c3a10 0x7f386415ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f3869e00640 1 -- 172.21.15.50:0/1256672998 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38640c0770 con 0x7f3864156160 2024-01-30T08:09:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f386a800640 1 --2- 172.21.15.50:0/1256672998 >> v2:172.21.15.125:3300/0 conn(0x7f38640c3a10 0x7f386415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.411+0000 7f5131200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c06aae0 0x7f512c06af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:55954/0 (socket says 172.21.15.50:55954) 2024-01-30T08:09:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5131200640 1 -- 172.21.15.50:0/3946152230 learned_addr learned my addr 172.21.15.50:0/3946152230 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5132600640 1 --2- 172.21.15.50:0/3946152230 >> v2:172.21.15.125:3300/0 conn(0x7f512c15c190 0x7f512c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512c0c3a10 con 0x7f512c156160 2024-01-30T08:09:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c0c4220 con 0x7f512c15c190 2024-01-30T08:09:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0c09a0 con 0x7f512c06aae0 2024-01-30T08:09:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f512be00640 1 -- 172.21.15.50:0/3946152230 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198085670 0 0) 0x7f512c0c3a10 con 0x7f512c156160 2024-01-30T08:09:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f512be00640 1 -- 172.21.15.50:0/3946152230 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c003530 con 0x7f512c156160 2024-01-30T08:09:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5132600640 1 -- 172.21.15.50:0/3946152230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c06aae0 msgr2=0x7f512c06af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5132600640 1 --2- 172.21.15.50:0/3946152230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c06aae0 0x7f512c06af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5132600640 1 -- 172.21.15.50:0/3946152230 >> v1:172.21.15.50:6789/0 conn(0x7f512c156160 legacy=0x7f512c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f5132600640 1 -- 172.21.15.50:0/3946152230 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0c3c60 con 0x7f512c15c190 2024-01-30T08:09:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f1a64c00640 1 --2- 172.21.15.50:0/1557338756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60156030 0x7f1a60158970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a600c2540 tx=0x7f1a5001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afb7d521dd4e5af server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f1a5f400640 1 -- 172.21.15.50:0/1557338756 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a500ad660 con 0x7f1a60156030 2024-01-30T08:09:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f1a5f400640 1 -- 172.21.15.50:0/1557338756 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a500ad7c0 con 0x7f1a60156030 2024-01-30T08:09:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f1a5f400640 1 -- 172.21.15.50:0/1557338756 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a500adb50 con 0x7f1a60156030 2024-01-30T08:09:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f3513800640 1 Processor -- start 2024-01-30T08:09:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.415+0000 7f3513800640 1 -- start start 2024-01-30T08:09:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3869e00640 1 --2- 172.21.15.50:0/1256672998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864156160 0x7f386406ab40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f386406e750 tx=0x7f385401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f45c9e7c0897db server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3868a00640 1 -- 172.21.15.50:0/1256672998 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540ad660 con 0x7f3864156160 2024-01-30T08:09:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3868a00640 1 -- 172.21.15.50:0/1256672998 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38540ad7c0 con 0x7f3864156160 2024-01-30T08:09:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3868a00640 1 -- 172.21.15.50:0/1256672998 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540adb50 con 0x7f3864156160 2024-01-30T08:09:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f1a67600640 1 -- 172.21.15.50:0/1557338756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60156030 msgr2=0x7f1a60158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f1a67600640 1 --2- 172.21.15.50:0/1557338756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60156030 0x7f1a60158970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a600c2540 tx=0x7f1a5001c3c0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3513800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c06e350 0x7f350c1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3513800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0c5230 con 0x7f350c0c0c80 2024-01-30T08:09:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3513800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0c4d20 con 0x7f350c0723e0 2024-01-30T08:09:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3513800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c153d30 con 0x7f350c06e350 2024-01-30T08:09:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3510e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c06e350 0x7f350c1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3510e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c06e350 0x7f350c1536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:55966/0 (socket says 172.21.15.50:55966) 2024-01-30T08:09:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3510e00640 1 -- 172.21.15.50:0/4172261280 learned_addr learned my addr 172.21.15.50:0/4172261280 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f386c800640 1 -- 172.21.15.50:0/1256672998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864156160 msgr2=0x7f386406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f386c800640 1 --2- 172.21.15.50:0/1256672998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864156160 0x7f386406ab40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f386406e750 tx=0x7f385401c3a0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f350b400640 1 -- 172.21.15.50:0/4172261280 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991546792 0 0) 0x7f350c0c4d20 con 0x7f350c0723e0 2024-01-30T08:09:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3510e00640 1 -- 172.21.15.50:0/4172261280 >> v1:172.21.15.125:6789/0 conn(0x7f350c0723e0 legacy=0x7f350c06acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3510e00640 1 -- 172.21.15.50:0/4172261280 >> v1:172.21.15.50:6789/0 conn(0x7f350c0c0c80 legacy=0x7f350c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f3510e00640 1 -- 172.21.15.50:0/4172261280 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c0c5480 con 0x7f350c06e350 2024-01-30T08:09:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f386c800640 1 -- 172.21.15.50:0/1256672998 shutdown_connections 2024-01-30T08:09:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f386c800640 1 --2- 172.21.15.50:0/1256672998 >> v2:172.21.15.125:3300/0 conn(0x7f38640c3a10 0x7f386415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f386c800640 1 --2- 172.21.15.50:0/1256672998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38640c3f20 0x7f386415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f386c800640 1 --2- 172.21.15.50:0/1256672998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864156160 0x7f386406ab40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f386c800640 1 -- 172.21.15.50:0/1256672998 >> 172.21.15.50:0/1256672998 conn(0x7f38640c5f10 msgr2=0x7f38640c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f1a67600640 1 -- 172.21.15.50:0/1557338756 shutdown_connections 2024-01-30T08:09:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f1a67600640 1 --2- 172.21.15.50:0/1557338756 >> v2:172.21.15.50:3300/0 conn(0x7f1a6006fe80 0x7f1a6006d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f1a67600640 1 --2- 172.21.15.50:0/1557338756 >> v2:172.21.15.125:3300/0 conn(0x7f1a600c1fc0 0x7f1a600c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f1a67600640 1 --2- 172.21.15.50:0/1557338756 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60156030 0x7f1a60158970 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.419+0000 7f1a67600640 1 -- 172.21.15.50:0/1557338756 >> 172.21.15.50:0/1557338756 conn(0x7f1a6006ad40 msgr2=0x7f1a600c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f5132600640 1 --2- 172.21.15.50:0/3946152230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c15c190 0x7f512c15c620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f51140097c0 tx=0x7f511401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa603442fa902052 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f386c800640 1 -- 172.21.15.50:0/1256672998 shutdown_connections 2024-01-30T08:09:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f1a67600640 1 -- 172.21.15.50:0/1557338756 shutdown_connections 2024-01-30T08:09:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f1a67600640 1 -- 172.21.15.50:0/1557338756 wait complete. 2024-01-30T08:09:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f512be00640 1 -- 172.21.15.50:0/3946152230 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140ac620 con 0x7f512c15c190 2024-01-30T08:09:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f512be00640 1 -- 172.21.15.50:0/3946152230 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140ac780 con 0x7f512c15c190 2024-01-30T08:09:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6ea2600640 1 Processor -- start 2024-01-30T08:09:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6ea2600640 1 -- start start 2024-01-30T08:09:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f386c800640 1 -- 172.21.15.50:0/1256672998 wait complete. 2024-01-30T08:09:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c15c190 msgr2=0x7f512c15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f512be00640 1 -- 172.21.15.50:0/3946152230 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140ac620 con 0x7f512c15c190 2024-01-30T08:09:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f5134600640 1 --2- 172.21.15.50:0/3946152230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c15c190 0x7f512c15c620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f51140097c0 tx=0x7f511401c3c0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f386c800640 1 Processor -- start 2024-01-30T08:09:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 shutdown_connections 2024-01-30T08:09:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f5134600640 1 --2- 172.21.15.50:0/3946152230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c15c190 0x7f512c15c620 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f5134600640 1 --2- 172.21.15.50:0/3946152230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c06aae0 0x7f512c06af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f386c800640 1 -- start start 2024-01-30T08:09:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 >> 172.21.15.50:0/3946152230 conn(0x7f512c0c5b10 msgr2=0x7f512c0c5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f1a67600640 1 Processor -- start 2024-01-30T08:09:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6ea2600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6e940d73e0 0x7f6e940d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6ea2600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e94049ec0 con 0x7f6e94009fd0 2024-01-30T08:09:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6ea2600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9404a200 con 0x7f6e94049940 2024-01-30T08:09:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6ea2600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e94047d30 con 0x7f6e940d73e0 2024-01-30T08:09:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6e9be00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e94009fd0 0x7f6e94006eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37728/0 (socket says 172.21.15.50:37728) 2024-01-30T08:09:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.423+0000 7f6e9be00640 1 -- 172.21.15.50:0/2723621492 learned_addr learned my addr 172.21.15.50:0/2723621492 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 shutdown_connections 2024-01-30T08:09:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386c800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38640c3a10 0x7f3864155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386c800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38640c3f20 0x7f38641f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386c800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3864156160 0x7f38640bf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386c800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38641f5a30 con 0x7f38640c3f20 2024-01-30T08:09:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386c800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38640a9130 con 0x7f38640c3a10 2024-01-30T08:09:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386c800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38640a8b20 con 0x7f3864156160 2024-01-30T08:09:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3510e00640 1 --2- 172.21.15.50:0/4172261280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c06e350 0x7f350c1536e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098a0 tx=0x7f34f401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8263c2a2bd71bbc3 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f350b400640 1 -- 172.21.15.50:0/4172261280 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40aa5f0 con 0x7f350c06e350 2024-01-30T08:09:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f350b400640 1 -- 172.21.15.50:0/4172261280 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f40aa750 con 0x7f350c06e350 2024-01-30T08:09:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f350b400640 1 -- 172.21.15.50:0/4172261280 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40aaae0 con 0x7f350c06e350 2024-01-30T08:09:09.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a67600640 1 -- start start 2024-01-30T08:09:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a67600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006fe80 0x7f1a60155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a67600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a600c1fc0 0x7f1a6014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a67600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a60156030 0x7f1a600a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a67600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600a8840 con 0x7f1a600c1fc0 2024-01-30T08:09:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a67600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600a95a0 con 0x7f1a60156030 2024-01-30T08:09:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a67600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600a8f90 con 0x7f1a6006fe80 2024-01-30T08:09:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f5134600640 1 -- 172.21.15.50:0/3946152230 wait complete. 2024-01-30T08:09:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9aa00640 1 --2- 172.21.15.50:0/2723621492 >> v2:172.21.15.125:3300/0 conn(0x7f6e940d73e0 0x7f6e940d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3864156160 0x7f38640bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3864156160 0x7f38640bf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:55978/0 (socket says 172.21.15.50:55978) 2024-01-30T08:09:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3869e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38640c3a10 0x7f3864155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 -- 172.21.15.50:0/2605989694 learned_addr learned my addr 172.21.15.50:0/2605989694 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3513800640 1 -- 172.21.15.50:0/4172261280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c06e350 msgr2=0x7f350c1536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3513800640 1 --2- 172.21.15.50:0/4172261280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c06e350 0x7f350c1536e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098a0 tx=0x7f34f401c530 comp rx=0 tx=0).stop 2024-01-30T08:09:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174456763 0 0) 0x7f6e9404a200 con 0x7f6e94049940 2024-01-30T08:09:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a60156030 0x7f1a600a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a60156030 0x7f1a600a9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37298/0 (socket says 172.21.15.50:37298) 2024-01-30T08:09:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 -- 172.21.15.50:0/4113972502 learned_addr learned my addr 172.21.15.50:0/4113972502 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a64c00640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006fe80 0x7f1a60155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a5fe00640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a600c1fc0 0x7f1a6014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3869400640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38640c3f20 0x7f38641f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 -- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006fe80 msgr2=0x7f1a60155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006fe80 0x7f1a60155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e7c003530 con 0x7f6e94049940 2024-01-30T08:09:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 -- 172.21.15.50:0/4113972502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a600c1fc0 msgr2=0x7f1a6014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a600c1fc0 0x7f1a6014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 -- 172.21.15.50:0/4113972502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50009420 con 0x7f1a60156030 2024-01-30T08:09:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 -- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38640c3a10 msgr2=0x7f3864155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38640c3a10 0x7f3864155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 -- 172.21.15.50:0/2605989694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38640c3f20 msgr2=0x7f38641f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38640c3f20 0x7f38641f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 -- 172.21.15.50:0/2605989694 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3854009420 con 0x7f3864156160 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f386a800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3864156160 0x7f38640bf640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f385c007ac0 tx=0x7f385c007f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 <== mon.1 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585938145 0 0) 0x7f6e7c003530 con 0x7f6e94049940 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 >> v2:172.21.15.125:3300/0 conn(0x7f6e940d73e0 msgr2=0x7f6e940d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 --2- 172.21.15.50:0/2723621492 >> v2:172.21.15.125:3300/0 conn(0x7f6e940d73e0 0x7f6e940d6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 >> v1:172.21.15.50:6789/0 conn(0x7f6e94009fd0 legacy=0x7f6e94006eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9404a4e0 con 0x7f6e94049940 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3513800640 1 -- 172.21.15.50:0/4172261280 shutdown_connections 2024-01-30T08:09:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3513800640 1 --2- 172.21.15.50:0/4172261280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c06e350 0x7f350c1536e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f3513800640 1 -- 172.21.15.50:0/4172261280 >> 172.21.15.50:0/4172261280 conn(0x7f350c0c5f10 msgr2=0x7f350c0c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f1a65600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a60156030 0x7f1a600a9a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800b970 tx=0x7f1a5800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 <== mon.1 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f6e9c074800 con 0x7f6e94049940 2024-01-30T08:09:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.427+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 >> v1:172.21.15.125:6789/0 conn(0x7f6e94049940 legacy=0x7f6e9404afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f3862000640 1 -- 172.21.15.50:0/2605989694 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00dd60 con 0x7f3864156160 2024-01-30T08:09:09.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9a000640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c003980 0x7f6e7c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f3862000640 1 -- 172.21.15.50:0/2605989694 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00f040 con 0x7f3864156160 2024-01-30T08:09:09.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f3862000640 1 -- 172.21.15.50:0/2605989694 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00dee0 con 0x7f3864156160 2024-01-30T08:09:09.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f1a5cc00640 1 -- 172.21.15.50:0/4113972502 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800cb40 con 0x7f1a60156030 2024-01-30T08:09:09.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f1a5cc00640 1 -- 172.21.15.50:0/4113972502 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5800ccc0 con 0x7f1a60156030 2024-01-30T08:09:09.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f1a5cc00640 1 -- 172.21.15.50:0/4113972502 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58014680 con 0x7f1a60156030 2024-01-30T08:09:09.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38641f5750 con 0x7f3864156160 2024-01-30T08:09:09.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9a000640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c004390 0x7f6e7c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38641f5200 con 0x7f3864156160 2024-01-30T08:09:09.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a60150010 con 0x7f1a60156030 2024-01-30T08:09:09.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9a000640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94047d30 con 0x7f6e7c004390 2024-01-30T08:09:09.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c00c060 con 0x7f6e7c005110 2024-01-30T08:09:09.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c00c220 con 0x7f6e7c003980 2024-01-30T08:09:09.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9b400640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c003980 0x7f6e7c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a601502f0 con 0x7f1a60156030 2024-01-30T08:09:09.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9be00640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38340052a0 con 0x7f3864156160 2024-01-30T08:09:09.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f5134600640 1 Processor -- start 2024-01-30T08:09:09.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f3513800640 1 -- 172.21.15.50:0/4172261280 shutdown_connections 2024-01-30T08:09:09.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f3513800640 1 -- 172.21.15.50:0/4172261280 wait complete. 2024-01-30T08:09:09.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f3513800640 1 Processor -- start 2024-01-30T08:09:09.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3513800640 1 -- start start 2024-01-30T08:09:09.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f5134600640 1 -- start start 2024-01-30T08:09:09.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3862000640 1 -- 172.21.15.50:0/2605989694 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f385c003be0 con 0x7f3864156160 2024-01-30T08:09:09.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a600a9750 con 0x7f1a60156030 2024-01-30T08:09:09.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f1a5cc00640 1 -- 172.21.15.50:0/4113972502 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1a58007370 con 0x7f1a60156030 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f1a5cc00640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a38066580 0x7f1a38068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f1a5cc00640 1 -- 172.21.15.50:0/4113972502 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a58084070 con 0x7f1a60156030 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5134600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c06aae0 0x7f512c14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5134600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f512c156160 0x7f512c1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5134600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c15c190 0x7f512c14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5134600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1f2160 con 0x7f512c156160 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5134600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c14e250 con 0x7f512c06aae0 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5134600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c14f500 con 0x7f512c15c190 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c15c190 0x7f512c14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c15c190 0x7f512c14fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56032/0 (socket says 172.21.15.50:56032) 2024-01-30T08:09:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 -- 172.21.15.50:0/4108099501 learned_addr learned my addr 172.21.15.50:0/4108099501 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5131c00640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c06aae0 0x7f512c14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3513800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06e350 0x7f350c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3513800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f350c0723e0 0x7f350c14da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3513800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c0c0c80 0x7f350c14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3513800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1f7de0 con 0x7f350c0723e0 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3513800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0bff70 con 0x7f350c06e350 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3513800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1fabf0 con 0x7f350c0c0c80 2024-01-30T08:09:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3510e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06e350 0x7f350c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9be00640 1 -- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c003980 msgr2=0x7f6e7c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9be00640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e7c003980 0x7f6e7c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9be00640 1 -- 172.21.15.50:0/2723621492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c004390 msgr2=0x7f6e7c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9be00640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e7c004390 0x7f6e7c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.431+0000 7f6e9be00640 1 -- 172.21.15.50:0/2723621492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c003530 con 0x7f6e7c005110 2024-01-30T08:09:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f6e9be00640 1 -- 172.21.15.50:0/2723621492 reap_dead start 2024-01-30T08:09:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f1a64c00640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a38066580 0x7f1a38068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3510e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06e350 0x7f350c070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37312/0 (socket says 172.21.15.50:37312) 2024-01-30T08:09:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3510e00640 1 -- 172.21.15.50:0/3578945978 learned_addr learned my addr 172.21.15.50:0/3578945978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3862000640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f383c0665d0 0x7f383c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3862000640 1 -- 172.21.15.50:0/2605989694 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f385c083f50 con 0x7f3864156160 2024-01-30T08:09:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3869e00640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f383c0665d0 0x7f383c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f3511800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c0c0c80 0x7f350c14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f6e9be00640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e7c00b990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c001a00 tx=0x7f6e8c01c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ab6388bf79e66b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 -- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c06aae0 msgr2=0x7f512c14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c06aae0 0x7f512c14e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 -- 172.21.15.50:0/4108099501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f512c156160 msgr2=0x7f512c1f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f512c156160 0x7f512c1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db4600640 1 Processor -- start 2024-01-30T08:09:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f350be00640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f350c0723e0 0x7f350c14da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.435+0000 7f5132600640 1 -- 172.21.15.50:0/4108099501 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114009420 con 0x7f512c15c190 2024-01-30T08:09:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f3511800640 1 -- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06e350 msgr2=0x7f350c070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f3511800640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06e350 0x7f350c070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f3511800640 1 -- 172.21.15.50:0/3578945978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f350c0723e0 msgr2=0x7f350c14da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f3511800640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f350c0723e0 0x7f350c14da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f3511800640 1 -- 172.21.15.50:0/3578945978 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40094d0 con 0x7f350c0c0c80 2024-01-30T08:09:09.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 Processor -- start 2024-01-30T08:09:09.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db4600640 1 -- start start 2024-01-30T08:09:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5132600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c15c190 0x7f512c14fe90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5114009710 tx=0x7f5114019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 -- start start 2024-01-30T08:09:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f3869e00640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f383c0665d0 0x7f383c068a90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38540af000 tx=0x7f38540a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f1a64c00640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a38066580 0x7f1a38068a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a500af000 tx=0x7f1a500a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f3511800640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c0c0c80 0x7f350c14dfc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f350400c760 tx=0x7f350400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db4600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac070ce0 0x7f5dac15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db4600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5dac0c2220 0x7f5dac0c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db4600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac070aa0 con 0x7f5dac152db0 2024-01-30T08:09:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db4600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac071160 con 0x7f5dac0c2220 2024-01-30T08:09:09.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db4600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0704e0 con 0x7f5dac070ce0 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08200aade0 0x7f0820072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f082006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f082006e780 0x7f08200c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08200c6b70 con 0x7f082006e780 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08200c3dc0 con 0x7f08200aade0 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f0824a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08200ab1c0 con 0x7f08200c63b0 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db2600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5dac0c2220 0x7f5dac0c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db1200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac070ce0 0x7f5dac15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db2600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5dac0c2220 0x7f5dac0c2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49512/0 (socket says 172.21.15.50:49512) 2024-01-30T08:09:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db1c00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5dac152db0 0x7f5dac15c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55128/0 (socket says 172.21.15.50:55128) 2024-01-30T08:09:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f5db2600640 1 -- 172.21.15.50:0/2535670476 learned_addr learned my addr 172.21.15.50:0/2535670476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f081e800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08200aade0 0x7f0820072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f081f200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f082006e780 0x7f08200c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0048b0 con 0x7f6e7c005110 2024-01-30T08:09:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c0a7070 con 0x7f6e7c005110 2024-01-30T08:09:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f6e9a000640 1 -- 172.21.15.50:0/2723621492 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c004c50 con 0x7f6e7c005110 2024-01-30T08:09:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5dabe00640 1 -- 172.21.15.50:0/2535670476 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778787511 0 0) 0x7f5dac070aa0 con 0x7f5dac152db0 2024-01-30T08:09:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5dabe00640 1 -- 172.21.15.50:0/2535670476 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d8c003530 con 0x7f5dac152db0 2024-01-30T08:09:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5db2600640 1 -- 172.21.15.50:0/2535670476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac070ce0 msgr2=0x7f5dac15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5db2600640 1 --2- 172.21.15.50:0/2535670476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac070ce0 0x7f5dac15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5db2600640 1 -- 172.21.15.50:0/2535670476 >> v1:172.21.15.125:6789/0 conn(0x7f5dac152db0 legacy=0x7f5dac15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5db2600640 1 -- 172.21.15.50:0/2535670476 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac15d090 con 0x7f5dac0c2220 2024-01-30T08:09:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f081f200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f082006e780 0x7f08200c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49514/0 (socket says 172.21.15.50:49514) 2024-01-30T08:09:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.439+0000 7f081f200640 1 -- 172.21.15.50:0/3399265867 learned_addr learned my addr 172.21.15.50:0/3399265867 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081de00640 1 --2- 172.21.15.50:0/3399265867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f082006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f1a5cc00640 1 -- 172.21.15.50:0/4113972502 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1a580b5590 con 0x7f1a60156030 2024-01-30T08:09:09.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f6ea2600640 1 -- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 msgr2=0x7f6e7c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f6ea2600640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e7c00b990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c001a00 tx=0x7f6e8c01c620 comp rx=0 tx=0).stop 2024-01-30T08:09:09.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081de00640 1 -- 172.21.15.50:0/3399265867 >> v2:172.21.15.125:3300/0 conn(0x7f08200aade0 msgr2=0x7f0820072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081de00640 1 --2- 172.21.15.50:0/3399265867 >> v2:172.21.15.125:3300/0 conn(0x7f08200aade0 0x7f0820072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081de00640 1 -- 172.21.15.50:0/3399265867 >> v2:172.21.15.50:3300/0 conn(0x7f082006e780 msgr2=0x7f08200c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f6ea2600640 1 -- 172.21.15.50:0/2723621492 shutdown_connections 2024-01-30T08:09:09.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f6ea2600640 1 --2- 172.21.15.50:0/2723621492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e7c00b990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f6ea2600640 1 -- 172.21.15.50:0/2723621492 >> 172.21.15.50:0/2723621492 conn(0x7f6e94048260 msgr2=0x7f6e94048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081de00640 1 --2- 172.21.15.50:0/3399265867 >> v2:172.21.15.50:3300/0 conn(0x7f082006e780 0x7f08200c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f3862000640 1 -- 172.21.15.50:0/2605989694 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f385c050f90 con 0x7f3864156160 2024-01-30T08:09:09.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f3508c00640 1 -- 172.21.15.50:0/3578945978 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504006d60 con 0x7f350c0c0c80 2024-01-30T08:09:09.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f3508c00640 1 -- 172.21.15.50:0/3578945978 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504003980 con 0x7f350c0c0c80 2024-01-30T08:09:09.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f3508c00640 1 -- 172.21.15.50:0/3578945978 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504003d30 con 0x7f350c0c0c80 2024-01-30T08:09:09.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f3513800640 1 -- 172.21.15.50:0/3578945978 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c1fb080 con 0x7f350c0c0c80 2024-01-30T08:09:09.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f3513800640 1 -- 172.21.15.50:0/3578945978 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c1fa5a0 con 0x7f350c0c0c80 2024-01-30T08:09:09.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081de00640 1 -- 172.21.15.50:0/3399265867 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08200c11f0 con 0x7f08200c63b0 2024-01-30T08:09:09.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5129600640 1 -- 172.21.15.50:0/4108099501 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140ac620 con 0x7f512c15c190 2024-01-30T08:09:09.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5129600640 1 -- 172.21.15.50:0/4108099501 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140ac8f0 con 0x7f512c15c190 2024-01-30T08:09:09.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5129600640 1 -- 172.21.15.50:0/4108099501 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140acc80 con 0x7f512c15c190 2024-01-30T08:09:09.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f6ea2600640 1 -- 172.21.15.50:0/2723621492 shutdown_connections 2024-01-30T08:09:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081e800640 1 --2- 172.21.15.50:0/3399265867 >> v2:172.21.15.125:3300/0 conn(0x7f08200aade0 0x7f0820072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f081f200640 1 --2- 172.21.15.50:0/3399265867 >> v2:172.21.15.50:3300/0 conn(0x7f082006e780 0x7f08200c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c14f7e0 con 0x7f512c15c190 2024-01-30T08:09:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c14dee0 con 0x7f512c15c190 2024-01-30T08:09:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.443+0000 7f6ea2600640 1 -- 172.21.15.50:0/2723621492 wait complete. 2024-01-30T08:09:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c1fad60 con 0x7f350c0c0c80 2024-01-30T08:09:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5db2600640 1 --2- 172.21.15.50:0/2535670476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac0c2220 0x7f5dac0c2670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009e50 tx=0x7f5da401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43f382bd40734bd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c0bcdb0 con 0x7f512c15c190 2024-01-30T08:09:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f3508c00640 1 -- 172.21.15.50:0/3578945978 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f35040050d0 con 0x7f350c0c0c80 2024-01-30T08:09:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5dabe00640 1 -- 172.21.15.50:0/2535670476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40a56a0 con 0x7f5dac0c2220 2024-01-30T08:09:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5dabe00640 1 -- 172.21.15.50:0/2535670476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da40a5800 con 0x7f5dac0c2220 2024-01-30T08:09:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5dabe00640 1 -- 172.21.15.50:0/2535670476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40a5b90 con 0x7f5dac0c2220 2024-01-30T08:09:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f6ea2600640 1 Processor -- start 2024-01-30T08:09:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f6ea2600640 1 -- start start 2024-01-30T08:09:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5db4600640 1 -- 172.21.15.50:0/2535670476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac0c2220 msgr2=0x7f5dac0c2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5db4600640 1 --2- 172.21.15.50:0/2535670476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac0c2220 0x7f5dac0c2670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009e50 tx=0x7f5da401c8f0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f5129600640 1 -- 172.21.15.50:0/4108099501 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f51140aa070 con 0x7f512c15c190 2024-01-30T08:09:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f3508c00640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f34e4066550 0x7f34e4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.447+0000 7f3508c00640 1 -- 172.21.15.50:0/3578945978 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35040834a0 con 0x7f350c0c0c80 2024-01-30T08:09:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f3510e00640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f34e4066550 0x7f34e4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5129600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f51040665d0 0x7f5104068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5129600640 1 -- 172.21.15.50:0/4108099501 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f511411e720 con 0x7f512c15c190 2024-01-30T08:09:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6ea2600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e94030330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6ea2600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e940daea0 0x7f6e94040760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6ea2600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e94040ca0 0x7f6e9403eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6ea2600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940453f0 con 0x7f6e94040ca0 2024-01-30T08:09:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6ea2600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940dc710 con 0x7f6e7c005110 2024-01-30T08:09:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6ea2600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94045970 con 0x7f6e940daea0 2024-01-30T08:09:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f081de00640 1 --2- 172.21.15.50:0/3399265867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f082006e240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f082006ec80 tx=0x7f08080206b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=355d195610e1924 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e940daea0 0x7f6e94040760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e940daea0 0x7f6e94040760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56046/0 (socket says 172.21.15.50:56046) 2024-01-30T08:09:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 -- 172.21.15.50:0/1526302233 learned_addr learned my addr 172.21.15.50:0/1526302233 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5131c00640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f51040665d0 0x7f5104068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9b400640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e94030330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f3510e00640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f34e4066550 0x7f34e4068a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098a0 tx=0x7f34f40b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5db4600640 1 -- 172.21.15.50:0/2535670476 shutdown_connections 2024-01-30T08:09:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5db4600640 1 --2- 172.21.15.50:0/2535670476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac0c2220 0x7f5dac0c2670 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5db4600640 1 --2- 172.21.15.50:0/2535670476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac070ce0 0x7f5dac15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5db4600640 1 -- 172.21.15.50:0/2535670476 >> 172.21.15.50:0/2535670476 conn(0x7f5dac06cb40 msgr2=0x7f5dac06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 -- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 msgr2=0x7f6e94030330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e94030330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 -- 172.21.15.50:0/1526302233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e94040ca0 msgr2=0x7f6e9403eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e94040ca0 0x7f6e9403eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 -- 172.21.15.50:0/1526302233 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94041b70 con 0x7f6e940daea0 2024-01-30T08:09:09.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5131c00640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f51040665d0 0x7f5104068a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5124007fd0 tx=0x7f5124009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f6e9aa00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e940daea0 0x7f6e94040760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400d800 tx=0x7f6e8400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5db4600640 1 -- 172.21.15.50:0/2535670476 shutdown_connections 2024-01-30T08:09:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f5db4600640 1 -- 172.21.15.50:0/2535670476 wait complete. 2024-01-30T08:09:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.451+0000 7f3508c00640 1 -- 172.21.15.50:0/3578945978 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3504088060 con 0x7f350c0c0c80 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 Processor -- start 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 -- start start 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac070ce0 0x7f5dac15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dac0c2220 0x7f5dac14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac152db0 0x7f5dac141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac158580 con 0x7f5dac070ce0 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac146220 con 0x7f5dac0c2220 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db4600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac146500 con 0x7f5dac152db0 2024-01-30T08:09:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac070ce0 0x7f5dac15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac070ce0 0x7f5dac15bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49528/0 (socket says 172.21.15.50:49528) 2024-01-30T08:09:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 -- 172.21.15.50:0/3574128842 learned_addr learned my addr 172.21.15.50:0/3574128842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f081d400640 1 -- 172.21.15.50:0/3399265867 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200c5530 con 0x7f08200c63b0 2024-01-30T08:09:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f081d400640 1 -- 172.21.15.50:0/3399265867 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080800d2d0 con 0x7f08200c63b0 2024-01-30T08:09:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f081d400640 1 -- 172.21.15.50:0/3399265867 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08080a9760 con 0x7f08200c63b0 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1200640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dac0c2220 0x7f5dac14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db2600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac152db0 0x7f5dac141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 -- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac152db0 msgr2=0x7f5dac141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac152db0 0x7f5dac141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 -- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dac0c2220 msgr2=0x7f5dac14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dac0c2220 0x7f5dac14ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db1c00640 1 -- 172.21.15.50:0/3574128842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009b30 con 0x7f5dac070ce0 2024-01-30T08:09:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f5db2600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac152db0 0x7f5dac141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.455+0000 7f6e93400640 1 -- 172.21.15.50:0/1526302233 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e840096a0 con 0x7f6e940daea0 2024-01-30T08:09:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f6e93400640 1 -- 172.21.15.50:0/1526302233 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84009800 con 0x7f6e940daea0 2024-01-30T08:09:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f6e93400640 1 -- 172.21.15.50:0/1526302233 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84009bb0 con 0x7f6e940daea0 2024-01-30T08:09:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f6ea2600640 1 -- 172.21.15.50:0/1526302233 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e94045600 con 0x7f6e940daea0 2024-01-30T08:09:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f6ea2600640 1 -- 172.21.15.50:0/1526302233 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e94030870 con 0x7f6e940daea0 2024-01-30T08:09:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f5db1c00640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac070ce0 0x7f5dac15bab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c430 tx=0x7f5d9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f5129600640 1 -- 172.21.15.50:0/4108099501 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f51140eb6b0 con 0x7f512c15c190 2024-01-30T08:09:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f5da9600640 1 -- 172.21.15.50:0/3574128842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0074e0 con 0x7f5dac070ce0 2024-01-30T08:09:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f5da9600640 1 -- 172.21.15.50:0/3574128842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c007660 con 0x7f5dac070ce0 2024-01-30T08:09:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f5da9600640 1 -- 172.21.15.50:0/3574128842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c004a30 con 0x7f5dac070ce0 2024-01-30T08:09:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac153310 con 0x7f5dac070ce0 2024-01-30T08:09:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac14bf40 con 0x7f5dac070ce0 2024-01-30T08:09:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f0824a00640 1 -- 172.21.15.50:0/3399265867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 msgr2=0x7f082006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.459+0000 7f0824a00640 1 --2- 172.21.15.50:0/3399265867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f082006e240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f082006ec80 tx=0x7f08080206b0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac1586c0 con 0x7f5dac070ce0 2024-01-30T08:09:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c0052a0 con 0x7f6e940daea0 2024-01-30T08:09:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f6e93400640 1 -- 172.21.15.50:0/1526302233 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6e84009d10 con 0x7f6e940daea0 2024-01-30T08:09:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f5da9600640 1 -- 172.21.15.50:0/3574128842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5d9c004b90 con 0x7f5dac070ce0 2024-01-30T08:09:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f5da9600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5d840665d0 0x7f5d84068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f5da9600640 1 -- 172.21.15.50:0/3574128842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d9c083c00 con 0x7f5dac070ce0 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f0824a00640 1 -- 172.21.15.50:0/3399265867 shutdown_connections 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f0824a00640 1 --2- 172.21.15.50:0/3399265867 >> v2:172.21.15.50:3300/0 conn(0x7f082006e780 0x7f08200c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f0824a00640 1 --2- 172.21.15.50:0/3399265867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f082006e240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f0824a00640 1 --2- 172.21.15.50:0/3399265867 >> v2:172.21.15.125:3300/0 conn(0x7f08200aade0 0x7f0820072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f0824a00640 1 -- 172.21.15.50:0/3399265867 >> 172.21.15.50:0/3399265867 conn(0x7f08200a79f0 msgr2=0x7f08200a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f0824a00640 1 -- 172.21.15.50:0/3399265867 shutdown_connections 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.463+0000 7f0824a00640 1 -- 172.21.15.50:0/3399265867 wait complete. 2024-01-30T08:09:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f5db1200640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5d840665d0 0x7f5d84068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f6e93400640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e740665d0 0x7f6e74068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f6e93400640 1 -- 172.21.15.50:0/1526302233 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e84084510 con 0x7f6e940daea0 2024-01-30T08:09:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f6e9b400640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e740665d0 0x7f6e74068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f5db1200640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5d840665d0 0x7f5d84068a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5dac14a410 tx=0x7f5d94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f0824a00640 1 Processor -- start 2024-01-30T08:09:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f6e9b400640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e740665d0 0x7f6e74068a90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c064290 tx=0x7f6e9c08d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f0824a00640 1 -- start start 2024-01-30T08:09:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.467+0000 7f6e93400640 1 -- 172.21.15.50:0/1526302233 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6e84051530 con 0x7f6e940daea0 2024-01-30T08:09:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.471+0000 7f5da9600640 1 -- 172.21.15.50:0/3574128842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5d9c050c20 con 0x7f5dac070ce0 2024-01-30T08:09:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f0824a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f082006e780 0x7f08200a6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f0824a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08200aade0 0x7f08201f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f0824a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f08201f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f0824a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08200a46c0 con 0x7f08200aade0 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f0824a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08201e3530 con 0x7f082006e780 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f0824a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08201f14e0 con 0x7f08200c63b0 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f081f200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f08201f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f081f200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f08201f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56054/0 (socket says 172.21.15.50:56054) 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f081f200640 1 -- 172.21.15.50:0/225616244 learned_addr learned my addr 172.21.15.50:0/225616244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.475+0000 7f081e800640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f082006e780 0x7f08200a6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f081e800640 1 -- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 msgr2=0x7f08201f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f081e800640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f08201f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f081e800640 1 -- 172.21.15.50:0/225616244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08200aade0 msgr2=0x7f08201f1970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f081e800640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08200aade0 0x7f08201f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f081e800640 1 -- 172.21.15.50:0/225616244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081000b580 con 0x7f082006e780 2024-01-30T08:09:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f081e800640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f082006e780 0x7f08200a6be0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e60 tx=0x7f081800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f0816a00640 1 -- 172.21.15.50:0/225616244 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818014480 con 0x7f082006e780 2024-01-30T08:09:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f0816a00640 1 -- 172.21.15.50:0/225616244 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800f040 con 0x7f082006e780 2024-01-30T08:09:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0818009a70 con 0x7f082006e780 2024-01-30T08:09:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f0816a00640 1 -- 172.21.15.50:0/225616244 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818014820 con 0x7f082006e780 2024-01-30T08:09:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.479+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080800d8c0 con 0x7f082006e780 2024-01-30T08:09:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.483+0000 7f0816a00640 1 -- 172.21.15.50:0/225616244 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0818014980 con 0x7f082006e780 2024-01-30T08:09:09.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.483+0000 7f0816a00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f07f8066500 0x7f07f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.483+0000 7f0816a00640 1 -- 172.21.15.50:0/225616244 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0818084fe0 con 0x7f082006e780 2024-01-30T08:09:09.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.483+0000 7f081de00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f07f8066500 0x7f07f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.487+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08201f5290 con 0x7f082006e780 2024-01-30T08:09:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.487+0000 7f081de00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f07f8066500 0x7f07f80689c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f08080b2000 tx=0x7f0808004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.495+0000 7f0816a00640 1 -- 172.21.15.50:0/225616244 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0818051f80 con 0x7f082006e780 2024-01-30T08:09:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7ea400640 1 Processor -- start 2024-01-30T08:09:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7ea400640 1 -- start start 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7ea400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7e40c2e80 0x7fd7e4158820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7ea400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e41551f0 0x7fd7e413d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7ea400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e4071890 con 0x7fd7e40c2aa0 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7ea400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e4158d60 con 0x7fd7e40c2e80 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7ea400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4157d60 con 0x7fd7e41551f0 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7e3e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e41551f0 0x7fd7e413d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7e3e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e41551f0 0x7fd7e413d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56058/0 (socket says 172.21.15.50:56058) 2024-01-30T08:09:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7e3e00640 1 -- 172.21.15.50:0/2685440333 learned_addr learned my addr 172.21.15.50:0/2685440333 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7e3e00640 1 -- 172.21.15.50:0/2685440333 >> v2:172.21.15.50:3300/0 conn(0x7fd7e40c2e80 msgr2=0x7fd7e4158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:09.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7e3e00640 1 --2- 172.21.15.50:0/2685440333 >> v2:172.21.15.50:3300/0 conn(0x7fd7e40c2e80 0x7fd7e4158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7e3e00640 1 -- 172.21.15.50:0/2685440333 >> v1:172.21.15.125:6789/0 conn(0x7fd7e40c2aa0 legacy=0x7fd7e4071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.499+0000 7fd7e3e00640 1 -- 172.21.15.50:0/2685440333 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40c05f0 con 0x7fd7e41551f0 2024-01-30T08:09:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.511+0000 7fd7e3e00640 1 --2- 172.21.15.50:0/2685440333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e41551f0 0x7fd7e413d650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009870 tx=0x7fd7d401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9089d2864ebf232 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7e2000640 1 -- 172.21.15.50:0/2685440333 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40aa670 con 0x7fd7e41551f0 2024-01-30T08:09:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7e2000640 1 -- 172.21.15.50:0/2685440333 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d40aa7d0 con 0x7fd7e41551f0 2024-01-30T08:09:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7e2000640 1 -- 172.21.15.50:0/2685440333 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40aa670 con 0x7fd7e41551f0 2024-01-30T08:09:09.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 -- 172.21.15.50:0/2685440333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e41551f0 msgr2=0x7fd7e413d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 --2- 172.21.15.50:0/2685440333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e41551f0 0x7fd7e413d650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009870 tx=0x7fd7d401c510 comp rx=0 tx=0).stop 2024-01-30T08:09:09.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 -- 172.21.15.50:0/2685440333 shutdown_connections 2024-01-30T08:09:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 --2- 172.21.15.50:0/2685440333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e41551f0 0x7fd7e413d650 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 --2- 172.21.15.50:0/2685440333 >> v2:172.21.15.50:3300/0 conn(0x7fd7e40c2e80 0x7fd7e4158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 -- 172.21.15.50:0/2685440333 >> 172.21.15.50:0/2685440333 conn(0x7fd7e406c890 msgr2=0x7fd7e406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 -- 172.21.15.50:0/2685440333 shutdown_connections 2024-01-30T08:09:09.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.515+0000 7fd7ea400640 1 -- 172.21.15.50:0/2685440333 wait complete. 2024-01-30T08:09:09.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.519+0000 7fd7ea400640 1 Processor -- start 2024-01-30T08:09:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.519+0000 7fd7ea400640 1 -- start start 2024-01-30T08:09:09.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7ea400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e40c2aa0 0x7fd7e40c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7ea400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e40c2e80 0x7fd7e412f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7ea400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7e41551f0 0x7fd7e412fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e40c2aa0 0x7fd7e40c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e40c2aa0 0x7fd7e40c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56062/0 (socket says 172.21.15.50:56062) 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7e41551f0 0x7fd7e412fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7e41551f0 0x7fd7e412fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37362/0 (socket says 172.21.15.50:37362) 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 -- 172.21.15.50:0/3212526232 learned_addr learned my addr 172.21.15.50:0/3212526232 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e412ff80 con 0x7fd7e40c2e80 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41f1170 con 0x7fd7e41551f0 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41f0c10 con 0x7fd7e40c2aa0 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 -- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e40c2aa0 msgr2=0x7fd7e40c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e40c2aa0 0x7fd7e40c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 -- 172.21.15.50:0/3212526232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e40c2e80 msgr2=0x7fd7e412f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e40c2e80 0x7fd7e412f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40094d0 con 0x7fd7e41551f0 2024-01-30T08:09:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3e00640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7e41551f0 0x7fd7e412fa40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7d401a140 tx=0x7fd7d40192b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.523+0000 7fd7e3400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e40c2aa0 0x7fd7e40c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-01-30T08:09:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.527+0000 7fd7db400640 1 -- 172.21.15.50:0/3212526232 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40aae10 con 0x7fd7e41551f0 2024-01-30T08:09:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.527+0000 7fd7db400640 1 -- 172.21.15.50:0/3212526232 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d4003620 con 0x7fd7e41551f0 2024-01-30T08:09:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.527+0000 7fd7db400640 1 -- 172.21.15.50:0/3212526232 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4003990 con 0x7fd7e41551f0 2024-01-30T08:09:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.527+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e41f0e90 con 0x7fd7e41551f0 2024-01-30T08:09:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.527+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e40a8850 con 0x7fd7e41551f0 2024-01-30T08:09:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.531+0000 7fd7db400640 1 -- 172.21.15.50:0/3212526232 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd7d4003af0 con 0x7fd7e41551f0 2024-01-30T08:09:09.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.531+0000 7fd7db400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7bc066600 0x7fd7bc068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.531+0000 7fd7db400640 1 -- 172.21.15.50:0/3212526232 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7d411efc0 con 0x7fd7e41551f0 2024-01-30T08:09:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.531+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e4074a20 con 0x7fd7e41551f0 2024-01-30T08:09:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.531+0000 7fd7e3400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7bc066600 0x7fd7bc068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.535+0000 7fd7e3400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7bc066600 0x7fd7bc068ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc000f70 tx=0x7fd7cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:09.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.539+0000 7fd7db400640 1 -- 172.21.15.50:0/3212526232 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd7d40ebfe0 con 0x7fd7e41551f0 2024-01-30T08:09:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.759+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3834005550 con 0x7f3864156160 2024-01-30T08:09:09.764 INFO:teuthology.orchestra.run.smithi050.stdout:60129542151 2024-01-30T08:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.759+0000 7f3862000640 1 -- 172.21.15.50:0/2605989694 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f385c0545b0 con 0x7f3864156160 2024-01-30T08:09:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f383c0665d0 msgr2=0x7f383c068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f383c0665d0 0x7f383c068a90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38540af000 tx=0x7f38540a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3864156160 msgr2=0x7f38640bf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3864156160 0x7f38640bf640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f385c007ac0 tx=0x7f385c007f80 comp rx=0 tx=0).stop 2024-01-30T08:09:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 shutdown_connections 2024-01-30T08:09:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f383c0665d0 0x7f383c068a90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3864156160 0x7f38640bf640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38640c3f20 0x7f38641f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 --2- 172.21.15.50:0/2605989694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38640c3a10 0x7f3864155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 >> 172.21.15.50:0/2605989694 conn(0x7f38640c5f10 msgr2=0x7f38640a58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 shutdown_connections 2024-01-30T08:09:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.763+0000 7f386c800640 1 -- 172.21.15.50:0/2605989694 wait complete. 2024-01-30T08:09:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.795+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a6004ead0 con 0x7f1a60156030 2024-01-30T08:09:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.795+0000 7f1a5cc00640 1 -- 172.21.15.50:0/4113972502 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a58019090 con 0x7f1a60156030 2024-01-30T08:09:09.798 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2024-01-30T08:09:09.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.1 2024-01-30T08:09:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.795+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f350c04ead0 con 0x7f350c0c0c80 2024-01-30T08:09:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.799+0000 7f3508c00640 1 -- 172.21.15.50:0/3578945978 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3504050440 con 0x7f350c0c0c80 2024-01-30T08:09:09.801 INFO:teuthology.orchestra.run.smithi050.stdout:60129542151 2024-01-30T08:09:09.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.799+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f34e4066550 msgr2=0x7f34e4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.799+0000 7f3502000640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f34e4066550 0x7f34e4068a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098a0 tx=0x7f34f40b5040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c0c0c80 msgr2=0x7f350c14dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c0c0c80 0x7f350c14dfc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f350400c760 tx=0x7f350400cc20 comp rx=0 tx=0).stop 2024-01-30T08:09:09.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a38066580 msgr2=0x7f1a38068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a38066580 0x7f1a38068a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a500af000 tx=0x7f1a500a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:09.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a60156030 msgr2=0x7f1a600a9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a60156030 0x7f1a600a9a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800b970 tx=0x7f1a5800be30 comp rx=0 tx=0).stop 2024-01-30T08:09:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 shutdown_connections 2024-01-30T08:09:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f34e4066550 0x7f34e4068a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f350c0c0c80 0x7f350c14dfc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f350c0723e0 0x7f350c14da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 --2- 172.21.15.50:0/3578945978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f350c06e350 0x7f350c070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 >> 172.21.15.50:0/3578945978 conn(0x7f350c0c5f10 msgr2=0x7f350c06d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 shutdown_connections 2024-01-30T08:09:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a60156030 0x7f1a600a9a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1a38066580 0x7f1a38068a40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a600c1fc0 0x7f1a6014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 --2- 172.21.15.50:0/4113972502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006fe80 0x7f1a60155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 >> 172.21.15.50:0/4113972502 conn(0x7f1a6006ad40 msgr2=0x7f1a6015a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 shutdown_connections 2024-01-30T08:09:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f3502000640 1 -- 172.21.15.50:0/3578945978 wait complete. 2024-01-30T08:09:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 shutdown_connections 2024-01-30T08:09:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.803+0000 7f1a67600640 1 -- 172.21.15.50:0/4113972502 wait complete. 2024-01-30T08:09:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.807+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f512c04ead0 con 0x7f512c15c190 2024-01-30T08:09:09.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.807+0000 7f5129600640 1 -- 172.21.15.50:0/4108099501 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51140eb6b0 con 0x7f512c15c190 2024-01-30T08:09:09.810 INFO:teuthology.orchestra.run.smithi050.stdout:60129542151 2024-01-30T08:09:09.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.807+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5dac074a20 con 0x7f5dac070ce0 2024-01-30T08:09:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f51040665d0 msgr2=0x7f5104068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f51040665d0 0x7f5104068a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5124007fd0 tx=0x7f5124009040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c15c190 msgr2=0x7f512c14fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c15c190 0x7f512c14fe90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5114009710 tx=0x7f5114019160 comp rx=0 tx=0).stop 2024-01-30T08:09:09.813 INFO:teuthology.orchestra.run.smithi050.stdout:60129542151 2024-01-30T08:09:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5da9600640 1 -- 172.21.15.50:0/3574128842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d9c054240 con 0x7f5dac070ce0 2024-01-30T08:09:09.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 shutdown_connections 2024-01-30T08:09:09.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f51040665d0 0x7f5104068a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512c15c190 0x7f512c14fe90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f512c156160 0x7f512c1f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 --2- 172.21.15.50:0/4108099501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512c06aae0 0x7f512c14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 >> 172.21.15.50:0/4108099501 conn(0x7f512c0c5b10 msgr2=0x7f512c0c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5d840665d0 msgr2=0x7f5d84068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5d840665d0 0x7f5d84068a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5dac14a410 tx=0x7f5d94008040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac070ce0 msgr2=0x7f5dac15bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac070ce0 0x7f5dac15bab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c430 tx=0x7f5d9c00c8f0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 shutdown_connections 2024-01-30T08:09:09.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5134600640 1 -- 172.21.15.50:0/4108099501 wait complete. 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 shutdown_connections 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dac0c2220 0x7f5dac14ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5d840665d0 0x7f5d84068a90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5dac152db0 0x7f5dac141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 --2- 172.21.15.50:0/3574128842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dac070ce0 0x7f5dac15bab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.811+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 >> 172.21.15.50:0/3574128842 conn(0x7f5dac06cb40 msgr2=0x7f5dac14f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.815+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 shutdown_connections 2024-01-30T08:09:09.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.815+0000 7f5db4600640 1 -- 172.21.15.50:0/3574128842 wait complete. 2024-01-30T08:09:09.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.815+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e6c005550 con 0x7f6e940daea0 2024-01-30T08:09:09.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.815+0000 7f6e93400640 1 -- 172.21.15.50:0/1526302233 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e84054b50 con 0x7f6e940daea0 2024-01-30T08:09:09.819 INFO:teuthology.orchestra.run.smithi050.stdout:60129542151 2024-01-30T08:09:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e740665d0 msgr2=0x7f6e74068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e740665d0 0x7f6e74068a90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c064290 tx=0x7f6e9c08d040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e940daea0 msgr2=0x7f6e94040760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e940daea0 0x7f6e94040760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400d800 tx=0x7f6e8400dcc0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 shutdown_connections 2024-01-30T08:09:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e740665d0 0x7f6e74068a90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e94040ca0 0x7f6e9403eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e940daea0 0x7f6e94040760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 --2- 172.21.15.50:0/1526302233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e7c005110 0x7f6e94030330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 >> 172.21.15.50:0/1526302233 conn(0x7f6e94048260 msgr2=0x7f6e940055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 shutdown_connections 2024-01-30T08:09:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.823+0000 7f6e90c00640 1 -- 172.21.15.50:0/1526302233 wait complete. 2024-01-30T08:09:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.835+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f082004ea60 con 0x7f082006e780 2024-01-30T08:09:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.835+0000 7f0816a00640 1 -- 172.21.15.50:0/225616244 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08180555a0 con 0x7f082006e780 2024-01-30T08:09:09.838 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2024-01-30T08:09:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f07f8066500 msgr2=0x7f07f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f07f8066500 0x7f07f80689c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f08080b2000 tx=0x7f0808004740 comp rx=0 tx=0).stop 2024-01-30T08:09:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f082006e780 msgr2=0x7f08200a6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f082006e780 0x7f08200a6be0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e60 tx=0x7f081800c490 comp rx=0 tx=0).stop 2024-01-30T08:09:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 shutdown_connections 2024-01-30T08:09:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f07f8066500 0x7f07f80689c0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f08080b2000 tx=0x7f0808004740 comp rx=0 tx=0).stop 2024-01-30T08:09:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08200c63b0 0x7f08201f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08200aade0 0x7f08201f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 --2- 172.21.15.50:0/225616244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f082006e780 0x7f08200a6be0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 >> 172.21.15.50:0/225616244 conn(0x7f08200a79f0 msgr2=0x7f08200a5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.6 2024-01-30T08:09:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 shutdown_connections 2024-01-30T08:09:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.839+0000 7f0824a00640 1 -- 172.21.15.50:0/225616244 wait complete. 2024-01-30T08:09:09.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.3 2024-01-30T08:09:09.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2024-01-30T08:09:09.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.0 2024-01-30T08:09:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd7e40679f0 con 0x7fd7e41551f0 2024-01-30T08:09:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7db400640 1 -- 172.21.15.50:0/3212526232 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7d40ef600 con 0x7fd7e41551f0 2024-01-30T08:09:09.861 INFO:teuthology.orchestra.run.smithi050.stdout:60129542151 2024-01-30T08:09:09.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.2 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7bc066600 msgr2=0x7fd7bc068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7bc066600 0x7fd7bc068ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc000f70 tx=0x7fd7cc009040 comp rx=0 tx=0).stop 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7e41551f0 msgr2=0x7fd7e412fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7e41551f0 0x7fd7e412fa40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7d401a140 tx=0x7fd7d40192b0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 shutdown_connections 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7e41551f0 0x7fd7e412fa40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7bc066600 0x7fd7bc068ac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e40c2e80 0x7fd7e412f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 --2- 172.21.15.50:0/3212526232 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7e40c2aa0 0x7fd7e40c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 >> 172.21.15.50:0/3212526232 conn(0x7fd7e406c890 msgr2=0x7fd7e41562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 shutdown_connections 2024-01-30T08:09:09.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:09.859+0000 7fd7ea400640 1 -- 172.21.15.50:0/3212526232 wait complete. 2024-01-30T08:09:09.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2024-01-30T08:09:09.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2024-01-30T08:09:10.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-30T08:09:10.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-30T08:09:10.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-30T08:09:10.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-30T08:09:10.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-30T08:09:10.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-30T08:09:10.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-30T08:09:10.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-30T08:09:11.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.007+0000 7ff519e00640 1 Processor -- start 2024-01-30T08:09:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.007+0000 7ff519e00640 1 -- start start 2024-01-30T08:09:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff519e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff514072320 0x7ff5140c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff519e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5140c4300 0x7ff5140c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff519e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff514154740 con 0x7ff514153800 2024-01-30T08:09:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff519e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff514154c70 con 0x7ff514072320 2024-01-30T08:09:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff519e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff514154990 con 0x7ff5140c4300 2024-01-30T08:09:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff513400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5140c4300 0x7ff5140c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff513400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5140c4300 0x7ff5140c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56070/0 (socket says 172.21.15.50:56070) 2024-01-30T08:09:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff513400640 1 -- 172.21.15.50:0/1424691499 learned_addr learned my addr 172.21.15.50:0/1424691499 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff513400640 1 -- 172.21.15.50:0/1424691499 >> v2:172.21.15.50:3300/0 conn(0x7ff514072320 msgr2=0x7ff5140c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff513400640 1 --2- 172.21.15.50:0/1424691499 >> v2:172.21.15.50:3300/0 conn(0x7ff514072320 0x7ff5140c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff513400640 1 -- 172.21.15.50:0/1424691499 >> v1:172.21.15.50:6789/0 conn(0x7ff514153800 legacy=0x7ff51406ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.011+0000 7ff513400640 1 -- 172.21.15.50:0/1424691499 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140c5420 con 0x7ff5140c4300 2024-01-30T08:09:11.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff513400640 1 --2- 172.21.15.50:0/1424691499 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5140c4300 0x7ff5140c4710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc008870 tx=0x7ff4fc01e9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80353dee4e52bff server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff511600640 1 -- 172.21.15.50:0/1424691499 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a79c0 con 0x7ff5140c4300 2024-01-30T08:09:11.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff511600640 1 -- 172.21.15.50:0/1424691499 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0ab070 con 0x7ff5140c4300 2024-01-30T08:09:11.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff511600640 1 -- 172.21.15.50:0/1424691499 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a7d40 con 0x7ff5140c4300 2024-01-30T08:09:11.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 -- 172.21.15.50:0/1424691499 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5140c4300 msgr2=0x7ff5140c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 --2- 172.21.15.50:0/1424691499 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5140c4300 0x7ff5140c4710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc008870 tx=0x7ff4fc01e9e0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 -- 172.21.15.50:0/1424691499 shutdown_connections 2024-01-30T08:09:11.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 --2- 172.21.15.50:0/1424691499 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5140c4300 0x7ff5140c4710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 --2- 172.21.15.50:0/1424691499 >> v2:172.21.15.50:3300/0 conn(0x7ff514072320 0x7ff5140c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 -- 172.21.15.50:0/1424691499 >> 172.21.15.50:0/1424691499 conn(0x7ff5140c5b10 msgr2=0x7ff5140c5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 -- 172.21.15.50:0/1424691499 shutdown_connections 2024-01-30T08:09:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.019+0000 7ff519e00640 1 -- 172.21.15.50:0/1424691499 wait complete. 2024-01-30T08:09:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.023+0000 7ff519e00640 1 Processor -- start 2024-01-30T08:09:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.023+0000 7ff519e00640 1 -- start start 2024-01-30T08:09:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff519e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff514072320 0x7ff5140a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff519e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5140c4300 0x7ff5140a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff519e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff514153800 0x7ff5140bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff512000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5140c4300 0x7ff5140a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff512a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff514072320 0x7ff5140a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff512000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5140c4300 0x7ff5140a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49586/0 (socket says 172.21.15.50:49586) 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff512a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff514072320 0x7ff5140a80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37366/0 (socket says 172.21.15.50:37366) 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff512000640 1 -- 172.21.15.50:0/1710127188 learned_addr learned my addr 172.21.15.50:0/1710127188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff513400640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff514153800 0x7ff5140bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140a6c70 con 0x7ff5140c4300 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140a6680 con 0x7ff514072320 2024-01-30T08:09:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140bf7c0 con 0x7ff514153800 2024-01-30T08:09:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff513400640 1 -- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff514072320 msgr2=0x7ff5140a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff513400640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff514072320 0x7ff5140a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff513400640 1 -- 172.21.15.50:0/1710127188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5140c4300 msgr2=0x7ff5140a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff513400640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5140c4300 0x7ff5140a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff513400640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc008550 con 0x7ff514153800 2024-01-30T08:09:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff513400640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff514153800 0x7ff5140bf280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0af000 tx=0x7ff4fc01d220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff50b400640 1 -- 172.21.15.50:0/1710127188 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a8c60 con 0x7ff514153800 2024-01-30T08:09:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff50b400640 1 -- 172.21.15.50:0/1710127188 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0a8dc0 con 0x7ff514153800 2024-01-30T08:09:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.027+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5140bfa40 con 0x7ff514153800 2024-01-30T08:09:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.031+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5140a6890 con 0x7ff514153800 2024-01-30T08:09:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.031+0000 7ff50b400640 1 -- 172.21.15.50:0/1710127188 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00b370 con 0x7ff514153800 2024-01-30T08:09:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.031+0000 7ff50b400640 1 -- 172.21.15.50:0/1710127188 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff4fc00b4d0 con 0x7ff514153800 2024-01-30T08:09:11.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.035+0000 7ff50b400640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff4ec066500 0x7ff4ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.035+0000 7ff50b400640 1 -- 172.21.15.50:0/1710127188 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4fc11e170 con 0x7ff514153800 2024-01-30T08:09:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.035+0000 7ff512a00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff4ec066500 0x7ff4ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.035+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e40052a0 con 0x7ff514153800 2024-01-30T08:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.035+0000 7ff512a00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff4ec066500 0x7ff4ec0689c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff514152cd0 tx=0x7ff504009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.043+0000 7ff50b400640 1 -- 172.21.15.50:0/1710127188 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff4fc0eb2e0 con 0x7ff514153800 2024-01-30T08:09:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 Processor -- start 2024-01-30T08:09:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 -- start start 2024-01-30T08:09:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c1512c0 0x7f245c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f245c072490 0x7f245c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f245c0a4ca0 0x7f245c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0c5800 con 0x7f245c072490 2024-01-30T08:09:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2460e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c1512c0 0x7f245c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2460e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c1512c0 0x7f245c06db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56088/0 (socket says 172.21.15.50:56088) 2024-01-30T08:09:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2460e00640 1 -- 172.21.15.50:0/3968142234 learned_addr learned my addr 172.21.15.50:0/3968142234 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0c4ac0 con 0x7f245c0a4ca0 2024-01-30T08:09:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2462200640 1 -- 172.21.15.50:0/3968142234 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c154d70 con 0x7f245c1512c0 2024-01-30T08:09:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f2461800640 1 --2- 172.21.15.50:0/3968142234 >> v2:172.21.15.125:3300/0 conn(0x7f245c0a4ca0 0x7f245c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.071+0000 7f245be00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f245c072490 0x7f245c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.075+0000 7f1928c00640 1 Processor -- start 2024-01-30T08:09:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.075+0000 7f1928c00640 1 -- start start 2024-01-30T08:09:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.075+0000 7f2461800640 1 -- 172.21.15.50:0/3968142234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c1512c0 msgr2=0x7f245c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.075+0000 7f2461800640 1 --2- 172.21.15.50:0/3968142234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c1512c0 0x7f245c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.075+0000 7f2461800640 1 -- 172.21.15.50:0/3968142234 >> v2:172.21.15.50:3300/0 conn(0x7f245c072490 msgr2=0x7f245c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.075+0000 7f2461800640 1 --2- 172.21.15.50:0/3968142234 >> v2:172.21.15.50:3300/0 conn(0x7f245c072490 0x7f245c0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.075+0000 7f2461800640 1 -- 172.21.15.50:0/3968142234 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0c54d0 con 0x7f245c0a4ca0 2024-01-30T08:09:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1928c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1924156160 0x7f192406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1928c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19240c3a10 0x7f19241633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1921e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1924156160 0x7f192406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1921e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1924156160 0x7f192406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49602/0 (socket says 172.21.15.50:49602) 2024-01-30T08:09:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1921e00640 1 -- 172.21.15.50:0/1048589399 learned_addr learned my addr 172.21.15.50:0/1048589399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1922800640 1 --2- 172.21.15.50:0/1048589399 >> v2:172.21.15.125:3300/0 conn(0x7f19240c3a10 0x7f19241633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f2461800640 1 --2- 172.21.15.50:0/3968142234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c0a4ca0 0x7f245c153e70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f245c06d1d0 tx=0x7f244c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=478fd1e747fd31c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192415c090 con 0x7f19240c3f20 2024-01-30T08:09:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240c1be0 con 0x7f1924156160 2024-01-30T08:09:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f245b400640 1 -- 172.21.15.50:0/3968142234 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0ab600 con 0x7f245c0a4ca0 2024-01-30T08:09:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f245b400640 1 -- 172.21.15.50:0/3968142234 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c0a7050 con 0x7f245c0a4ca0 2024-01-30T08:09:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f245b400640 1 -- 172.21.15.50:0/3968142234 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0ab980 con 0x7f245c0a4ca0 2024-01-30T08:09:11.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240c0770 con 0x7f19240c3a10 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1922800640 1 -- 172.21.15.50:0/1048589399 >> v2:172.21.15.50:3300/0 conn(0x7f1924156160 msgr2=0x7f192406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.083+0000 7f2462200640 1 -- 172.21.15.50:0/3968142234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c0a4ca0 msgr2=0x7f245c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.083+0000 7f2462200640 1 --2- 172.21.15.50:0/3968142234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c0a4ca0 0x7f245c153e70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f245c06d1d0 tx=0x7f244c01c3e0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.083+0000 7f2462200640 1 -- 172.21.15.50:0/3968142234 shutdown_connections 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.083+0000 7f2462200640 1 --2- 172.21.15.50:0/3968142234 >> v2:172.21.15.50:3300/0 conn(0x7f245c072490 0x7f245c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.083+0000 7f2462200640 1 --2- 172.21.15.50:0/3968142234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c0a4ca0 0x7f245c153e70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.083+0000 7f2462200640 1 --2- 172.21.15.50:0/3968142234 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c1512c0 0x7f245c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.083+0000 7f2462200640 1 -- 172.21.15.50:0/3968142234 >> 172.21.15.50:0/3968142234 conn(0x7f245c06ad40 msgr2=0x7f245c0a7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1922800640 1 --2- 172.21.15.50:0/1048589399 >> v2:172.21.15.50:3300/0 conn(0x7f1924156160 0x7f192406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1922800640 1 -- 172.21.15.50:0/1048589399 >> v1:172.21.15.50:6789/0 conn(0x7f19240c3f20 legacy=0x7f192415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.079+0000 7f1922800640 1 -- 172.21.15.50:0/1048589399 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924156540 con 0x7f19240c3a10 2024-01-30T08:09:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1922800640 1 --2- 172.21.15.50:0/1048589399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19241633e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f192406b690 tx=0x7f191401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cfd26fd0c216d94 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f2462200640 1 -- 172.21.15.50:0/3968142234 shutdown_connections 2024-01-30T08:09:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f2462200640 1 -- 172.21.15.50:0/3968142234 wait complete. 2024-01-30T08:09:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1920a00640 1 -- 172.21.15.50:0/1048589399 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140ac600 con 0x7f19240c3a10 2024-01-30T08:09:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1920a00640 1 -- 172.21.15.50:0/1048589399 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19140a8050 con 0x7f19240c3a10 2024-01-30T08:09:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1920a00640 1 -- 172.21.15.50:0/1048589399 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140ac980 con 0x7f19240c3a10 2024-01-30T08:09:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 msgr2=0x7f19241633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1928c00640 1 --2- 172.21.15.50:0/1048589399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19241633e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f192406b690 tx=0x7f191401c3a0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 shutdown_connections 2024-01-30T08:09:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1928c00640 1 --2- 172.21.15.50:0/1048589399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19241633e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1928c00640 1 --2- 172.21.15.50:0/1048589399 >> v2:172.21.15.50:3300/0 conn(0x7f1924156160 0x7f192406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.087+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 >> 172.21.15.50:0/1048589399 conn(0x7f19240c5f10 msgr2=0x7f19240c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2462200640 1 Processor -- start 2024-01-30T08:09:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 shutdown_connections 2024-01-30T08:09:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f1928c00640 1 -- 172.21.15.50:0/1048589399 wait complete. 2024-01-30T08:09:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2462200640 1 -- start start 2024-01-30T08:09:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7fcfbf400640 1 Processor -- start 2024-01-30T08:09:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2462200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c072490 0x7f245c0bd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2462200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c0a4ca0 0x7f245c1f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2460e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c072490 0x7f245c0bd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2460e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c072490 0x7f245c0bd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37398/0 (socket says 172.21.15.50:37398) 2024-01-30T08:09:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f1928c00640 1 Processor -- start 2024-01-30T08:09:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2460e00640 1 -- 172.21.15.50:0/3878986705 learned_addr learned my addr 172.21.15.50:0/3878986705 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f1928c00640 1 -- start start 2024-01-30T08:09:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f245be00640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c0a4ca0 0x7f245c1f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7f2462200640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c1512c0 0x7f245c0a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0a7c90 con 0x7f245c1512c0 2024-01-30T08:09:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2461800640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c1512c0 0x7f245c0a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.091+0000 7fcfbf400640 1 -- start start 2024-01-30T08:09:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbf400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb8152db0 0x7fcfb8070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbf400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfb815c440 0x7fcfb815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbf400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb8070aa0 con 0x7fcfb815ce00 2024-01-30T08:09:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbf400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80704e0 con 0x7fcfb815c440 2024-01-30T08:09:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbf400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8159690 con 0x7fcfb8152db0 2024-01-30T08:09:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb8152db0 0x7fcfb8070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb8152db0 0x7fcfb8070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56118/0 (socket says 172.21.15.50:56118) 2024-01-30T08:09:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbca00640 1 -- 172.21.15.50:0/3897743192 learned_addr learned my addr 172.21.15.50:0/3897743192 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfb7e00640 1 --2- 172.21.15.50:0/3897743192 >> v2:172.21.15.125:3300/0 conn(0x7fcfb815c440 0x7fcfb815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1928c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19240a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1928c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19240c3f20 0x7f192414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1928c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1924156160 0x7f192414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1921e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19240a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1921e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19240a7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37408/0 (socket says 172.21.15.50:37408) 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbca00640 1 -- 172.21.15.50:0/3897743192 >> v2:172.21.15.125:3300/0 conn(0x7fcfb815c440 msgr2=0x7fcfb815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbca00640 1 --2- 172.21.15.50:0/3897743192 >> v2:172.21.15.125:3300/0 conn(0x7fcfb815c440 0x7fcfb815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbca00640 1 -- 172.21.15.50:0/3897743192 >> v1:172.21.15.50:6789/0 conn(0x7fcfb815ce00 legacy=0x7fcfb806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfbca00640 1 -- 172.21.15.50:0/3897743192 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8159970 con 0x7fcfb8152db0 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1921400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19240c3f20 0x7f192414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1922800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1924156160 0x7f192414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1921400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19240c3f20 0x7f192414d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56124/0 (socket says 172.21.15.50:56124) 2024-01-30T08:09:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1922800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1924156160 0x7f192414daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49610/0 (socket says 172.21.15.50:49610) 2024-01-30T08:09:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7fcfb7e00640 1 --2- 172.21.15.50:0/3897743192 >> v2:172.21.15.125:3300/0 conn(0x7fcfb815c440 0x7fcfb815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1921e00640 1 -- 172.21.15.50:0/746489848 learned_addr learned my addr 172.21.15.50:0/746489848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240a57f0 con 0x7f1924156160 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0a76f0 con 0x7f245c072490 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c1f1660 con 0x7f245c0a4ca0 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2460e00640 1 -- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c0a4ca0 msgr2=0x7f245c1f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2460e00640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c0a4ca0 0x7f245c1f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2460e00640 1 -- 172.21.15.50:0/3878986705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c1512c0 msgr2=0x7f245c0a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2460e00640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c1512c0 0x7f245c0a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2460e00640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c009420 con 0x7f245c072490 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2461800640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c1512c0 0x7f245c0a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2460e00640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c072490 0x7f245c0bd200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2454007c00 tx=0x7f245400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2458c00640 1 -- 172.21.15.50:0/3878986705 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454007e10 con 0x7f245c072490 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2458c00640 1 -- 172.21.15.50:0/3878986705 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400f040 con 0x7f245c072490 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2458c00640 1 -- 172.21.15.50:0/3878986705 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454015640 con 0x7f245c072490 2024-01-30T08:09:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c0a79b0 con 0x7f245c072490 2024-01-30T08:09:11.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c1f1250 con 0x7f245c072490 2024-01-30T08:09:11.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19241583d0 con 0x7f19240c3a10 2024-01-30T08:09:11.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.095+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19241586b0 con 0x7f19240c3f20 2024-01-30T08:09:11.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c04ead0 con 0x7f245c072490 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1922800640 1 -- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19240c3f20 msgr2=0x7f192414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1922800640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19240c3f20 0x7f192414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1922800640 1 -- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 msgr2=0x7f19240a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1922800640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19240a7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1922800640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914009420 con 0x7f1924156160 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1922800640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1924156160 0x7f192414daf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19140ac000 tx=0x7f191401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f191a000640 1 -- 172.21.15.50:0/746489848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140b7650 con 0x7f1924156160 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f191a000640 1 -- 172.21.15.50:0/746489848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19140b77d0 con 0x7f1924156160 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f191a000640 1 -- 172.21.15.50:0/746489848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140b7b80 con 0x7f1924156160 2024-01-30T08:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1924158990 con 0x7f1924156160 2024-01-30T08:09:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1924154b20 con 0x7f1924156160 2024-01-30T08:09:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.099+0000 7f2458c00640 1 -- 172.21.15.50:0/3878986705 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f24540157a0 con 0x7f245c072490 2024-01-30T08:09:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.103+0000 7f2458c00640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2434066580 0x7f2434068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.103+0000 7f2458c00640 1 -- 172.21.15.50:0/3878986705 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2454083ef0 con 0x7f245c072490 2024-01-30T08:09:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.103+0000 7f245be00640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2434066580 0x7f2434068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.103+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1924154d70 con 0x7f1924156160 2024-01-30T08:09:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.103+0000 7f191a000640 1 -- 172.21.15.50:0/746489848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f19140b3070 con 0x7f1924156160 2024-01-30T08:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfbca00640 1 --2- 172.21.15.50:0/3897743192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb8152db0 0x7fcfb8070ce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e50 tx=0x7fcfb001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a01b22f42abda80 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7f245be00640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2434066580 0x7f2434068a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f245c0aa1a0 tx=0x7f2444009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfb7400640 1 -- 172.21.15.50:0/3897743192 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00a5560 con 0x7fcfb8152db0 2024-01-30T08:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfb7400640 1 -- 172.21.15.50:0/3897743192 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb00a56c0 con 0x7fcfb8152db0 2024-01-30T08:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfb7400640 1 -- 172.21.15.50:0/3897743192 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00a5560 con 0x7fcfb8152db0 2024-01-30T08:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7f191a000640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f18fc0665d0 0x7f18fc068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfbf400640 1 -- 172.21.15.50:0/3897743192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb8152db0 msgr2=0x7fcfb8070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfbf400640 1 --2- 172.21.15.50:0/3897743192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb8152db0 0x7fcfb8070ce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e50 tx=0x7fcfb001c8b0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7f191a000640 1 -- 172.21.15.50:0/746489848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f191411e6e0 con 0x7f1924156160 2024-01-30T08:09:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7f1921e00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f18fc0665d0 0x7f18fc068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7f1921e00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f18fc0665d0 0x7f18fc068a90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f190c006aa0 tx=0x7f190c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfbf400640 1 -- 172.21.15.50:0/3897743192 shutdown_connections 2024-01-30T08:09:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfbf400640 1 --2- 172.21.15.50:0/3897743192 >> v2:172.21.15.125:3300/0 conn(0x7fcfb815c440 0x7fcfb815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfbf400640 1 --2- 172.21.15.50:0/3897743192 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb8152db0 0x7fcfb8070ce0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7fcfbf400640 1 -- 172.21.15.50:0/3897743192 >> 172.21.15.50:0/3897743192 conn(0x7fcfb806cb40 msgr2=0x7fcfb806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.107+0000 7f2458c00640 1 -- 172.21.15.50:0/3878986705 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f24540510c0 con 0x7f245c072490 2024-01-30T08:09:11.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.111+0000 7fcfbf400640 1 -- 172.21.15.50:0/3897743192 shutdown_connections 2024-01-30T08:09:11.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.111+0000 7fcfbf400640 1 -- 172.21.15.50:0/3897743192 wait complete. 2024-01-30T08:09:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.111+0000 7fcfbf400640 1 Processor -- start 2024-01-30T08:09:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.111+0000 7fcfbf400640 1 -- start start 2024-01-30T08:09:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7f191a000640 1 -- 172.21.15.50:0/746489848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1924154d70 con 0x7f1924156160 2024-01-30T08:09:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb8152db0 0x7fcfb80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbf400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfb815c440 0x7fcfb80c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbf400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb815ce00 0x7fcfb80c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbf400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8140520 con 0x7fcfb8152db0 2024-01-30T08:09:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbf400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80c58f0 con 0x7fcfb815c440 2024-01-30T08:09:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbf400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80c4750 con 0x7fcfb815ce00 2024-01-30T08:09:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb8152db0 0x7fcfb80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfb7e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfb815c440 0x7fcfb80c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb8152db0 0x7fcfb80c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49612/0 (socket says 172.21.15.50:49612) 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbca00640 1 -- 172.21.15.50:0/2963129464 learned_addr learned my addr 172.21.15.50:0/2963129464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbd400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb815ce00 0x7fcfb80c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbd400640 1 -- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfb815c440 msgr2=0x7fcfb80c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbd400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfb815c440 0x7fcfb80c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbd400640 1 -- 172.21.15.50:0/2963129464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb8152db0 msgr2=0x7fcfb80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbd400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb8152db0 0x7fcfb80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.115+0000 7fcfbd400640 1 -- 172.21.15.50:0/2963129464 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009b30 con 0x7fcfb815ce00 2024-01-30T08:09:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.119+0000 7fcfbd400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb815ce00 0x7fcfb80c53b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfb815d250 tx=0x7fcfa800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.119+0000 7fcfb4c00640 1 -- 172.21.15.50:0/2963129464 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011830 con 0x7fcfb815ce00 2024-01-30T08:09:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.119+0000 7fcfb4c00640 1 -- 172.21.15.50:0/2963129464 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8011990 con 0x7fcfb815ce00 2024-01-30T08:09:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.119+0000 7fcfb4c00640 1 -- 172.21.15.50:0/2963129464 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011d40 con 0x7fcfb815ce00 2024-01-30T08:09:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.119+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb813efa0 con 0x7fcfb815ce00 2024-01-30T08:09:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.119+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb813fc80 con 0x7fcfb815ce00 2024-01-30T08:09:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.119+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8074a20 con 0x7fcfb815ce00 2024-01-30T08:09:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.123+0000 7fcfb4c00640 1 -- 172.21.15.50:0/2963129464 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcfa801a400 con 0x7fcfb815ce00 2024-01-30T08:09:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fcfb4c00640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcf90066500 0x7fcf900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fcfb4c00640 1 -- 172.21.15.50:0/2963129464 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfa8084690 con 0x7fcfb815ce00 2024-01-30T08:09:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fcfbca00640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcf90066500 0x7fcf900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa847e00640 1 Processor -- start 2024-01-30T08:09:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa847e00640 1 -- start start 2024-01-30T08:09:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fcfb4c00640 1 -- 172.21.15.50:0/2963129464 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcfa8051760 con 0x7fcfb815ce00 2024-01-30T08:09:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa847e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8480a5350 0x7fa84815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa847e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480c3fc0 con 0x7fa8480c4d50 2024-01-30T08:09:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa847e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480c42a0 con 0x7fa8480a4f70 2024-01-30T08:09:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa847e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480c4b40 con 0x7fa8480a5350 2024-01-30T08:09:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa846000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8480a5350 0x7fa84815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa846000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8480a5350 0x7fa84815a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49614/0 (socket says 172.21.15.50:49614) 2024-01-30T08:09:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.127+0000 7fa846000640 1 -- 172.21.15.50:0/2239286083 learned_addr learned my addr 172.21.15.50:0/2239286083 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181345171 0 0) 0x7fa8480c42a0 con 0x7fa8480a4f70 2024-01-30T08:09:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa828003530 con 0x7fa8480a4f70 2024-01-30T08:09:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fcfbca00640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcf90066500 0x7fcf900689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e50 tx=0x7fcfb00a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 <== mon.1 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2046712197 0 0) 0x7fa828003530 con 0x7fa8480a4f70 2024-01-30T08:09:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 >> v2:172.21.15.50:3300/0 conn(0x7fa8480a5350 msgr2=0x7fa84815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 --2- 172.21.15.50:0/2239286083 >> v2:172.21.15.50:3300/0 conn(0x7fa8480a5350 0x7fa84815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 >> v1:172.21.15.50:6789/0 conn(0x7fa8480c4d50 legacy=0x7fa84815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480c4580 con 0x7fa8480a4f70 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 <== mon.1 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fa838001680 con 0x7fa8480a4f70 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 >> v1:172.21.15.125:6789/0 conn(0x7fa8480a4f70 legacy=0x7fa84806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828003980 0x7fa828003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280047d0 0x7fa828004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa828005190 0x7fa82800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c4b40 con 0x7fa828005190 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82800bfe0 con 0x7fa828003980 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82800c1a0 con 0x7fa8280047d0 2024-01-30T08:09:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa846a00640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828003980 0x7fa828003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa846000640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280047d0 0x7fa828004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa846a00640 1 -- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280047d0 msgr2=0x7fa828004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa847400640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa828005190 0x7fa82800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa846a00640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280047d0 0x7fa828004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa846a00640 1 -- 172.21.15.50:0/2239286083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa828005190 msgr2=0x7fa82800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa846a00640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa828005190 0x7fa82800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.131+0000 7fa846a00640 1 -- 172.21.15.50:0/2239286083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480c4580 con 0x7fa828003980 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.135+0000 7fa846000640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280047d0 0x7fa828004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.135+0000 7fa847400640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa828005190 0x7fa82800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.135+0000 7fa847400640 1 -- 172.21.15.50:0/2239286083 reap_dead start 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa846a00640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828003980 0x7fa828003da0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c1e0 tx=0x7fa83801cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68f77690f9362cd4 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380a5b40 con 0x7fa828003980 2024-01-30T08:09:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa845600640 1 -- 172.21.15.50:0/2239286083 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8380a5cc0 con 0x7fa828003980 2024-01-30T08:09:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa847e00640 1 -- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828003980 msgr2=0x7fa828003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa847e00640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828003980 0x7fa828003da0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c1e0 tx=0x7fa83801cc60 comp rx=0 tx=0).stop 2024-01-30T08:09:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa847e00640 1 -- 172.21.15.50:0/2239286083 shutdown_connections 2024-01-30T08:09:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa847e00640 1 --2- 172.21.15.50:0/2239286083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828003980 0x7fa828003da0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa847e00640 1 -- 172.21.15.50:0/2239286083 >> 172.21.15.50:0/2239286083 conn(0x7fa84806ad40 msgr2=0x7fa8480a7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa847e00640 1 -- 172.21.15.50:0/2239286083 shutdown_connections 2024-01-30T08:09:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.139+0000 7fa847e00640 1 -- 172.21.15.50:0/2239286083 wait complete. 2024-01-30T08:09:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.143+0000 7fa847e00640 1 Processor -- start 2024-01-30T08:09:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.143+0000 7fa847e00640 1 -- start start 2024-01-30T08:09:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb641800640 1 Processor -- start 2024-01-30T08:09:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb641800640 1 -- start start 2024-01-30T08:09:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa847e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8481f1a10 0x7fa848155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa846a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8481f1a10 0x7fa848155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb641800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c14dd00 0x7fb63c0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb641800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb63c150c90 0x7fb63c151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa846a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8481f1a10 0x7fa848155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49640/0 (socket says 172.21.15.50:49640) 2024-01-30T08:09:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb63a000640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb63c0c2020 0x7fb63c0c2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55148/0 (socket says 172.21.15.50:55148) 2024-01-30T08:09:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb63a000640 1 -- 172.21.15.50:0/1064220451 learned_addr learned my addr 172.21.15.50:0/1064220451 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c153d80 con 0x7fb63c0c2020 2024-01-30T08:09:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c150790 con 0x7fb63c150c90 2024-01-30T08:09:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c151660 con 0x7fb63c14dd00 2024-01-30T08:09:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb63aa00640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c14dd00 0x7fb63c0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fb63b400640 1 --2- 172.21.15.50:0/1064220451 >> v2:172.21.15.50:3300/0 conn(0x7fb63c150c90 0x7fb63c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa847e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8480a9550 0x7fa8480a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401832021 0 0) 0x7fb63c153d80 con 0x7fb63c0c2020 2024-01-30T08:09:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa847e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8480a9f10 0x7fa84806ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa847e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c1310 con 0x7fa8481f1a10 2024-01-30T08:09:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa847e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c0ce0 con 0x7fa8480a9f10 2024-01-30T08:09:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.147+0000 7fa847e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481f2260 con 0x7fa8480a9550 2024-01-30T08:09:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8480a9550 0x7fa8480a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846a00640 1 -- 172.21.15.50:0/2024715583 learned_addr learned my addr 172.21.15.50:0/2024715583 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa847400640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8480a9f10 0x7fa84806ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846a00640 1 -- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8480a9550 msgr2=0x7fa8480a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846a00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8480a9550 0x7fa8480a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846a00640 1 -- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8480a9f10 msgr2=0x7fa84806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846a00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8480a9f10 0x7fa84806ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846a00640 1 -- 172.21.15.50:0/2024715583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8481f2500 con 0x7fa8481f1a10 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846000640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8480a9550 0x7fa8480a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb61c003530 con 0x7fb63c0c2020 2024-01-30T08:09:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa846a00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8481f1a10 0x7fa848155720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa838000c10 tx=0x7fa828005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 <== mon.1 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3534280866 0 0) 0x7fb61c003530 con 0x7fb63c0c2020 2024-01-30T08:09:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c14dd00 msgr2=0x7fb63c0c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c14dd00 0x7fb63c0c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 >> v2:172.21.15.50:3300/0 conn(0x7fb63c150c90 msgr2=0x7fb63c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 --2- 172.21.15.50:0/1064220451 >> v2:172.21.15.50:3300/0 conn(0x7fb63c150c90 0x7fb63c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c070800 con 0x7fb63c0c2020 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 <== mon.1 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fb62c001680 con 0x7fb63c0c2020 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 >> v1:172.21.15.125:6789/0 conn(0x7fb63c0c2020 legacy=0x7fb63c0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb61c003980 0x7fb61c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb61c004370 0x7fb61c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61c004d90 0x7fb61c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c150790 con 0x7fb61c004d90 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c151660 con 0x7fb61c004370 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0147d0 con 0x7fb61c003980 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb63aa00640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c14dd00 0x7fb63c0c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb63aa00640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb61c003980 0x7fb61c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb63a000640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb61c004370 0x7fb61c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fb63b400640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61c004d90 0x7fb61c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb483800640 1 Processor -- start 2024-01-30T08:09:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.151+0000 7fa83ea00640 1 -- 172.21.15.50:0/2024715583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380b1040 con 0x7fa8481f1a10 2024-01-30T08:09:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480c0f30 con 0x7fa8481f1a10 2024-01-30T08:09:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480c22e0 con 0x7fa8481f1a10 2024-01-30T08:09:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fa83ea00640 1 -- 172.21.15.50:0/2024715583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838001670 con 0x7fa8481f1a10 2024-01-30T08:09:11.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fa83ea00640 1 -- 172.21.15.50:0/2024715583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380054e0 con 0x7fa8481f1a10 2024-01-30T08:09:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb63a000640 1 -- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb61c003980 msgr2=0x7fb61c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb63a000640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb61c003980 0x7fb61c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb63a000640 1 -- 172.21.15.50:0/1064220451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61c004d90 msgr2=0x7fb61c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb63a000640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb61c004d90 0x7fb61c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb63a000640 1 -- 172.21.15.50:0/1064220451 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c070800 con 0x7fb61c004370 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb483800640 1 -- start start 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb483800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb47c14dd00 0x7fb47c0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb483800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb47c0c2020 0x7fb47c0c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb483800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c153d80 con 0x7fb47c0c2e90 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb483800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c150790 con 0x7fb47c14dd00 2024-01-30T08:09:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb483800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c070800 con 0x7fb47c0c2020 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb481800640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb47c0c2e90 0x7fb47c150c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55160/0 (socket says 172.21.15.50:55160) 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb481800640 1 -- 172.21.15.50:0/764620102 learned_addr learned my addr 172.21.15.50:0/764620102 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fb47be00640 1 --2- 172.21.15.50:0/764620102 >> v2:172.21.15.125:3300/0 conn(0x7fb47c0c2020 0x7fb47c0c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.159+0000 7fb47b400640 1 -- 172.21.15.50:0/764620102 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832554787 0 0) 0x7fb47c153d80 con 0x7fb47c0c2e90 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.159+0000 7fb47b400640 1 -- 172.21.15.50:0/764620102 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb45c003530 con 0x7fb47c0c2e90 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.159+0000 7fb47be00640 1 -- 172.21.15.50:0/764620102 >> v2:172.21.15.50:3300/0 conn(0x7fb47c14dd00 msgr2=0x7fb47c0c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.159+0000 7fb47b400640 1 -- 172.21.15.50:0/764620102 <== mon.1 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2338026191 0 0) 0x7fb45c003530 con 0x7fb47c0c2e90 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.159+0000 7fb47be00640 1 --2- 172.21.15.50:0/764620102 >> v2:172.21.15.50:3300/0 conn(0x7fb47c14dd00 0x7fb47c0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.159+0000 7fb47be00640 1 -- 172.21.15.50:0/764620102 >> v1:172.21.15.125:6789/0 conn(0x7fb47c0c2e90 legacy=0x7fb47c150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.159+0000 7fb47be00640 1 -- 172.21.15.50:0/764620102 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c070ae0 con 0x7fb47c0c2020 2024-01-30T08:09:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.155+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8180052a0 con 0x7fa8481f1a10 2024-01-30T08:09:11.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fa83ea00640 1 -- 172.21.15.50:0/2024715583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa838003600 con 0x7fa8481f1a10 2024-01-30T08:09:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb63a000640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb61c004370 0x7fb61c004850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0c2460 tx=0x7fb62c01f3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e4adca710b9fb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb47be00640 1 --2- 172.21.15.50:0/764620102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2020 0x7fb47c0c2950 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0c0d80 tx=0x7fb47401c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e99def635938b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c005ae0 con 0x7fb61c004370 2024-01-30T08:09:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c0ab070 con 0x7fb61c004370 2024-01-30T08:09:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb47b400640 1 -- 172.21.15.50:0/764620102 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464001660 con 0x7fb47c0c2020 2024-01-30T08:09:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb639600640 1 -- 172.21.15.50:0/1064220451 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c005ea0 con 0x7fb61c004370 2024-01-30T08:09:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb61c004370 msgr2=0x7fb61c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb641800640 1 --2- 172.21.15.50:0/1064220451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb61c004370 0x7fb61c004850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0c2460 tx=0x7fb62c01f3d0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fa83ea00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa820066500 0x7fa8200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb47b400640 1 -- 172.21.15.50:0/764620102 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4740a7050 con 0x7fb47c0c2020 2024-01-30T08:09:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb47b400640 1 -- 172.21.15.50:0/764620102 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740ab620 con 0x7fb47c0c2020 2024-01-30T08:09:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fa83ea00640 1 -- 172.21.15.50:0/2024715583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8381303d0 con 0x7fa8481f1a10 2024-01-30T08:09:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb63b400640 1 -- 172.21.15.50:0/1064220451 reap_dead start 2024-01-30T08:09:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 shutdown_connections 2024-01-30T08:09:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 >> 172.21.15.50:0/1064220451 conn(0x7fb63c06c890 msgr2=0x7fb63c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb483800640 1 -- 172.21.15.50:0/764620102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2020 msgr2=0x7fb47c0c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.163+0000 7fb483800640 1 --2- 172.21.15.50:0/764620102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2020 0x7fb47c0c2950 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0c0d80 tx=0x7fb47401c2f0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb483800640 1 -- 172.21.15.50:0/764620102 shutdown_connections 2024-01-30T08:09:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fa846000640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa820066500 0x7fa8200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb483800640 1 --2- 172.21.15.50:0/764620102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2020 0x7fb47c0c2950 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb483800640 1 --2- 172.21.15.50:0/764620102 >> v2:172.21.15.50:3300/0 conn(0x7fb47c14dd00 0x7fb47c0c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb483800640 1 -- 172.21.15.50:0/764620102 >> 172.21.15.50:0/764620102 conn(0x7fb47c06c890 msgr2=0x7fb47c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb483800640 1 -- 172.21.15.50:0/764620102 shutdown_connections 2024-01-30T08:09:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fa846000640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa820066500 0x7fa8200689c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa848155f00 tx=0x7fa84000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb483800640 1 -- 172.21.15.50:0/764620102 wait complete. 2024-01-30T08:09:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 shutdown_connections 2024-01-30T08:09:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb641800640 1 -- 172.21.15.50:0/1064220451 wait complete. 2024-01-30T08:09:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.167+0000 7fb483800640 1 Processor -- start 2024-01-30T08:09:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb483800640 1 -- start start 2024-01-30T08:09:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb483800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb47c0c2020 0x7fb47c144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb641800640 1 Processor -- start 2024-01-30T08:09:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb47c0c2020 0x7fb47c144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb47c0c2020 0x7fb47c144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49664/0 (socket says 172.21.15.50:49664) 2024-01-30T08:09:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb641800640 1 -- start start 2024-01-30T08:09:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb483800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2e90 0x7fb47c14bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb483800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47c14dd00 0x7fb47c1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb483800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0a9560 con 0x7fb47c0c2020 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb483800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c1f1b40 con 0x7fb47c0c2e90 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb483800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0ab500 con 0x7fb47c14dd00 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 -- 172.21.15.50:0/2136482606 learned_addr learned my addr 172.21.15.50:0/2136482606 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb481800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47c14dd00 0x7fb47c1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb47be00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2e90 0x7fb47c14bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 -- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47c14dd00 msgr2=0x7fb47c1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47c14dd00 0x7fb47c1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 -- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2e90 msgr2=0x7fb47c14bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2e90 0x7fb47c14bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb480e00640 1 -- 172.21.15.50:0/2136482606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009420 con 0x7fb47c0c2020 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.171+0000 7fb481800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47c14dd00 0x7fb47c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb47be00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2e90 0x7fb47c14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb480e00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb47c0c2020 0x7fb47c144a90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00ba50 tx=0x7fb46c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb641800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb63c0c26c0 0x7fb63c1e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb641800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c1e6800 0x7fb63c0bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb641800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb63c1e9640 0x7fb63c0bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb63c0c26c0 0x7fb63c1e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 Processor -- start 2024-01-30T08:09:11.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 -- start start 2024-01-30T08:09:11.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fa83ea00640 1 -- 172.21.15.50:0/2024715583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa8380fd4a0 con 0x7fa8481f1a10 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb641800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0c0620 con 0x7fb63c1e9640 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb641800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0bd1b0 con 0x7fb63c0c26c0 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb641800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c1e5b10 con 0x7fb63c1e6800 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63a000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c1e6800 0x7fb63c0bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb63c0c26c0 0x7fb63c1e9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37482/0 (socket says 172.21.15.50:37482) 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 -- 172.21.15.50:0/1020401165 learned_addr learned my addr 172.21.15.50:0/1020401165 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63b400640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb63c1e9640 0x7fb63c0bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 -- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c1e6800 msgr2=0x7fb63c0bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c1e6800 0x7fb63c0bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 -- 172.21.15.50:0/1020401165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb63c1e9640 msgr2=0x7fb63c0bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb63c1e9640 0x7fb63c0bf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 -- 172.21.15.50:0/1020401165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0c0340 con 0x7fb63c0c26c0 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb63aa00640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb63c0c26c0 0x7fb63c1e9100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb634011400 tx=0x7fb6340118c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb632a00640 1 -- 172.21.15.50:0/1020401165 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400e030 con 0x7fb63c0c26c0 2024-01-30T08:09:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb632a00640 1 -- 172.21.15.50:0/1020401165 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634009e10 con 0x7fb63c0c26c0 2024-01-30T08:09:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb632a00640 1 -- 172.21.15.50:0/1020401165 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340168c0 con 0x7fb63c0c26c0 2024-01-30T08:09:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c014eb30 0x7f02c00c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02c0151ef0 0x7f02c0152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c1e5d20 con 0x7fb63c0c26c0 2024-01-30T08:09:11.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c1e62e0 con 0x7fb63c0c26c0 2024-01-30T08:09:11.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb478c00640 1 -- 172.21.15.50:0/2136482606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00cbe0 con 0x7fb47c0c2020 2024-01-30T08:09:11.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb478c00640 1 -- 172.21.15.50:0/2136482606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c00cd60 con 0x7fb47c0c2020 2024-01-30T08:09:11.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb478c00640 1 -- 172.21.15.50:0/2136482606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c014680 con 0x7fb47c0c2020 2024-01-30T08:09:11.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c0a97b0 con 0x7fb47c0c2020 2024-01-30T08:09:11.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c0a9d70 con 0x7fb47c0c2020 2024-01-30T08:09:11.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02c00c2990 0x7f02c00c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c014ef10 con 0x7f02c0151ef0 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c00c1ca0 con 0x7f02c00c2990 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02c6000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00c1f80 con 0x7f02c014eb30 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02bea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02c0151ef0 0x7f02c0152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02bfe00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02c00c2990 0x7f02c00c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02bfe00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02c00c2990 0x7f02c00c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37484/0 (socket says 172.21.15.50:37484) 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.175+0000 7f02bfe00640 1 -- 172.21.15.50:0/2358653480 learned_addr learned my addr 172.21.15.50:0/2358653480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7f02bfe00640 1 -- 172.21.15.50:0/2358653480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c014eb30 msgr2=0x7f02c00c14b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7f02bfe00640 1 --2- 172.21.15.50:0/2358653480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c014eb30 0x7f02c00c14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7f02bfe00640 1 -- 172.21.15.50:0/2358653480 >> v2:172.21.15.50:3300/0 conn(0x7f02c0151ef0 msgr2=0x7f02c0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7f02bfe00640 1 --2- 172.21.15.50:0/2358653480 >> v2:172.21.15.50:3300/0 conn(0x7f02c0151ef0 0x7f02c0152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7f02bfe00640 1 -- 172.21.15.50:0/2358653480 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00c2260 con 0x7f02c00c2990 2024-01-30T08:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c074a20 con 0x7fb63c0c26c0 2024-01-30T08:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.179+0000 7fb632a00640 1 -- 172.21.15.50:0/1020401165 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb634016a20 con 0x7fb63c0c26c0 2024-01-30T08:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.183+0000 7fb632a00640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb614066600 0x7fb614068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.183+0000 7fb63a000640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb614066600 0x7fb614068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.183+0000 7fb632a00640 1 -- 172.21.15.50:0/1020401165 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb63400f070 con 0x7fb63c0c26c0 2024-01-30T08:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.183+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c074a20 con 0x7fb47c0c2020 2024-01-30T08:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.183+0000 7fb63a000640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb614066600 0x7fb614068ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0af000 tx=0x7fb62c0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.183+0000 7f02bfe00640 1 --2- 172.21.15.50:0/2358653480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c00c2990 0x7f02c00c2de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f02c006c440 tx=0x7f02b002d2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e66c27e7f3ba6f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7fb478c00640 1 -- 172.21.15.50:0/2136482606 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb46c01d3b0 con 0x7fb47c0c2020 2024-01-30T08:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7fb632a00640 1 -- 172.21.15.50:0/1020401165 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb634051d80 con 0x7fb63c0c26c0 2024-01-30T08:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02be000640 1 -- 172.21.15.50:0/2358653480 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00112d0 con 0x7f02c00c2990 2024-01-30T08:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02be000640 1 -- 172.21.15.50:0/2358653480 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b0011430 con 0x7f02c00c2990 2024-01-30T08:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02be000640 1 -- 172.21.15.50:0/2358653480 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000f850 con 0x7f02c00c2990 2024-01-30T08:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7fb478c00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb454066500 0x7fb4540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7fb478c00640 1 -- 172.21.15.50:0/2136482606 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb46c084170 con 0x7fb47c0c2020 2024-01-30T08:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7fb47be00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb454066500 0x7fb4540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02c6000640 1 -- 172.21.15.50:0/2358653480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c00c2990 msgr2=0x7f02c00c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02c6000640 1 --2- 172.21.15.50:0/2358653480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c00c2990 0x7f02c00c2de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f02c006c440 tx=0x7f02b002d2f0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02c6000640 1 -- 172.21.15.50:0/2358653480 shutdown_connections 2024-01-30T08:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02c6000640 1 --2- 172.21.15.50:0/2358653480 >> v2:172.21.15.50:3300/0 conn(0x7f02c0151ef0 0x7f02c0152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02c6000640 1 --2- 172.21.15.50:0/2358653480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c00c2990 0x7f02c00c2de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02c6000640 1 --2- 172.21.15.50:0/2358653480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c014eb30 0x7f02c00c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.187+0000 7f02c6000640 1 -- 172.21.15.50:0/2358653480 >> 172.21.15.50:0/2358653480 conn(0x7f02c006cb40 msgr2=0x7f02c006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.191+0000 7f02c6000640 1 -- 172.21.15.50:0/2358653480 shutdown_connections 2024-01-30T08:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.191+0000 7f02c6000640 1 -- 172.21.15.50:0/2358653480 wait complete. 2024-01-30T08:09:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.191+0000 7fb47be00640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb454066500 0x7fb4540689c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ad000 tx=0x7fb474008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.191+0000 7f02c6000640 1 Processor -- start 2024-01-30T08:09:11.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.191+0000 7f02c6000640 1 -- start start 2024-01-30T08:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02c6000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c00c2990 0x7f02c00c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02c6000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c014eb30 0x7f02c0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02c6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c0151ef0 0x7f02c00709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02c6000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00c5470 con 0x7f02c0151ef0 2024-01-30T08:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bea00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c014eb30 0x7f02c0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02c6000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01512c0 con 0x7f02c014eb30 2024-01-30T08:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bea00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c014eb30 0x7f02c0070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37492/0 (socket says 172.21.15.50:37492) 2024-01-30T08:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bea00640 1 -- 172.21.15.50:0/264917560 learned_addr learned my addr 172.21.15.50:0/264917560 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bfe00640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c0151ef0 0x7f02c00709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bf400640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c00c2990 0x7f02c00c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0150290 con 0x7f02c00c2990 2024-01-30T08:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bf400640 1 -- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c014eb30 msgr2=0x7f02c0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bf400640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c014eb30 0x7f02c0070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bf400640 1 -- 172.21.15.50:0/264917560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c0151ef0 msgr2=0x7f02c00709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bf400640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c0151ef0 0x7f02c00709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.195+0000 7f02bf400640 1 -- 172.21.15.50:0/264917560 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0011d70 con 0x7f02c00c2990 2024-01-30T08:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.199+0000 7f02bf400640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c00c2990 0x7f02c00c4790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02b800be20 tx=0x7f02b8009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.199+0000 7f02b7400640 1 -- 172.21.15.50:0/264917560 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8014440 con 0x7f02c00c2990 2024-01-30T08:09:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.199+0000 7f02b7400640 1 -- 172.21.15.50:0/264917560 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b80145a0 con 0x7f02c00c2990 2024-01-30T08:09:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.199+0000 7f02b7400640 1 -- 172.21.15.50:0/264917560 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8014950 con 0x7f02c00c2990 2024-01-30T08:09:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.199+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c00c5190 con 0x7f02c00c2990 2024-01-30T08:09:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.199+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c014ff20 con 0x7f02c00c2990 2024-01-30T08:09:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.199+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c014fa70 con 0x7f02c00c2990 2024-01-30T08:09:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.203+0000 7f02b7400640 1 -- 172.21.15.50:0/264917560 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f02b801d3b0 con 0x7f02c00c2990 2024-01-30T08:09:11.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.203+0000 7fb478c00640 1 -- 172.21.15.50:0/2136482606 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb46c051110 con 0x7fb47c0c2020 2024-01-30T08:09:11.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.203+0000 7f02b7400640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0298066550 0x7f0298068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.203+0000 7f02bea00640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0298066550 0x7f0298068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.207+0000 7f02b7400640 1 -- 172.21.15.50:0/264917560 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02b8054dd0 con 0x7f02c00c2990 2024-01-30T08:09:11.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.207+0000 7f02bea00640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0298066550 0x7f0298068a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02c014dde0 tx=0x7f02a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.211+0000 7f02b7400640 1 -- 172.21.15.50:0/264917560 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f02b8089060 con 0x7f02c00c2990 2024-01-30T08:09:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.387+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4e4005550 con 0x7ff514153800 2024-01-30T08:09:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.387+0000 7ff50b400640 1 -- 172.21.15.50:0/1710127188 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4fc0ad020 con 0x7ff514153800 2024-01-30T08:09:11.394 INFO:teuthology.orchestra.run.smithi050.stdout:60129542153 2024-01-30T08:09:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff4ec066500 msgr2=0x7ff4ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff4ec066500 0x7ff4ec0689c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff514152cd0 tx=0x7ff504009040 comp rx=0 tx=0).stop 2024-01-30T08:09:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff514153800 msgr2=0x7ff5140bf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff514153800 0x7ff5140bf280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0af000 tx=0x7ff4fc01d220 comp rx=0 tx=0).stop 2024-01-30T08:09:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 shutdown_connections 2024-01-30T08:09:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff4ec066500 0x7ff4ec0689c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff514153800 0x7ff5140bf280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5140c4300 0x7ff5140a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 --2- 172.21.15.50:0/1710127188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff514072320 0x7ff5140a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.395+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 >> 172.21.15.50:0/1710127188 conn(0x7ff5140c5b10 msgr2=0x7ff5140bc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.399+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 shutdown_connections 2024-01-30T08:09:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.399+0000 7ff519e00640 1 -- 172.21.15.50:0/1710127188 wait complete. 2024-01-30T08:09:11.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.1 2024-01-30T08:09:11.435 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.451+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f245c0c4f20 con 0x7f245c072490 2024-01-30T08:09:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.455+0000 7f2458c00640 1 -- 172.21.15.50:0/3878986705 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f245401a090 con 0x7f245c072490 2024-01-30T08:09:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.455+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f19240a59f0 con 0x7f1924156160 2024-01-30T08:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout:60129542153 2024-01-30T08:09:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.455+0000 7f191a000640 1 -- 172.21.15.50:0/746489848 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19240a59f0 con 0x7f1924156160 2024-01-30T08:09:11.460 INFO:teuthology.orchestra.run.smithi050.stdout:60129542153 2024-01-30T08:09:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f18fc0665d0 msgr2=0x7f18fc068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f18fc0665d0 0x7f18fc068a90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f190c006aa0 tx=0x7f190c008040 comp rx=0 tx=0).stop 2024-01-30T08:09:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1924156160 msgr2=0x7f192414daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1924156160 0x7f192414daf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19140ac000 tx=0x7f191401abe0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2434066580 msgr2=0x7f2434068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2434066580 0x7f2434068a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f245c0aa1a0 tx=0x7f2444009190 comp rx=0 tx=0).stop 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c072490 msgr2=0x7f245c0bd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c072490 0x7f245c0bd200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2454007c00 tx=0x7f245400d4a0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 shutdown_connections 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2434066580 0x7f2434068a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245c1512c0 0x7f245c0a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f245c0a4ca0 0x7f245c1f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 --2- 172.21.15.50:0/3878986705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f245c072490 0x7f245c0bd200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 >> 172.21.15.50:0/3878986705 conn(0x7f245c06ad40 msgr2=0x7f245c0c1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 shutdown_connections 2024-01-30T08:09:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f18fc0665d0 0x7f18fc068a90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1924156160 0x7f192414daf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f19240c3f20 0x7f192414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 --2- 172.21.15.50:0/746489848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19240c3a10 0x7f19240a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 >> 172.21.15.50:0/746489848 conn(0x7f19240c5f10 msgr2=0x7f19240c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 shutdown_connections 2024-01-30T08:09:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f2462200640 1 -- 172.21.15.50:0/3878986705 wait complete. 2024-01-30T08:09:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 shutdown_connections 2024-01-30T08:09:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.459+0000 7f1928c00640 1 -- 172.21.15.50:0/746489848 wait complete. 2024-01-30T08:09:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.467+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa818005820 con 0x7fa8481f1a10 2024-01-30T08:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-01-30T08:09:11.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.471+0000 7fa83ea00640 1 -- 172.21.15.50:0/2024715583 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa838100ac0 con 0x7fa8481f1a10 2024-01-30T08:09:11.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa820066500 msgr2=0x7fa8200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa820066500 0x7fa8200689c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa848155f00 tx=0x7fa84000b040 comp rx=0 tx=0).stop 2024-01-30T08:09:11.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8481f1a10 msgr2=0x7fa848155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8481f1a10 0x7fa848155720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa838000c10 tx=0x7fa828005800 comp rx=0 tx=0).stop 2024-01-30T08:09:11.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 shutdown_connections 2024-01-30T08:09:11.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8480a9f10 0x7fa84806ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa820066500 0x7fa8200689c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8480a9550 0x7fa8480a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 --2- 172.21.15.50:0/2024715583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8481f1a10 0x7fa848155720 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 >> 172.21.15.50:0/2024715583 conn(0x7fa84806ad40 msgr2=0x7fa8480a6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 shutdown_connections 2024-01-30T08:09:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.475+0000 7fa847e00640 1 -- 172.21.15.50:0/2024715583 wait complete. 2024-01-30T08:09:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.487+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcfb815ca70 con 0x7fcfb815ce00 2024-01-30T08:09:11.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.487+0000 7fcfb4c00640 1 -- 172.21.15.50:0/2963129464 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfa8015020 con 0x7fcfb815ce00 2024-01-30T08:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout:60129542153 2024-01-30T08:09:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcf90066500 msgr2=0x7fcf900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcf90066500 0x7fcf900689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e50 tx=0x7fcfb00a7070 comp rx=0 tx=0).stop 2024-01-30T08:09:11.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb815ce00 msgr2=0x7fcfb80c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb815ce00 0x7fcfb80c53b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfb815d250 tx=0x7fcfa800b870 comp rx=0 tx=0).stop 2024-01-30T08:09:11.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.6 2024-01-30T08:09:11.495 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 shutdown_connections 2024-01-30T08:09:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfb815c440 0x7fcfb80c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcf90066500 0x7fcf900689c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb815ce00 0x7fcfb80c53b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 --2- 172.21.15.50:0/2963129464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb8152db0 0x7fcfb80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 >> 172.21.15.50:0/2963129464 conn(0x7fcfb806cb40 msgr2=0x7fcfb806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 shutdown_connections 2024-01-30T08:09:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.491+0000 7fcfbf400640 1 -- 172.21.15.50:0/2963129464 wait complete. 2024-01-30T08:09:11.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.3 2024-01-30T08:09:11.499 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-01-30T08:09:11.509 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.4 2024-01-30T08:09:11.517 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.519+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb47c0c0db0 con 0x7fb47c0c2020 2024-01-30T08:09:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.519+0000 7fb478c00640 1 -- 172.21.15.50:0/2136482606 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb46c054730 con 0x7fb47c0c2020 2024-01-30T08:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2024-01-30T08:09:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb454066500 msgr2=0x7fb4540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb454066500 0x7fb4540689c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ad000 tx=0x7fb474008040 comp rx=0 tx=0).stop 2024-01-30T08:09:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb47c0c2020 msgr2=0x7fb47c144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb47c0c2020 0x7fb47c144a90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00ba50 tx=0x7fb46c00bf10 comp rx=0 tx=0).stop 2024-01-30T08:09:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 shutdown_connections 2024-01-30T08:09:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47c0c2e90 0x7fb47c14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb454066500 0x7fb4540689c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47c14dd00 0x7fb47c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 --2- 172.21.15.50:0/2136482606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb47c0c2020 0x7fb47c144a90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 >> 172.21.15.50:0/2136482606 conn(0x7fb47c06c890 msgr2=0x7fb47c14ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 shutdown_connections 2024-01-30T08:09:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.523+0000 7fb483800640 1 -- 172.21.15.50:0/2136482606 wait complete. 2024-01-30T08:09:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.527+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb63c0c0db0 con 0x7fb63c0c26c0 2024-01-30T08:09:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb632a00640 1 -- 172.21.15.50:0/1020401165 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6340553a0 con 0x7fb63c0c26c0 2024-01-30T08:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout:60129542153 2024-01-30T08:09:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb614066600 msgr2=0x7fb614068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb614066600 0x7fb614068ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0af000 tx=0x7fb62c0aa000 comp rx=0 tx=0).stop 2024-01-30T08:09:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb63c0c26c0 msgr2=0x7fb63c1e9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb63c0c26c0 0x7fb63c1e9100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb634011400 tx=0x7fb6340118c0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 shutdown_connections 2024-01-30T08:09:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb614066600 0x7fb614068ac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb63c1e9640 0x7fb63c0bf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb63c1e6800 0x7fb63c0bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 --2- 172.21.15.50:0/1020401165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb63c0c26c0 0x7fb63c1e9100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 >> 172.21.15.50:0/1020401165 conn(0x7fb63c06c890 msgr2=0x7fb63c14cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 shutdown_connections 2024-01-30T08:09:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.531+0000 7fb641800640 1 -- 172.21.15.50:0/1020401165 wait complete. 2024-01-30T08:09:11.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-01-30T08:09:11.547 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.547+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f02c0074a20 con 0x7f02c00c2990 2024-01-30T08:09:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.547+0000 7f02b7400640 1 -- 172.21.15.50:0/264917560 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02b8051110 con 0x7f02c00c2990 2024-01-30T08:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:60129542153 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0298066550 msgr2=0x7f0298068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0298066550 0x7f0298068a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02c014dde0 tx=0x7f02a8008040 comp rx=0 tx=0).stop 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c00c2990 msgr2=0x7f02c00c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c00c2990 0x7f02c00c4790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02b800be20 tx=0x7f02b8009f70 comp rx=0 tx=0).stop 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 shutdown_connections 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c014eb30 0x7f02c0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0298066550 0x7f0298068a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c0151ef0 0x7f02c00709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 --2- 172.21.15.50:0/264917560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c00c2990 0x7f02c00c4790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 >> 172.21.15.50:0/264917560 conn(0x7f02c006cb40 msgr2=0x7f02c006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 shutdown_connections 2024-01-30T08:09:11.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.551+0000 7f02c6000640 1 -- 172.21.15.50:0/264917560 wait complete. 2024-01-30T08:09:11.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.2 2024-01-30T08:09:11.564 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.7 2024-01-30T08:09:11.576 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:11.576 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-30T08:09:11.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.755+0000 7f8715000640 1 Processor -- start 2024-01-30T08:09:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f8715000640 1 -- start start 2024-01-30T08:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f8715000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 0x7f871006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f8715000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8710153390 0x7f87100a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f8715000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8710152f00 con 0x7f87100c4310 2024-01-30T08:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f8715000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87101525f0 con 0x7f8710153390 2024-01-30T08:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f8715000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100a7680 con 0x7f871006de40 2024-01-30T08:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870e800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f87100c4310 0x7f8710155be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37768/0 (socket says 172.21.15.50:37768) 2024-01-30T08:09:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870e800640 1 -- 172.21.15.50:0/4085554450 learned_addr learned my addr 172.21.15.50:0/4085554450 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870de00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 0x7f871006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870d400640 1 --2- 172.21.15.50:0/4085554450 >> v2:172.21.15.125:3300/0 conn(0x7f8710153390 0x7f87100a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181445907 0 0) 0x7f8710152f00 con 0x7f87100c4310 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f0003530 con 0x7f87100c4310 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972556571 0 0) 0x7f86f0003530 con 0x7f87100c4310 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 msgr2=0x7f871006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 0x7f871006e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 >> v2:172.21.15.125:3300/0 conn(0x7f8710153390 msgr2=0x7f87100a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 --2- 172.21.15.50:0/4085554450 >> v2:172.21.15.125:3300/0 conn(0x7f8710153390 0x7f87100a6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87101528b0 con 0x7f87100c4310 2024-01-30T08:09:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f8708001a00 con 0x7f87100c4310 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 >> v1:172.21.15.50:6789/0 conn(0x7f87100c4310 legacy=0x7f8710155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f0003980 0x7f86f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 0x7f86f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0004d10 0x7f86f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87101525f0 con 0x7f86f0004d10 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87100a7680 con 0x7f86f0003980 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f000ba10 con 0x7f871006de40 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870de00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f0003980 0x7f86f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870e800640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0004d10 0x7f86f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870d400640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 0x7f86f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870de00640 1 -- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 msgr2=0x7f86f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870de00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f871006de40 0x7f86f00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870de00640 1 -- 172.21.15.50:0/4085554450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0004d10 msgr2=0x7f86f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870de00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0004d10 0x7f86f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870de00640 1 -- 172.21.15.50:0/4085554450 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0003530 con 0x7f86f0003980 2024-01-30T08:09:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.759+0000 7f870e800640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0004d10 0x7f86f0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f870de00640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f0003980 0x7f86f0003da0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ae0 tx=0x7f870001ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b1da6eb4325421 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000a5610 con 0x7f86f0003980 2024-01-30T08:09:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87000a5770 con 0x7f86f0003980 2024-01-30T08:09:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f870ca00640 1 -- 172.21.15.50:0/4085554450 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000a5b20 con 0x7f86f0003980 2024-01-30T08:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f8715000640 1 -- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f0003980 msgr2=0x7f86f0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f8715000640 1 --2- 172.21.15.50:0/4085554450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86f0003980 0x7f86f0003da0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ae0 tx=0x7f870001ca20 comp rx=0 tx=0).stop 2024-01-30T08:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f870e800640 1 -- 172.21.15.50:0/4085554450 reap_dead start 2024-01-30T08:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f8715000640 1 -- 172.21.15.50:0/4085554450 shutdown_connections 2024-01-30T08:09:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f8715000640 1 -- 172.21.15.50:0/4085554450 >> 172.21.15.50:0/4085554450 conn(0x7f87100c4830 msgr2=0x7f87100c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f8715000640 1 -- 172.21.15.50:0/4085554450 shutdown_connections 2024-01-30T08:09:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.763+0000 7f8715000640 1 -- 172.21.15.50:0/4085554450 wait complete. 2024-01-30T08:09:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 Processor -- start 2024-01-30T08:09:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 -- start start 2024-01-30T08:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f0003980 0x7f87101f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f871006d5d0 0x7f87101f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87100a5e70 0x7f87100a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8710159a20 con 0x7f87100a5e70 2024-01-30T08:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87101f13a0 con 0x7f871006d5d0 2024-01-30T08:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871006c3e0 con 0x7f86f0003980 2024-01-30T08:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87100a5e70 0x7f87100a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87100a5e70 0x7f87100a6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49708/0 (socket says 172.21.15.50:49708) 2024-01-30T08:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 -- 172.21.15.50:0/2584543691 learned_addr learned my addr 172.21.15.50:0/2584543691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870d400640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f871006d5d0 0x7f87101f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870de00640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f0003980 0x7f87101f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 -- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f0003980 msgr2=0x7f87101f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f0003980 0x7f87101f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 -- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f871006d5d0 msgr2=0x7f87101f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f871006d5d0 0x7f87101f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 -- 172.21.15.50:0/2584543691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871006c6c0 con 0x7f87100a5e70 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870de00640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f0003980 0x7f87101f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870d400640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f871006d5d0 0x7f87101f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f870e800640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87100a5e70 0x7f87100a6320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f87100721e0 tx=0x7f8708007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8706000640 1 -- 172.21.15.50:0/2584543691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800ae90 con 0x7f87100a5e70 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8706000640 1 -- 172.21.15.50:0/2584543691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87080133f0 con 0x7f87100a5e70 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871006c9a0 con 0x7f87100a5e70 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8706000640 1 -- 172.21.15.50:0/2584543691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87080137c0 con 0x7f87100a5e70 2024-01-30T08:09:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.767+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871006cf60 con 0x7f87100a5e70 2024-01-30T08:09:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.771+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871006d150 con 0x7f87100a5e70 2024-01-30T08:09:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.771+0000 7f8706000640 1 -- 172.21.15.50:0/2584543691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8708013920 con 0x7f87100a5e70 2024-01-30T08:09:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.771+0000 7f8706000640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f86e8066500 0x7f86e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.771+0000 7f8706000640 1 -- 172.21.15.50:0/2584543691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8708084750 con 0x7f87100a5e70 2024-01-30T08:09:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.771+0000 7f870de00640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f86e8066500 0x7f86e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.771+0000 7f870de00640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f86e8066500 0x7f86e80689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87000af000 tx=0x7f87000046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.775+0000 7f8706000640 1 -- 172.21.15.50:0/2584543691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8708051790 con 0x7f87100a5e70 2024-01-30T08:09:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.935+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8710074a20 con 0x7f86e8066500 2024-01-30T08:09:11.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8706000640 1 -- 172.21.15.50:0/2584543691 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345349 (secure 0 0 0) 0x7f8710074a20 con 0x7f86e8066500 2024-01-30T08:09:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f86e8066500 msgr2=0x7f86e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f86e8066500 0x7f86e80689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87000af000 tx=0x7f87000046d0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87100a5e70 msgr2=0x7f87100a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87100a5e70 0x7f87100a6320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f87100721e0 tx=0x7f8708007430 comp rx=0 tx=0).stop 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 shutdown_connections 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f871006d5d0 0x7f87101f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f86e8066500 0x7f86e80689c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87100a5e70 0x7f87100a6320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 --2- 172.21.15.50:0/2584543691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86f0003980 0x7f87101f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 >> 172.21.15.50:0/2584543691 conn(0x7f87100c4830 msgr2=0x7f871014c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 shutdown_connections 2024-01-30T08:09:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:11.947+0000 7f8715000640 1 -- 172.21.15.50:0/2584543691 wait complete. 2024-01-30T08:09:11.970 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-01-30T08:09:11.056356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218404,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756316,"statfs":{"total":773094113280,"available":772870467584,"internally_reserved":0,"allocated":2293760,"data_stored":2016230,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003442"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062910+0000","last_change":"2024-01-30T08:08:41.284386+0000","last_active":"2024-01-30T08:08:49.062910+0000","last_peered":"2024-01-30T08:08:49.062910+0000","last_clean":"2024-01-30T08:08:49.062910+0000","last_became_active":"2024-01-30T08:08:41.284070+0000","last_became_peered":"2024-01-30T08:08:41.284070+0000","last_unstale":"2024-01-30T08:08:49.062910+0000","last_undegraded":"2024-01-30T08:08:49.062910+0000","last_fullsized":"2024-01-30T08:08:49.062910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:49:56.992264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305887+0000","last_change":"2024-01-30T08:08:42.279355+0000","last_active":"2024-01-30T08:08:47.305887+0000","last_peered":"2024-01-30T08:08:47.305887+0000","last_clean":"2024-01-30T08:08:47.305887+0000","last_became_active":"2024-01-30T08:08:42.276213+0000","last_became_peered":"2024-01-30T08:08:42.276213+0000","last_unstale":"2024-01-30T08:08:47.305887+0000","last_undegraded":"2024-01-30T08:08:47.305887+0000","last_fullsized":"2024-01-30T08:08:47.305887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.562412+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.561547+0000","last_became_peered":"2024-01-30T08:08:46.561547+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:25.519672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306121+0000","last_change":"2024-01-30T08:08:41.277142+0000","last_active":"2024-01-30T08:08:47.306121+0000","last_peered":"2024-01-30T08:08:47.306121+0000","last_clean":"2024-01-30T08:08:47.306121+0000","last_became_active":"2024-01-30T08:08:41.276876+0000","last_became_peered":"2024-01-30T08:08:41.276876+0000","last_unstale":"2024-01-30T08:08:47.306121+0000","last_undegraded":"2024-01-30T08:08:47.306121+0000","last_fullsized":"2024-01-30T08:08:47.306121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062659+0000","last_change":"2024-01-30T08:08:42.289777+0000","last_active":"2024-01-30T08:08:49.062659+0000","last_peered":"2024-01-30T08:08:49.062659+0000","last_clean":"2024-01-30T08:08:49.062659+0000","last_became_active":"2024-01-30T08:08:42.288789+0000","last_became_peered":"2024-01-30T08:08:42.288789+0000","last_unstale":"2024-01-30T08:08:49.062659+0000","last_undegraded":"2024-01-30T08:08:49.062659+0000","last_fullsized":"2024-01-30T08:08:49.062659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:47:56.164414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305170+0000","last_change":"2024-01-30T08:08:46.315655+0000","last_active":"2024-01-30T08:08:47.305170+0000","last_peered":"2024-01-30T08:08:47.305170+0000","last_clean":"2024-01-30T08:08:47.305170+0000","last_became_active":"2024-01-30T08:08:46.314644+0000","last_became_peered":"2024-01-30T08:08:46.314644+0000","last_unstale":"2024-01-30T08:08:47.305170+0000","last_undegraded":"2024-01-30T08:08:47.305170+0000","last_fullsized":"2024-01-30T08:08:47.305170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:15.180621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061282+0000","last_change":"2024-01-30T08:08:41.289340+0000","last_active":"2024-01-30T08:08:49.061282+0000","last_peered":"2024-01-30T08:08:49.061282+0000","last_clean":"2024-01-30T08:08:49.061282+0000","last_became_active":"2024-01-30T08:08:41.288491+0000","last_became_peered":"2024-01-30T08:08:41.288491+0000","last_unstale":"2024-01-30T08:08:49.061282+0000","last_undegraded":"2024-01-30T08:08:49.061282+0000","last_fullsized":"2024-01-30T08:08:49.061282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062248+0000","last_change":"2024-01-30T08:08:42.297915+0000","last_active":"2024-01-30T08:08:49.062248+0000","last_peered":"2024-01-30T08:08:49.062248+0000","last_clean":"2024-01-30T08:08:49.062248+0000","last_became_active":"2024-01-30T08:08:42.297662+0000","last_became_peered":"2024-01-30T08:08:42.297662+0000","last_unstale":"2024-01-30T08:08:49.062248+0000","last_undegraded":"2024-01-30T08:08:49.062248+0000","last_fullsized":"2024-01-30T08:08:49.062248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:59:23.741905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306032+0000","last_change":"2024-01-30T08:08:46.308032+0000","last_active":"2024-01-30T08:08:47.306032+0000","last_peered":"2024-01-30T08:08:47.306032+0000","last_clean":"2024-01-30T08:08:47.306032+0000","last_became_active":"2024-01-30T08:08:46.307399+0000","last_became_peered":"2024-01-30T08:08:46.307399+0000","last_unstale":"2024-01-30T08:08:47.306032+0000","last_undegraded":"2024-01-30T08:08:47.306032+0000","last_fullsized":"2024-01-30T08:08:47.306032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:00.921167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060898+0000","last_change":"2024-01-30T08:08:41.291632+0000","last_active":"2024-01-30T08:08:49.060898+0000","last_peered":"2024-01-30T08:08:49.060898+0000","last_clean":"2024-01-30T08:08:49.060898+0000","last_became_active":"2024-01-30T08:08:41.291202+0000","last_became_peered":"2024-01-30T08:08:41.291202+0000","last_unstale":"2024-01-30T08:08:49.060898+0000","last_undegraded":"2024-01-30T08:08:49.060898+0000","last_fullsized":"2024-01-30T08:08:49.060898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062453+0000","last_change":"2024-01-30T08:08:42.295783+0000","last_active":"2024-01-30T08:08:49.062453+0000","last_peered":"2024-01-30T08:08:49.062453+0000","last_clean":"2024-01-30T08:08:49.062453+0000","last_became_active":"2024-01-30T08:08:42.295323+0000","last_became_peered":"2024-01-30T08:08:42.295323+0000","last_unstale":"2024-01-30T08:08:49.062453+0000","last_undegraded":"2024-01-30T08:08:49.062453+0000","last_fullsized":"2024-01-30T08:08:49.062453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:19:42.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306102+0000","last_change":"2024-01-30T08:08:46.315845+0000","last_active":"2024-01-30T08:08:47.306102+0000","last_peered":"2024-01-30T08:08:47.306102+0000","last_clean":"2024-01-30T08:08:47.306102+0000","last_became_active":"2024-01-30T08:08:46.315351+0000","last_became_peered":"2024-01-30T08:08:46.315351+0000","last_unstale":"2024-01-30T08:08:47.306102+0000","last_undegraded":"2024-01-30T08:08:47.306102+0000","last_fullsized":"2024-01-30T08:08:47.306102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:05.115925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306123+0000","last_change":"2024-01-30T08:08:42.276052+0000","last_active":"2024-01-30T08:08:47.306123+0000","last_peered":"2024-01-30T08:08:47.306123+0000","last_clean":"2024-01-30T08:08:47.306123+0000","last_became_active":"2024-01-30T08:08:42.275642+0000","last_became_peered":"2024-01-30T08:08:42.275642+0000","last_unstale":"2024-01-30T08:08:47.306123+0000","last_undegraded":"2024-01-30T08:08:47.306123+0000","last_fullsized":"2024-01-30T08:08:47.306123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:38.647109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061678+0000","last_change":"2024-01-30T08:08:41.284716+0000","last_active":"2024-01-30T08:08:49.061678+0000","last_peered":"2024-01-30T08:08:49.061678+0000","last_clean":"2024-01-30T08:08:49.061678+0000","last_became_active":"2024-01-30T08:08:41.284434+0000","last_became_peered":"2024-01-30T08:08:41.284434+0000","last_unstale":"2024-01-30T08:08:49.061678+0000","last_undegraded":"2024-01-30T08:08:49.061678+0000","last_fullsized":"2024-01-30T08:08:49.061678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:49.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306435+0000","last_change":"2024-01-30T08:08:46.304711+0000","last_active":"2024-01-30T08:08:47.306435+0000","last_peered":"2024-01-30T08:08:47.306435+0000","last_clean":"2024-01-30T08:08:47.306435+0000","last_became_active":"2024-01-30T08:08:46.304246+0000","last_became_peered":"2024-01-30T08:08:46.304246+0000","last_unstale":"2024-01-30T08:08:47.306435+0000","last_undegraded":"2024-01-30T08:08:47.306435+0000","last_fullsized":"2024-01-30T08:08:47.306435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305525+0000","last_change":"2024-01-30T08:08:42.284398+0000","last_active":"2024-01-30T08:08:47.305525+0000","last_peered":"2024-01-30T08:08:47.305525+0000","last_clean":"2024-01-30T08:08:47.305525+0000","last_became_active":"2024-01-30T08:08:42.284058+0000","last_became_peered":"2024-01-30T08:08:42.284058+0000","last_unstale":"2024-01-30T08:08:47.305525+0000","last_undegraded":"2024-01-30T08:08:47.305525+0000","last_fullsized":"2024-01-30T08:08:47.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063365+0000","last_change":"2024-01-30T08:08:41.283040+0000","last_active":"2024-01-30T08:08:49.063365+0000","last_peered":"2024-01-30T08:08:49.063365+0000","last_clean":"2024-01-30T08:08:49.063365+0000","last_became_active":"2024-01-30T08:08:41.275704+0000","last_became_peered":"2024-01-30T08:08:41.275704+0000","last_unstale":"2024-01-30T08:08:49.063365+0000","last_undegraded":"2024-01-30T08:08:49.063365+0000","last_fullsized":"2024-01-30T08:08:49.063365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:46.318981+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:46.318487+0000","last_became_peered":"2024-01-30T08:08:46.318487+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305403+0000","last_change":"2024-01-30T08:08:42.276779+0000","last_active":"2024-01-30T08:08:47.305403+0000","last_peered":"2024-01-30T08:08:47.305403+0000","last_clean":"2024-01-30T08:08:47.305403+0000","last_became_active":"2024-01-30T08:08:42.276293+0000","last_became_peered":"2024-01-30T08:08:42.276293+0000","last_unstale":"2024-01-30T08:08:47.305403+0000","last_undegraded":"2024-01-30T08:08:47.305403+0000","last_fullsized":"2024-01-30T08:08:47.305403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062313+0000","last_change":"2024-01-30T08:08:41.280606+0000","last_active":"2024-01-30T08:08:49.062313+0000","last_peered":"2024-01-30T08:08:49.062313+0000","last_clean":"2024-01-30T08:08:49.062313+0000","last_became_active":"2024-01-30T08:08:41.280257+0000","last_became_peered":"2024-01-30T08:08:41.280257+0000","last_unstale":"2024-01-30T08:08:49.062313+0000","last_undegraded":"2024-01-30T08:08:49.062313+0000","last_fullsized":"2024-01-30T08:08:49.062313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063823+0000","last_change":"2024-01-30T08:08:46.564137+0000","last_active":"2024-01-30T08:08:49.063823+0000","last_peered":"2024-01-30T08:08:49.063823+0000","last_clean":"2024-01-30T08:08:49.063823+0000","last_became_active":"2024-01-30T08:08:46.563422+0000","last_became_peered":"2024-01-30T08:08:46.563422+0000","last_unstale":"2024-01-30T08:08:49.063823+0000","last_undegraded":"2024-01-30T08:08:49.063823+0000","last_fullsized":"2024-01-30T08:08:49.063823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:53.755351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305710+0000","last_change":"2024-01-30T08:08:42.271792+0000","last_active":"2024-01-30T08:08:47.305710+0000","last_peered":"2024-01-30T08:08:47.305710+0000","last_clean":"2024-01-30T08:08:47.305710+0000","last_became_active":"2024-01-30T08:08:42.271488+0000","last_became_peered":"2024-01-30T08:08:42.271488+0000","last_unstale":"2024-01-30T08:08:47.305710+0000","last_undegraded":"2024-01-30T08:08:47.305710+0000","last_fullsized":"2024-01-30T08:08:47.305710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:43.028344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060650+0000","last_change":"2024-01-30T08:08:41.289206+0000","last_active":"2024-01-30T08:08:49.060650+0000","last_peered":"2024-01-30T08:08:49.060650+0000","last_clean":"2024-01-30T08:08:49.060650+0000","last_became_active":"2024-01-30T08:08:41.288158+0000","last_became_peered":"2024-01-30T08:08:41.288158+0000","last_unstale":"2024-01-30T08:08:49.060650+0000","last_undegraded":"2024-01-30T08:08:49.060650+0000","last_fullsized":"2024-01-30T08:08:49.060650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306652+0000","last_change":"2024-01-30T08:08:46.315546+0000","last_active":"2024-01-30T08:08:47.306652+0000","last_peered":"2024-01-30T08:08:47.306652+0000","last_clean":"2024-01-30T08:08:47.306652+0000","last_became_active":"2024-01-30T08:08:46.314665+0000","last_became_peered":"2024-01-30T08:08:46.314665+0000","last_unstale":"2024-01-30T08:08:47.306652+0000","last_undegraded":"2024-01-30T08:08:47.306652+0000","last_fullsized":"2024-01-30T08:08:47.306652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062963+0000","last_change":"2024-01-30T08:08:42.278495+0000","last_active":"2024-01-30T08:08:49.062963+0000","last_peered":"2024-01-30T08:08:49.062963+0000","last_clean":"2024-01-30T08:08:49.062963+0000","last_became_active":"2024-01-30T08:08:42.278239+0000","last_became_peered":"2024-01-30T08:08:42.278239+0000","last_unstale":"2024-01-30T08:08:49.062963+0000","last_undegraded":"2024-01-30T08:08:49.062963+0000","last_fullsized":"2024-01-30T08:08:49.062963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:15:30.493486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307419+0000","last_change":"2024-01-30T08:08:41.288843+0000","last_active":"2024-01-30T08:08:47.307419+0000","last_peered":"2024-01-30T08:08:47.307419+0000","last_clean":"2024-01-30T08:08:47.307419+0000","last_became_active":"2024-01-30T08:08:41.287058+0000","last_became_peered":"2024-01-30T08:08:41.287058+0000","last_unstale":"2024-01-30T08:08:47.307419+0000","last_undegraded":"2024-01-30T08:08:47.307419+0000","last_fullsized":"2024-01-30T08:08:47.307419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305476+0000","last_change":"2024-01-30T08:08:46.561858+0000","last_active":"2024-01-30T08:08:47.305476+0000","last_peered":"2024-01-30T08:08:47.305476+0000","last_clean":"2024-01-30T08:08:47.305476+0000","last_became_active":"2024-01-30T08:08:46.561473+0000","last_became_peered":"2024-01-30T08:08:46.561473+0000","last_unstale":"2024-01-30T08:08:47.305476+0000","last_undegraded":"2024-01-30T08:08:47.305476+0000","last_fullsized":"2024-01-30T08:08:47.305476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:55.086903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:42.292374+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:42.292083+0000","last_became_peered":"2024-01-30T08:08:42.292083+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063796+0000","last_change":"2024-01-30T08:08:41.277386+0000","last_active":"2024-01-30T08:08:49.063796+0000","last_peered":"2024-01-30T08:08:49.063796+0000","last_clean":"2024-01-30T08:08:49.063796+0000","last_became_active":"2024-01-30T08:08:41.276132+0000","last_became_peered":"2024-01-30T08:08:41.276132+0000","last_unstale":"2024-01-30T08:08:49.063796+0000","last_undegraded":"2024-01-30T08:08:49.063796+0000","last_fullsized":"2024-01-30T08:08:49.063796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.566162+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.565660+0000","last_became_peered":"2024-01-30T08:08:46.565660+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063508+0000","last_change":"2024-01-30T08:08:42.271610+0000","last_active":"2024-01-30T08:08:49.063508+0000","last_peered":"2024-01-30T08:08:49.063508+0000","last_clean":"2024-01-30T08:08:49.063508+0000","last_became_active":"2024-01-30T08:08:42.271325+0000","last_became_peered":"2024-01-30T08:08:42.271325+0000","last_unstale":"2024-01-30T08:08:49.063508+0000","last_undegraded":"2024-01-30T08:08:49.063508+0000","last_fullsized":"2024-01-30T08:08:49.063508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061483+0000","last_change":"2024-01-30T08:08:41.289187+0000","last_active":"2024-01-30T08:08:49.061483+0000","last_peered":"2024-01-30T08:08:49.061483+0000","last_clean":"2024-01-30T08:08:49.061483+0000","last_became_active":"2024-01-30T08:08:41.288137+0000","last_became_peered":"2024-01-30T08:08:41.288137+0000","last_unstale":"2024-01-30T08:08:49.061483+0000","last_undegraded":"2024-01-30T08:08:49.061483+0000","last_fullsized":"2024-01-30T08:08:49.061483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062164+0000","last_change":"2024-01-30T08:08:46.562867+0000","last_active":"2024-01-30T08:08:49.062164+0000","last_peered":"2024-01-30T08:08:49.062164+0000","last_clean":"2024-01-30T08:08:49.062164+0000","last_became_active":"2024-01-30T08:08:46.562382+0000","last_became_peered":"2024-01-30T08:08:46.562382+0000","last_unstale":"2024-01-30T08:08:49.062164+0000","last_undegraded":"2024-01-30T08:08:49.062164+0000","last_fullsized":"2024-01-30T08:08:49.062164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:44.788175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062441+0000","last_change":"2024-01-30T08:08:42.287858+0000","last_active":"2024-01-30T08:08:49.062441+0000","last_peered":"2024-01-30T08:08:49.062441+0000","last_clean":"2024-01-30T08:08:49.062441+0000","last_became_active":"2024-01-30T08:08:42.287567+0000","last_became_peered":"2024-01-30T08:08:42.287567+0000","last_unstale":"2024-01-30T08:08:49.062441+0000","last_undegraded":"2024-01-30T08:08:49.062441+0000","last_fullsized":"2024-01-30T08:08:49.062441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:40.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063597+0000","last_change":"2024-01-30T08:08:41.278170+0000","last_active":"2024-01-30T08:08:49.063597+0000","last_peered":"2024-01-30T08:08:49.063597+0000","last_clean":"2024-01-30T08:08:49.063597+0000","last_became_active":"2024-01-30T08:08:41.277887+0000","last_became_peered":"2024-01-30T08:08:41.277887+0000","last_unstale":"2024-01-30T08:08:49.063597+0000","last_undegraded":"2024-01-30T08:08:49.063597+0000","last_fullsized":"2024-01-30T08:08:49.063597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063213+0000","last_change":"2024-01-30T08:08:46.307067+0000","last_active":"2024-01-30T08:08:49.063213+0000","last_peered":"2024-01-30T08:08:49.063213+0000","last_clean":"2024-01-30T08:08:49.063213+0000","last_became_active":"2024-01-30T08:08:46.306645+0000","last_became_peered":"2024-01-30T08:08:46.306645+0000","last_unstale":"2024-01-30T08:08:49.063213+0000","last_undegraded":"2024-01-30T08:08:49.063213+0000","last_fullsized":"2024-01-30T08:08:49.063213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306470+0000","last_change":"2024-01-30T08:08:42.283427+0000","last_active":"2024-01-30T08:08:47.306470+0000","last_peered":"2024-01-30T08:08:47.306470+0000","last_clean":"2024-01-30T08:08:47.306470+0000","last_became_active":"2024-01-30T08:08:42.281444+0000","last_became_peered":"2024-01-30T08:08:42.281444+0000","last_unstale":"2024-01-30T08:08:47.306470+0000","last_undegraded":"2024-01-30T08:08:47.306470+0000","last_fullsized":"2024-01-30T08:08:47.306470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:42.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062249+0000","last_change":"2024-01-30T08:08:41.275140+0000","last_active":"2024-01-30T08:08:49.062249+0000","last_peered":"2024-01-30T08:08:49.062249+0000","last_clean":"2024-01-30T08:08:49.062249+0000","last_became_active":"2024-01-30T08:08:41.274851+0000","last_became_peered":"2024-01-30T08:08:41.274851+0000","last_unstale":"2024-01-30T08:08:49.062249+0000","last_undegraded":"2024-01-30T08:08:49.062249+0000","last_fullsized":"2024-01-30T08:08:49.062249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:40:25.984103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063589+0000","last_change":"2024-01-30T08:08:46.320651+0000","last_active":"2024-01-30T08:08:49.063589+0000","last_peered":"2024-01-30T08:08:49.063589+0000","last_clean":"2024-01-30T08:08:49.063589+0000","last_became_active":"2024-01-30T08:08:46.320138+0000","last_became_peered":"2024-01-30T08:08:46.320138+0000","last_unstale":"2024-01-30T08:08:49.063589+0000","last_undegraded":"2024-01-30T08:08:49.063589+0000","last_fullsized":"2024-01-30T08:08:49.063589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:08.547055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062056+0000","last_change":"2024-01-30T08:08:42.271482+0000","last_active":"2024-01-30T08:08:49.062056+0000","last_peered":"2024-01-30T08:08:49.062056+0000","last_clean":"2024-01-30T08:08:49.062056+0000","last_became_active":"2024-01-30T08:08:42.271232+0000","last_became_peered":"2024-01-30T08:08:42.271232+0000","last_unstale":"2024-01-30T08:08:49.062056+0000","last_undegraded":"2024-01-30T08:08:49.062056+0000","last_fullsized":"2024-01-30T08:08:49.062056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789511+0000","last_change":"2024-01-30T08:08:41.277419+0000","last_active":"2024-01-30T08:08:47.789511+0000","last_peered":"2024-01-30T08:08:47.789511+0000","last_clean":"2024-01-30T08:08:47.789511+0000","last_became_active":"2024-01-30T08:08:41.277104+0000","last_became_peered":"2024-01-30T08:08:41.277104+0000","last_unstale":"2024-01-30T08:08:47.789511+0000","last_undegraded":"2024-01-30T08:08:47.789511+0000","last_fullsized":"2024-01-30T08:08:47.789511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063871+0000","last_change":"2024-01-30T08:08:46.321512+0000","last_active":"2024-01-30T08:08:49.063871+0000","last_peered":"2024-01-30T08:08:49.063871+0000","last_clean":"2024-01-30T08:08:49.063871+0000","last_became_active":"2024-01-30T08:08:46.320112+0000","last_became_peered":"2024-01-30T08:08:46.320112+0000","last_unstale":"2024-01-30T08:08:49.063871+0000","last_undegraded":"2024-01-30T08:08:49.063871+0000","last_fullsized":"2024-01-30T08:08:49.063871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061695+0000","last_change":"2024-01-30T08:08:42.296060+0000","last_active":"2024-01-30T08:08:49.061695+0000","last_peered":"2024-01-30T08:08:49.061695+0000","last_clean":"2024-01-30T08:08:49.061695+0000","last_became_active":"2024-01-30T08:08:42.295753+0000","last_became_peered":"2024-01-30T08:08:42.295753+0000","last_unstale":"2024-01-30T08:08:49.061695+0000","last_undegraded":"2024-01-30T08:08:49.061695+0000","last_fullsized":"2024-01-30T08:08:49.061695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:29:48.979595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060657+0000","last_change":"2024-01-30T08:08:41.286271+0000","last_active":"2024-01-30T08:08:49.060657+0000","last_peered":"2024-01-30T08:08:49.060657+0000","last_clean":"2024-01-30T08:08:49.060657+0000","last_became_active":"2024-01-30T08:08:41.285958+0000","last_became_peered":"2024-01-30T08:08:41.285958+0000","last_unstale":"2024-01-30T08:08:49.060657+0000","last_undegraded":"2024-01-30T08:08:49.060657+0000","last_fullsized":"2024-01-30T08:08:49.060657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062773+0000","last_change":"2024-01-30T08:08:46.562368+0000","last_active":"2024-01-30T08:08:49.062773+0000","last_peered":"2024-01-30T08:08:49.062773+0000","last_clean":"2024-01-30T08:08:49.062773+0000","last_became_active":"2024-01-30T08:08:46.561511+0000","last_became_peered":"2024-01-30T08:08:46.561511+0000","last_unstale":"2024-01-30T08:08:49.062773+0000","last_undegraded":"2024-01-30T08:08:49.062773+0000","last_fullsized":"2024-01-30T08:08:49.062773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:55.340433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305463+0000","last_change":"2024-01-30T08:08:42.284518+0000","last_active":"2024-01-30T08:08:47.305463+0000","last_peered":"2024-01-30T08:08:47.305463+0000","last_clean":"2024-01-30T08:08:47.305463+0000","last_became_active":"2024-01-30T08:08:42.284043+0000","last_became_peered":"2024-01-30T08:08:42.284043+0000","last_unstale":"2024-01-30T08:08:47.305463+0000","last_undegraded":"2024-01-30T08:08:47.305463+0000","last_fullsized":"2024-01-30T08:08:47.305463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061950+0000","last_change":"2024-01-30T08:08:41.280995+0000","last_active":"2024-01-30T08:08:49.061950+0000","last_peered":"2024-01-30T08:08:49.061950+0000","last_clean":"2024-01-30T08:08:49.061950+0000","last_became_active":"2024-01-30T08:08:41.280455+0000","last_became_peered":"2024-01-30T08:08:41.280455+0000","last_unstale":"2024-01-30T08:08:49.061950+0000","last_undegraded":"2024-01-30T08:08:49.061950+0000","last_fullsized":"2024-01-30T08:08:49.061950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:29.471243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061322+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:08:49.061322+0000","last_peered":"2024-01-30T08:08:49.061322+0000","last_clean":"2024-01-30T08:08:49.061322+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:08:49.061322+0000","last_undegraded":"2024-01-30T08:08:49.061322+0000","last_fullsized":"2024-01-30T08:08:49.061322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307091+0000","last_change":"2024-01-30T08:08:46.565243+0000","last_active":"2024-01-30T08:08:47.307091+0000","last_peered":"2024-01-30T08:08:47.307091+0000","last_clean":"2024-01-30T08:08:47.307091+0000","last_became_active":"2024-01-30T08:08:46.564876+0000","last_became_peered":"2024-01-30T08:08:46.564876+0000","last_unstale":"2024-01-30T08:08:47.307091+0000","last_undegraded":"2024-01-30T08:08:47.307091+0000","last_fullsized":"2024-01-30T08:08:47.307091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061006+0000","last_change":"2024-01-30T08:08:42.296681+0000","last_active":"2024-01-30T08:08:49.061006+0000","last_peered":"2024-01-30T08:08:49.061006+0000","last_clean":"2024-01-30T08:08:49.061006+0000","last_became_active":"2024-01-30T08:08:42.296349+0000","last_became_peered":"2024-01-30T08:08:42.296349+0000","last_unstale":"2024-01-30T08:08:49.061006+0000","last_undegraded":"2024-01-30T08:08:49.061006+0000","last_fullsized":"2024-01-30T08:08:49.061006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:35.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789843+0000","last_change":"2024-01-30T08:08:41.288774+0000","last_active":"2024-01-30T08:08:47.789843+0000","last_peered":"2024-01-30T08:08:47.789843+0000","last_clean":"2024-01-30T08:08:47.789843+0000","last_became_active":"2024-01-30T08:08:41.288519+0000","last_became_peered":"2024-01-30T08:08:41.288519+0000","last_unstale":"2024-01-30T08:08:47.789843+0000","last_undegraded":"2024-01-30T08:08:47.789843+0000","last_fullsized":"2024-01-30T08:08:47.789843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305155+0000","last_change":"2024-01-30T08:08:46.560657+0000","last_active":"2024-01-30T08:08:47.305155+0000","last_peered":"2024-01-30T08:08:47.305155+0000","last_clean":"2024-01-30T08:08:47.305155+0000","last_became_active":"2024-01-30T08:08:46.559970+0000","last_became_peered":"2024-01-30T08:08:46.559970+0000","last_unstale":"2024-01-30T08:08:47.305155+0000","last_undegraded":"2024-01-30T08:08:47.305155+0000","last_fullsized":"2024-01-30T08:08:47.305155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062304+0000","last_change":"2024-01-30T08:08:42.290969+0000","last_active":"2024-01-30T08:08:49.062304+0000","last_peered":"2024-01-30T08:08:49.062304+0000","last_clean":"2024-01-30T08:08:49.062304+0000","last_became_active":"2024-01-30T08:08:42.290605+0000","last_became_peered":"2024-01-30T08:08:42.290605+0000","last_unstale":"2024-01-30T08:08:49.062304+0000","last_undegraded":"2024-01-30T08:08:49.062304+0000","last_fullsized":"2024-01-30T08:08:49.062304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:47:41.957325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063753+0000","last_change":"2024-01-30T08:08:41.283051+0000","last_active":"2024-01-30T08:08:49.063753+0000","last_peered":"2024-01-30T08:08:49.063753+0000","last_clean":"2024-01-30T08:08:49.063753+0000","last_became_active":"2024-01-30T08:08:41.282773+0000","last_became_peered":"2024-01-30T08:08:41.282773+0000","last_unstale":"2024-01-30T08:08:49.063753+0000","last_undegraded":"2024-01-30T08:08:49.063753+0000","last_fullsized":"2024-01-30T08:08:49.063753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062287+0000","last_change":"2024-01-30T08:08:46.311779+0000","last_active":"2024-01-30T08:08:49.062287+0000","last_peered":"2024-01-30T08:08:49.062287+0000","last_clean":"2024-01-30T08:08:49.062287+0000","last_became_active":"2024-01-30T08:08:46.311314+0000","last_became_peered":"2024-01-30T08:08:46.311314+0000","last_unstale":"2024-01-30T08:08:49.062287+0000","last_undegraded":"2024-01-30T08:08:49.062287+0000","last_fullsized":"2024-01-30T08:08:49.062287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:02.056713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061327+0000","last_change":"2024-01-30T08:08:42.305456+0000","last_active":"2024-01-30T08:08:49.061327+0000","last_peered":"2024-01-30T08:08:49.061327+0000","last_clean":"2024-01-30T08:08:49.061327+0000","last_became_active":"2024-01-30T08:08:42.305210+0000","last_became_peered":"2024-01-30T08:08:42.305210+0000","last_unstale":"2024-01-30T08:08:49.061327+0000","last_undegraded":"2024-01-30T08:08:49.061327+0000","last_fullsized":"2024-01-30T08:08:49.061327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:49.726372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789981+0000","last_change":"2024-01-30T08:08:41.267098+0000","last_active":"2024-01-30T08:08:47.789981+0000","last_peered":"2024-01-30T08:08:47.789981+0000","last_clean":"2024-01-30T08:08:47.789981+0000","last_became_active":"2024-01-30T08:08:41.266760+0000","last_became_peered":"2024-01-30T08:08:41.266760+0000","last_unstale":"2024-01-30T08:08:47.789981+0000","last_undegraded":"2024-01-30T08:08:47.789981+0000","last_fullsized":"2024-01-30T08:08:47.789981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060608+0000","last_change":"2024-01-30T08:08:46.564824+0000","last_active":"2024-01-30T08:08:49.060608+0000","last_peered":"2024-01-30T08:08:49.060608+0000","last_clean":"2024-01-30T08:08:49.060608+0000","last_became_active":"2024-01-30T08:08:46.564330+0000","last_became_peered":"2024-01-30T08:08:46.564330+0000","last_unstale":"2024-01-30T08:08:49.060608+0000","last_undegraded":"2024-01-30T08:08:49.060608+0000","last_fullsized":"2024-01-30T08:08:49.060608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:30:28.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061676+0000","last_change":"2024-01-30T08:08:42.305183+0000","last_active":"2024-01-30T08:08:49.061676+0000","last_peered":"2024-01-30T08:08:49.061676+0000","last_clean":"2024-01-30T08:08:49.061676+0000","last_became_active":"2024-01-30T08:08:42.304786+0000","last_became_peered":"2024-01-30T08:08:42.304786+0000","last_unstale":"2024-01-30T08:08:49.061676+0000","last_undegraded":"2024-01-30T08:08:49.061676+0000","last_fullsized":"2024-01-30T08:08:49.061676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:14.376017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305702+0000","last_change":"2024-01-30T08:08:41.277848+0000","last_active":"2024-01-30T08:08:47.305702+0000","last_peered":"2024-01-30T08:08:47.305702+0000","last_clean":"2024-01-30T08:08:47.305702+0000","last_became_active":"2024-01-30T08:08:41.276589+0000","last_became_peered":"2024-01-30T08:08:41.276589+0000","last_unstale":"2024-01-30T08:08:47.305702+0000","last_undegraded":"2024-01-30T08:08:47.305702+0000","last_fullsized":"2024-01-30T08:08:47.305702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305158+0000","last_change":"2024-01-30T08:08:46.307894+0000","last_active":"2024-01-30T08:08:47.305158+0000","last_peered":"2024-01-30T08:08:47.305158+0000","last_clean":"2024-01-30T08:08:47.305158+0000","last_became_active":"2024-01-30T08:08:46.307456+0000","last_became_peered":"2024-01-30T08:08:46.307456+0000","last_unstale":"2024-01-30T08:08:47.305158+0000","last_undegraded":"2024-01-30T08:08:47.305158+0000","last_fullsized":"2024-01-30T08:08:47.305158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:29.212048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060944+0000","last_change":"2024-01-30T08:08:42.300225+0000","last_active":"2024-01-30T08:08:49.060944+0000","last_peered":"2024-01-30T08:08:49.060944+0000","last_clean":"2024-01-30T08:08:49.060944+0000","last_became_active":"2024-01-30T08:08:42.299982+0000","last_became_peered":"2024-01-30T08:08:42.299982+0000","last_unstale":"2024-01-30T08:08:49.060944+0000","last_undegraded":"2024-01-30T08:08:49.060944+0000","last_fullsized":"2024-01-30T08:08:49.060944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789401+0000","last_change":"2024-01-30T08:08:41.281155+0000","last_active":"2024-01-30T08:08:47.789401+0000","last_peered":"2024-01-30T08:08:47.789401+0000","last_clean":"2024-01-30T08:08:47.789401+0000","last_became_active":"2024-01-30T08:08:41.280684+0000","last_became_peered":"2024-01-30T08:08:41.280684+0000","last_unstale":"2024-01-30T08:08:47.789401+0000","last_undegraded":"2024-01-30T08:08:47.789401+0000","last_fullsized":"2024-01-30T08:08:47.789401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062626+0000","last_change":"2024-01-30T08:08:46.312867+0000","last_active":"2024-01-30T08:08:49.062626+0000","last_peered":"2024-01-30T08:08:49.062626+0000","last_clean":"2024-01-30T08:08:49.062626+0000","last_became_active":"2024-01-30T08:08:46.312450+0000","last_became_peered":"2024-01-30T08:08:46.312450+0000","last_unstale":"2024-01-30T08:08:49.062626+0000","last_undegraded":"2024-01-30T08:08:49.062626+0000","last_fullsized":"2024-01-30T08:08:49.062626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:01.538569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305554+0000","last_change":"2024-01-30T08:08:42.277590+0000","last_active":"2024-01-30T08:08:47.305554+0000","last_peered":"2024-01-30T08:08:47.305554+0000","last_clean":"2024-01-30T08:08:47.305554+0000","last_became_active":"2024-01-30T08:08:42.277197+0000","last_became_peered":"2024-01-30T08:08:42.277197+0000","last_unstale":"2024-01-30T08:08:47.305554+0000","last_undegraded":"2024-01-30T08:08:47.305554+0000","last_fullsized":"2024-01-30T08:08:47.305554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305769+0000","last_change":"2024-01-30T08:08:41.282399+0000","last_active":"2024-01-30T08:08:47.305769+0000","last_peered":"2024-01-30T08:08:47.305769+0000","last_clean":"2024-01-30T08:08:47.305769+0000","last_became_active":"2024-01-30T08:08:41.282056+0000","last_became_peered":"2024-01-30T08:08:41.282056+0000","last_unstale":"2024-01-30T08:08:47.305769+0000","last_undegraded":"2024-01-30T08:08:47.305769+0000","last_fullsized":"2024-01-30T08:08:47.305769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306153+0000","last_change":"2024-01-30T08:08:46.564745+0000","last_active":"2024-01-30T08:08:47.306153+0000","last_peered":"2024-01-30T08:08:47.306153+0000","last_clean":"2024-01-30T08:08:47.306153+0000","last_became_active":"2024-01-30T08:08:46.562228+0000","last_became_peered":"2024-01-30T08:08:46.562228+0000","last_unstale":"2024-01-30T08:08:47.306153+0000","last_undegraded":"2024-01-30T08:08:47.306153+0000","last_fullsized":"2024-01-30T08:08:47.306153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:13.466128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061539+0000","last_change":"2024-01-30T08:08:42.305622+0000","last_active":"2024-01-30T08:08:49.061539+0000","last_peered":"2024-01-30T08:08:49.061539+0000","last_clean":"2024-01-30T08:08:49.061539+0000","last_became_active":"2024-01-30T08:08:42.305341+0000","last_became_peered":"2024-01-30T08:08:42.305341+0000","last_unstale":"2024-01-30T08:08:49.061539+0000","last_undegraded":"2024-01-30T08:08:49.061539+0000","last_fullsized":"2024-01-30T08:08:49.061539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062120+0000","last_change":"2024-01-30T08:08:41.283528+0000","last_active":"2024-01-30T08:08:49.062120+0000","last_peered":"2024-01-30T08:08:49.062120+0000","last_clean":"2024-01-30T08:08:49.062120+0000","last_became_active":"2024-01-30T08:08:41.283251+0000","last_became_peered":"2024-01-30T08:08:41.283251+0000","last_unstale":"2024-01-30T08:08:49.062120+0000","last_undegraded":"2024-01-30T08:08:49.062120+0000","last_fullsized":"2024-01-30T08:08:49.062120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:48:28.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306255+0000","last_change":"2024-01-30T08:08:46.562419+0000","last_active":"2024-01-30T08:08:47.306255+0000","last_peered":"2024-01-30T08:08:47.306255+0000","last_clean":"2024-01-30T08:08:47.306255+0000","last_became_active":"2024-01-30T08:08:46.562016+0000","last_became_peered":"2024-01-30T08:08:46.562016+0000","last_unstale":"2024-01-30T08:08:47.306255+0000","last_undegraded":"2024-01-30T08:08:47.306255+0000","last_fullsized":"2024-01-30T08:08:47.306255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:52.532600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061999+0000","last_change":"2024-01-30T08:08:42.286331+0000","last_active":"2024-01-30T08:08:49.061999+0000","last_peered":"2024-01-30T08:08:49.061999+0000","last_clean":"2024-01-30T08:08:49.061999+0000","last_became_active":"2024-01-30T08:08:42.286070+0000","last_became_peered":"2024-01-30T08:08:42.286070+0000","last_unstale":"2024-01-30T08:08:49.061999+0000","last_undegraded":"2024-01-30T08:08:49.061999+0000","last_fullsized":"2024-01-30T08:08:49.061999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:49:29.159312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062387+0000","last_change":"2024-01-30T08:08:41.279978+0000","last_active":"2024-01-30T08:08:49.062387+0000","last_peered":"2024-01-30T08:08:49.062387+0000","last_clean":"2024-01-30T08:08:49.062387+0000","last_became_active":"2024-01-30T08:08:41.279673+0000","last_became_peered":"2024-01-30T08:08:41.279673+0000","last_unstale":"2024-01-30T08:08:49.062387+0000","last_undegraded":"2024-01-30T08:08:49.062387+0000","last_fullsized":"2024-01-30T08:08:49.062387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:24.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062307+0000","last_change":"2024-01-30T08:08:46.561776+0000","last_active":"2024-01-30T08:08:49.062307+0000","last_peered":"2024-01-30T08:08:49.062307+0000","last_clean":"2024-01-30T08:08:49.062307+0000","last_became_active":"2024-01-30T08:08:46.561227+0000","last_became_peered":"2024-01-30T08:08:46.561227+0000","last_unstale":"2024-01-30T08:08:49.062307+0000","last_undegraded":"2024-01-30T08:08:49.062307+0000","last_fullsized":"2024-01-30T08:08:49.062307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:07.684344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060787+0000","last_change":"2024-01-30T08:08:42.289925+0000","last_active":"2024-01-30T08:08:49.060787+0000","last_peered":"2024-01-30T08:08:49.060787+0000","last_clean":"2024-01-30T08:08:49.060787+0000","last_became_active":"2024-01-30T08:08:42.289634+0000","last_became_peered":"2024-01-30T08:08:42.289634+0000","last_unstale":"2024-01-30T08:08:49.060787+0000","last_undegraded":"2024-01-30T08:08:49.060787+0000","last_fullsized":"2024-01-30T08:08:49.060787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:57.307398+0000","last_change":"2024-01-30T08:08:41.274369+0000","last_active":"2024-01-30T08:08:57.307398+0000","last_peered":"2024-01-30T08:08:57.307398+0000","last_clean":"2024-01-30T08:08:57.307398+0000","last_became_active":"2024-01-30T08:08:41.274054+0000","last_became_peered":"2024-01-30T08:08:41.274054+0000","last_unstale":"2024-01-30T08:08:57.307398+0000","last_undegraded":"2024-01-30T08:08:57.307398+0000","last_fullsized":"2024-01-30T08:08:57.307398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063316+0000","last_change":"2024-01-30T08:08:46.309278+0000","last_active":"2024-01-30T08:08:49.063316+0000","last_peered":"2024-01-30T08:08:49.063316+0000","last_clean":"2024-01-30T08:08:49.063316+0000","last_became_active":"2024-01-30T08:08:46.308827+0000","last_became_peered":"2024-01-30T08:08:46.308827+0000","last_unstale":"2024-01-30T08:08:49.063316+0000","last_undegraded":"2024-01-30T08:08:49.063316+0000","last_fullsized":"2024-01-30T08:08:49.063316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:18.404996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306375+0000","last_change":"2024-01-30T08:08:42.295489+0000","last_active":"2024-01-30T08:08:47.306375+0000","last_peered":"2024-01-30T08:08:47.306375+0000","last_clean":"2024-01-30T08:08:47.306375+0000","last_became_active":"2024-01-30T08:08:42.295174+0000","last_became_peered":"2024-01-30T08:08:42.295174+0000","last_unstale":"2024-01-30T08:08:47.306375+0000","last_undegraded":"2024-01-30T08:08:47.306375+0000","last_fullsized":"2024-01-30T08:08:47.306375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:45.352887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063672+0000","last_change":"2024-01-30T08:08:41.285933+0000","last_active":"2024-01-30T08:08:49.063672+0000","last_peered":"2024-01-30T08:08:49.063672+0000","last_clean":"2024-01-30T08:08:49.063672+0000","last_became_active":"2024-01-30T08:08:41.285666+0000","last_became_peered":"2024-01-30T08:08:41.285666+0000","last_unstale":"2024-01-30T08:08:49.063672+0000","last_undegraded":"2024-01-30T08:08:49.063672+0000","last_fullsized":"2024-01-30T08:08:49.063672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306259+0000","last_change":"2024-01-30T08:08:46.309394+0000","last_active":"2024-01-30T08:08:47.306259+0000","last_peered":"2024-01-30T08:08:47.306259+0000","last_clean":"2024-01-30T08:08:47.306259+0000","last_became_active":"2024-01-30T08:08:46.308580+0000","last_became_peered":"2024-01-30T08:08:46.308580+0000","last_unstale":"2024-01-30T08:08:47.306259+0000","last_undegraded":"2024-01-30T08:08:47.306259+0000","last_fullsized":"2024-01-30T08:08:47.306259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062825+0000","last_change":"2024-01-30T08:08:42.278568+0000","last_active":"2024-01-30T08:08:49.062825+0000","last_peered":"2024-01-30T08:08:49.062825+0000","last_clean":"2024-01-30T08:08:49.062825+0000","last_became_active":"2024-01-30T08:08:42.278276+0000","last_became_peered":"2024-01-30T08:08:42.278276+0000","last_unstale":"2024-01-30T08:08:49.062825+0000","last_undegraded":"2024-01-30T08:08:49.062825+0000","last_fullsized":"2024-01-30T08:08:49.062825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:58:32.360625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062543+0000","last_change":"2024-01-30T08:08:41.282653+0000","last_active":"2024-01-30T08:08:49.062543+0000","last_peered":"2024-01-30T08:08:49.062543+0000","last_clean":"2024-01-30T08:08:49.062543+0000","last_became_active":"2024-01-30T08:08:41.282366+0000","last_became_peered":"2024-01-30T08:08:41.282366+0000","last_unstale":"2024-01-30T08:08:49.062543+0000","last_undegraded":"2024-01-30T08:08:49.062543+0000","last_fullsized":"2024-01-30T08:08:49.062543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:46:13.875970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305335+0000","last_change":"2024-01-30T08:08:46.315140+0000","last_active":"2024-01-30T08:08:47.305335+0000","last_peered":"2024-01-30T08:08:47.305335+0000","last_clean":"2024-01-30T08:08:47.305335+0000","last_became_active":"2024-01-30T08:08:46.314739+0000","last_became_peered":"2024-01-30T08:08:46.314739+0000","last_unstale":"2024-01-30T08:08:47.305335+0000","last_undegraded":"2024-01-30T08:08:47.305335+0000","last_fullsized":"2024-01-30T08:08:47.305335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:44:48.427798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062325+0000","last_change":"2024-01-30T08:08:42.291387+0000","last_active":"2024-01-30T08:08:49.062325+0000","last_peered":"2024-01-30T08:08:49.062325+0000","last_clean":"2024-01-30T08:08:49.062325+0000","last_became_active":"2024-01-30T08:08:42.290925+0000","last_became_peered":"2024-01-30T08:08:42.290925+0000","last_unstale":"2024-01-30T08:08:49.062325+0000","last_undegraded":"2024-01-30T08:08:49.062325+0000","last_fullsized":"2024-01-30T08:08:49.062325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:18:35.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307293+0000","last_change":"2024-01-30T08:08:41.287404+0000","last_active":"2024-01-30T08:08:47.307293+0000","last_peered":"2024-01-30T08:08:47.307293+0000","last_clean":"2024-01-30T08:08:47.307293+0000","last_became_active":"2024-01-30T08:08:41.287106+0000","last_became_peered":"2024-01-30T08:08:41.287106+0000","last_unstale":"2024-01-30T08:08:47.307293+0000","last_undegraded":"2024-01-30T08:08:47.307293+0000","last_fullsized":"2024-01-30T08:08:47.307293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305221+0000","last_change":"2024-01-30T08:08:46.565452+0000","last_active":"2024-01-30T08:08:47.305221+0000","last_peered":"2024-01-30T08:08:47.305221+0000","last_clean":"2024-01-30T08:08:47.305221+0000","last_became_active":"2024-01-30T08:08:46.564941+0000","last_became_peered":"2024-01-30T08:08:46.564941+0000","last_unstale":"2024-01-30T08:08:47.305221+0000","last_undegraded":"2024-01-30T08:08:47.305221+0000","last_fullsized":"2024-01-30T08:08:47.305221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:02:06.216545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062488+0000","last_change":"2024-01-30T08:08:46.561905+0000","last_active":"2024-01-30T08:08:49.062488+0000","last_peered":"2024-01-30T08:08:49.062488+0000","last_clean":"2024-01-30T08:08:49.062488+0000","last_became_active":"2024-01-30T08:08:46.561585+0000","last_became_peered":"2024-01-30T08:08:46.561585+0000","last_unstale":"2024-01-30T08:08:49.062488+0000","last_undegraded":"2024-01-30T08:08:49.062488+0000","last_fullsized":"2024-01-30T08:08:49.062488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:30.023145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061874+0000","last_change":"2024-01-30T08:08:42.268086+0000","last_active":"2024-01-30T08:08:49.061874+0000","last_peered":"2024-01-30T08:08:49.061874+0000","last_clean":"2024-01-30T08:08:49.061874+0000","last_became_active":"2024-01-30T08:08:42.267843+0000","last_became_peered":"2024-01-30T08:08:42.267843+0000","last_unstale":"2024-01-30T08:08:49.061874+0000","last_undegraded":"2024-01-30T08:08:49.061874+0000","last_fullsized":"2024-01-30T08:08:49.061874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060969+0000","last_change":"2024-01-30T08:08:41.286334+0000","last_active":"2024-01-30T08:08:49.060969+0000","last_peered":"2024-01-30T08:08:49.060969+0000","last_clean":"2024-01-30T08:08:49.060969+0000","last_became_active":"2024-01-30T08:08:41.286076+0000","last_became_peered":"2024-01-30T08:08:41.286076+0000","last_unstale":"2024-01-30T08:08:49.060969+0000","last_undegraded":"2024-01-30T08:08:49.060969+0000","last_fullsized":"2024-01-30T08:08:49.060969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:28:13.810152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307178+0000","last_change":"2024-01-30T08:08:46.310557+0000","last_active":"2024-01-30T08:08:47.307178+0000","last_peered":"2024-01-30T08:08:47.307178+0000","last_clean":"2024-01-30T08:08:47.307178+0000","last_became_active":"2024-01-30T08:08:46.310122+0000","last_became_peered":"2024-01-30T08:08:46.310122+0000","last_unstale":"2024-01-30T08:08:47.307178+0000","last_undegraded":"2024-01-30T08:08:47.307178+0000","last_fullsized":"2024-01-30T08:08:47.307178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305285+0000","last_change":"2024-01-30T08:08:42.287557+0000","last_active":"2024-01-30T08:08:47.305285+0000","last_peered":"2024-01-30T08:08:47.305285+0000","last_clean":"2024-01-30T08:08:47.305285+0000","last_became_active":"2024-01-30T08:08:42.287258+0000","last_became_peered":"2024-01-30T08:08:42.287258+0000","last_unstale":"2024-01-30T08:08:47.305285+0000","last_undegraded":"2024-01-30T08:08:47.305285+0000","last_fullsized":"2024-01-30T08:08:47.305285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305479+0000","last_change":"2024-01-30T08:08:41.275268+0000","last_active":"2024-01-30T08:08:47.305479+0000","last_peered":"2024-01-30T08:08:47.305479+0000","last_clean":"2024-01-30T08:08:47.305479+0000","last_became_active":"2024-01-30T08:08:41.274599+0000","last_became_peered":"2024-01-30T08:08:41.274599+0000","last_unstale":"2024-01-30T08:08:47.305479+0000","last_undegraded":"2024-01-30T08:08:47.305479+0000","last_fullsized":"2024-01-30T08:08:47.305479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306322+0000","last_change":"2024-01-30T08:08:41.278792+0000","last_active":"2024-01-30T08:08:47.306322+0000","last_peered":"2024-01-30T08:08:47.306322+0000","last_clean":"2024-01-30T08:08:47.306322+0000","last_became_active":"2024-01-30T08:08:41.278539+0000","last_became_peered":"2024-01-30T08:08:41.278539+0000","last_unstale":"2024-01-30T08:08:47.306322+0000","last_undegraded":"2024-01-30T08:08:47.306322+0000","last_fullsized":"2024-01-30T08:08:47.306322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062352+0000","last_change":"2024-01-30T08:08:42.297069+0000","last_active":"2024-01-30T08:08:49.062352+0000","last_peered":"2024-01-30T08:08:49.062352+0000","last_clean":"2024-01-30T08:08:49.062352+0000","last_became_active":"2024-01-30T08:08:42.296723+0000","last_became_peered":"2024-01-30T08:08:42.296723+0000","last_unstale":"2024-01-30T08:08:49.062352+0000","last_undegraded":"2024-01-30T08:08:49.062352+0000","last_fullsized":"2024-01-30T08:08:49.062352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789787+0000","last_change":"2024-01-30T08:08:46.310759+0000","last_active":"2024-01-30T08:08:47.789787+0000","last_peered":"2024-01-30T08:08:47.789787+0000","last_clean":"2024-01-30T08:08:47.789787+0000","last_became_active":"2024-01-30T08:08:46.310380+0000","last_became_peered":"2024-01-30T08:08:46.310380+0000","last_unstale":"2024-01-30T08:08:47.789787+0000","last_undegraded":"2024-01-30T08:08:47.789787+0000","last_fullsized":"2024-01-30T08:08:47.789787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:24.682030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305625+0000","last_change":"2024-01-30T08:08:41.283970+0000","last_active":"2024-01-30T08:08:47.305625+0000","last_peered":"2024-01-30T08:08:47.305625+0000","last_clean":"2024-01-30T08:08:47.305625+0000","last_became_active":"2024-01-30T08:08:41.283694+0000","last_became_peered":"2024-01-30T08:08:41.283694+0000","last_unstale":"2024-01-30T08:08:47.305625+0000","last_undegraded":"2024-01-30T08:08:47.305625+0000","last_fullsized":"2024-01-30T08:08:47.305625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:41:46.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306325+0000","last_change":"2024-01-30T08:08:42.274162+0000","last_active":"2024-01-30T08:08:47.306325+0000","last_peered":"2024-01-30T08:08:47.306325+0000","last_clean":"2024-01-30T08:08:47.306325+0000","last_became_active":"2024-01-30T08:08:42.273902+0000","last_became_peered":"2024-01-30T08:08:42.273902+0000","last_unstale":"2024-01-30T08:08:47.306325+0000","last_undegraded":"2024-01-30T08:08:47.306325+0000","last_fullsized":"2024-01-30T08:08:47.306325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:53.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305982+0000","last_change":"2024-01-30T08:08:46.314987+0000","last_active":"2024-01-30T08:08:47.305982+0000","last_peered":"2024-01-30T08:08:47.305982+0000","last_clean":"2024-01-30T08:08:47.305982+0000","last_became_active":"2024-01-30T08:08:46.314692+0000","last_became_peered":"2024-01-30T08:08:46.314692+0000","last_unstale":"2024-01-30T08:08:47.305982+0000","last_undegraded":"2024-01-30T08:08:47.305982+0000","last_fullsized":"2024-01-30T08:08:47.305982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:49:27.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305354+0000","last_change":"2024-01-30T08:08:42.282230+0000","last_active":"2024-01-30T08:08:47.305354+0000","last_peered":"2024-01-30T08:08:47.305354+0000","last_clean":"2024-01-30T08:08:47.305354+0000","last_became_active":"2024-01-30T08:08:42.281857+0000","last_became_peered":"2024-01-30T08:08:42.281857+0000","last_unstale":"2024-01-30T08:08:47.305354+0000","last_undegraded":"2024-01-30T08:08:47.305354+0000","last_fullsized":"2024-01-30T08:08:47.305354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789483+0000","last_change":"2024-01-30T08:08:42.272404+0000","last_active":"2024-01-30T08:08:47.789483+0000","last_peered":"2024-01-30T08:08:47.789483+0000","last_clean":"2024-01-30T08:08:47.789483+0000","last_became_active":"2024-01-30T08:08:42.272041+0000","last_became_peered":"2024-01-30T08:08:42.272041+0000","last_unstale":"2024-01-30T08:08:47.789483+0000","last_undegraded":"2024-01-30T08:08:47.789483+0000","last_fullsized":"2024-01-30T08:08:47.789483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:50.188325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062098+0000","last_change":"2024-01-30T08:08:42.288942+0000","last_active":"2024-01-30T08:08:49.062098+0000","last_peered":"2024-01-30T08:08:49.062098+0000","last_clean":"2024-01-30T08:08:49.062098+0000","last_became_active":"2024-01-30T08:08:42.288707+0000","last_became_peered":"2024-01-30T08:08:42.288707+0000","last_unstale":"2024-01-30T08:08:49.062098+0000","last_undegraded":"2024-01-30T08:08:49.062098+0000","last_fullsized":"2024-01-30T08:08:49.062098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:51:37.937923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062259+0000","last_change":"2024-01-30T08:08:42.286293+0000","last_active":"2024-01-30T08:08:49.062259+0000","last_peered":"2024-01-30T08:08:49.062259+0000","last_clean":"2024-01-30T08:08:49.062259+0000","last_became_active":"2024-01-30T08:08:42.285945+0000","last_became_peered":"2024-01-30T08:08:42.285945+0000","last_unstale":"2024-01-30T08:08:49.062259+0000","last_undegraded":"2024-01-30T08:08:49.062259+0000","last_fullsized":"2024-01-30T08:08:49.062259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:54:46.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306359+0000","last_change":"2024-01-30T08:08:42.288572+0000","last_active":"2024-01-30T08:08:47.306359+0000","last_peered":"2024-01-30T08:08:47.306359+0000","last_clean":"2024-01-30T08:08:47.306359+0000","last_became_active":"2024-01-30T08:08:42.288269+0000","last_became_peered":"2024-01-30T08:08:42.288269+0000","last_unstale":"2024-01-30T08:08:47.306359+0000","last_undegraded":"2024-01-30T08:08:47.306359+0000","last_fullsized":"2024-01-30T08:08:47.306359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063564+0000","last_change":"2024-01-30T08:08:42.266640+0000","last_active":"2024-01-30T08:08:49.063564+0000","last_peered":"2024-01-30T08:08:49.063564+0000","last_clean":"2024-01-30T08:08:49.063564+0000","last_became_active":"2024-01-30T08:08:42.266344+0000","last_became_peered":"2024-01-30T08:08:42.266344+0000","last_unstale":"2024-01-30T08:08:49.063564+0000","last_undegraded":"2024-01-30T08:08:49.063564+0000","last_fullsized":"2024-01-30T08:08:49.063564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307432+0000","last_change":"2024-01-30T08:08:42.292452+0000","last_active":"2024-01-30T08:08:47.307432+0000","last_peered":"2024-01-30T08:08:47.307432+0000","last_clean":"2024-01-30T08:08:47.307432+0000","last_became_active":"2024-01-30T08:08:42.291993+0000","last_became_peered":"2024-01-30T08:08:42.291993+0000","last_unstale":"2024-01-30T08:08:47.307432+0000","last_undegraded":"2024-01-30T08:08:47.307432+0000","last_fullsized":"2024-01-30T08:08:47.307432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306131+0000","last_change":"2024-01-30T08:08:42.284303+0000","last_active":"2024-01-30T08:08:47.306131+0000","last_peered":"2024-01-30T08:08:47.306131+0000","last_clean":"2024-01-30T08:08:47.306131+0000","last_became_active":"2024-01-30T08:08:42.283629+0000","last_became_peered":"2024-01-30T08:08:42.283629+0000","last_unstale":"2024-01-30T08:08:47.306131+0000","last_undegraded":"2024-01-30T08:08:47.306131+0000","last_fullsized":"2024-01-30T08:08:47.306131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060891+0000","last_change":"2024-01-30T08:08:42.289085+0000","last_active":"2024-01-30T08:08:49.060891+0000","last_peered":"2024-01-30T08:08:49.060891+0000","last_clean":"2024-01-30T08:08:49.060891+0000","last_became_active":"2024-01-30T08:08:42.288819+0000","last_became_peered":"2024-01-30T08:08:42.288819+0000","last_unstale":"2024-01-30T08:08:49.060891+0000","last_undegraded":"2024-01-30T08:08:49.060891+0000","last_fullsized":"2024-01-30T08:08:49.060891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:25:34.589630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305290+0000","last_change":"2024-01-30T08:08:42.285165+0000","last_active":"2024-01-30T08:08:47.305290+0000","last_peered":"2024-01-30T08:08:47.305290+0000","last_clean":"2024-01-30T08:08:47.305290+0000","last_became_active":"2024-01-30T08:08:42.284761+0000","last_became_peered":"2024-01-30T08:08:42.284761+0000","last_unstale":"2024-01-30T08:08:47.305290+0000","last_undegraded":"2024-01-30T08:08:47.305290+0000","last_fullsized":"2024-01-30T08:08:47.305290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061938+0000","last_change":"2024-01-30T08:08:42.284896+0000","last_active":"2024-01-30T08:08:49.061938+0000","last_peered":"2024-01-30T08:08:49.061938+0000","last_clean":"2024-01-30T08:08:49.061938+0000","last_became_active":"2024-01-30T08:08:42.284608+0000","last_became_peered":"2024-01-30T08:08:42.284608+0000","last_unstale":"2024-01-30T08:08:49.061938+0000","last_undegraded":"2024-01-30T08:08:49.061938+0000","last_fullsized":"2024-01-30T08:08:49.061938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:02:49.552868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062131+0000","last_change":"2024-01-30T08:08:42.287556+0000","last_active":"2024-01-30T08:08:49.062131+0000","last_peered":"2024-01-30T08:08:49.062131+0000","last_clean":"2024-01-30T08:08:49.062131+0000","last_became_active":"2024-01-30T08:08:42.287220+0000","last_became_peered":"2024-01-30T08:08:42.287220+0000","last_unstale":"2024-01-30T08:08:49.062131+0000","last_undegraded":"2024-01-30T08:08:49.062131+0000","last_fullsized":"2024-01-30T08:08:49.062131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:26:23.553412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306921+0000","last_change":"2024-01-30T08:08:42.279526+0000","last_active":"2024-01-30T08:08:47.306921+0000","last_peered":"2024-01-30T08:08:47.306921+0000","last_clean":"2024-01-30T08:08:47.306921+0000","last_became_active":"2024-01-30T08:08:42.279278+0000","last_became_peered":"2024-01-30T08:08:42.279278+0000","last_unstale":"2024-01-30T08:08:47.306921+0000","last_undegraded":"2024-01-30T08:08:47.306921+0000","last_fullsized":"2024-01-30T08:08:47.306921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061442+0000","last_change":"2024-01-30T08:08:42.289284+0000","last_active":"2024-01-30T08:08:49.061442+0000","last_peered":"2024-01-30T08:08:49.061442+0000","last_clean":"2024-01-30T08:08:49.061442+0000","last_became_active":"2024-01-30T08:08:42.289033+0000","last_became_peered":"2024-01-30T08:08:42.289033+0000","last_unstale":"2024-01-30T08:08:49.061442+0000","last_undegraded":"2024-01-30T08:08:49.061442+0000","last_fullsized":"2024-01-30T08:08:49.061442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:50.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789921+0000","last_change":"2024-01-30T08:08:42.275565+0000","last_active":"2024-01-30T08:08:47.789921+0000","last_peered":"2024-01-30T08:08:47.789921+0000","last_clean":"2024-01-30T08:08:47.789921+0000","last_became_active":"2024-01-30T08:08:42.275279+0000","last_became_peered":"2024-01-30T08:08:42.275279+0000","last_unstale":"2024-01-30T08:08:47.789921+0000","last_undegraded":"2024-01-30T08:08:47.789921+0000","last_fullsized":"2024-01-30T08:08:47.789921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:19.520174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062744+0000","last_change":"2024-01-30T08:08:42.300035+0000","last_active":"2024-01-30T08:08:49.062744+0000","last_peered":"2024-01-30T08:08:49.062744+0000","last_clean":"2024-01-30T08:08:49.062744+0000","last_became_active":"2024-01-30T08:08:42.299735+0000","last_became_peered":"2024-01-30T08:08:42.299735+0000","last_unstale":"2024-01-30T08:08:49.062744+0000","last_undegraded":"2024-01-30T08:08:49.062744+0000","last_fullsized":"2024-01-30T08:08:49.062744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:16:58.027734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060796+0000","last_change":"2024-01-30T08:08:42.274180+0000","last_active":"2024-01-30T08:08:49.060796+0000","last_peered":"2024-01-30T08:08:49.060796+0000","last_clean":"2024-01-30T08:08:49.060796+0000","last_became_active":"2024-01-30T08:08:42.273798+0000","last_became_peered":"2024-01-30T08:08:42.273798+0000","last_unstale":"2024-01-30T08:08:49.060796+0000","last_undegraded":"2024-01-30T08:08:49.060796+0000","last_fullsized":"2024-01-30T08:08:49.060796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062221+0000","last_change":"2024-01-30T08:08:42.272239+0000","last_active":"2024-01-30T08:08:49.062221+0000","last_peered":"2024-01-30T08:08:49.062221+0000","last_clean":"2024-01-30T08:08:49.062221+0000","last_became_active":"2024-01-30T08:08:42.270429+0000","last_became_peered":"2024-01-30T08:08:42.270429+0000","last_unstale":"2024-01-30T08:08:49.062221+0000","last_undegraded":"2024-01-30T08:08:49.062221+0000","last_fullsized":"2024-01-30T08:08:49.062221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061945+0000","last_change":"2024-01-30T08:08:42.279383+0000","last_active":"2024-01-30T08:08:49.061945+0000","last_peered":"2024-01-30T08:08:49.061945+0000","last_clean":"2024-01-30T08:08:49.061945+0000","last_became_active":"2024-01-30T08:08:42.279081+0000","last_became_peered":"2024-01-30T08:08:42.279081+0000","last_unstale":"2024-01-30T08:08:49.061945+0000","last_undegraded":"2024-01-30T08:08:49.061945+0000","last_fullsized":"2024-01-30T08:08:49.061945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:11:44.572777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305417+0000","last_change":"2024-01-30T08:08:42.277550+0000","last_active":"2024-01-30T08:08:47.305417+0000","last_peered":"2024-01-30T08:08:47.305417+0000","last_clean":"2024-01-30T08:08:47.305417+0000","last_became_active":"2024-01-30T08:08:42.276237+0000","last_became_peered":"2024-01-30T08:08:42.276237+0000","last_unstale":"2024-01-30T08:08:47.305417+0000","last_undegraded":"2024-01-30T08:08:47.305417+0000","last_fullsized":"2024-01-30T08:08:47.305417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306274+0000","last_change":"2024-01-30T08:08:42.282127+0000","last_active":"2024-01-30T08:08:47.306274+0000","last_peered":"2024-01-30T08:08:47.306274+0000","last_clean":"2024-01-30T08:08:47.306274+0000","last_became_active":"2024-01-30T08:08:42.281546+0000","last_became_peered":"2024-01-30T08:08:42.281546+0000","last_unstale":"2024-01-30T08:08:47.306274+0000","last_undegraded":"2024-01-30T08:08:47.306274+0000","last_fullsized":"2024-01-30T08:08:47.306274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:48.497646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307235+0000","last_change":"2024-01-30T08:08:42.280580+0000","last_active":"2024-01-30T08:08:47.307235+0000","last_peered":"2024-01-30T08:08:47.307235+0000","last_clean":"2024-01-30T08:08:47.307235+0000","last_became_active":"2024-01-30T08:08:42.280215+0000","last_became_peered":"2024-01-30T08:08:42.280215+0000","last_unstale":"2024-01-30T08:08:47.307235+0000","last_undegraded":"2024-01-30T08:08:47.307235+0000","last_fullsized":"2024-01-30T08:08:47.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307392+0000","last_change":"2024-01-30T08:08:42.274307+0000","last_active":"2024-01-30T08:08:47.307392+0000","last_peered":"2024-01-30T08:08:47.307392+0000","last_clean":"2024-01-30T08:08:47.307392+0000","last_became_active":"2024-01-30T08:08:42.273219+0000","last_became_peered":"2024-01-30T08:08:42.273219+0000","last_unstale":"2024-01-30T08:08:47.307392+0000","last_undegraded":"2024-01-30T08:08:47.307392+0000","last_fullsized":"2024-01-30T08:08:47.307392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061291+0000","last_change":"2024-01-30T08:08:42.298549+0000","last_active":"2024-01-30T08:08:49.061291+0000","last_peered":"2024-01-30T08:08:49.061291+0000","last_clean":"2024-01-30T08:08:49.061291+0000","last_became_active":"2024-01-30T08:08:42.298085+0000","last_became_peered":"2024-01-30T08:08:42.298085+0000","last_unstale":"2024-01-30T08:08:49.061291+0000","last_undegraded":"2024-01-30T08:08:49.061291+0000","last_fullsized":"2024-01-30T08:08:49.061291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:04.518076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305168+0000","last_change":"2024-01-30T08:08:42.278935+0000","last_active":"2024-01-30T08:08:47.305168+0000","last_peered":"2024-01-30T08:08:47.305168+0000","last_clean":"2024-01-30T08:08:47.305168+0000","last_became_active":"2024-01-30T08:08:42.278462+0000","last_became_peered":"2024-01-30T08:08:42.278462+0000","last_unstale":"2024-01-30T08:08:47.305168+0000","last_undegraded":"2024-01-30T08:08:47.305168+0000","last_fullsized":"2024-01-30T08:08:47.305168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060808+0000","last_change":"2024-01-30T08:08:42.287564+0000","last_active":"2024-01-30T08:08:49.060808+0000","last_peered":"2024-01-30T08:08:49.060808+0000","last_clean":"2024-01-30T08:08:49.060808+0000","last_became_active":"2024-01-30T08:08:42.287236+0000","last_became_peered":"2024-01-30T08:08:42.287236+0000","last_unstale":"2024-01-30T08:08:49.060808+0000","last_undegraded":"2024-01-30T08:08:49.060808+0000","last_fullsized":"2024-01-30T08:08:49.060808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061935+0000","last_change":"2024-01-30T08:08:42.273849+0000","last_active":"2024-01-30T08:08:49.061935+0000","last_peered":"2024-01-30T08:08:49.061935+0000","last_clean":"2024-01-30T08:08:49.061935+0000","last_became_active":"2024-01-30T08:08:42.273535+0000","last_became_peered":"2024-01-30T08:08:42.273535+0000","last_unstale":"2024-01-30T08:08:49.061935+0000","last_undegraded":"2024-01-30T08:08:49.061935+0000","last_fullsized":"2024-01-30T08:08:49.061935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:05:19.851128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061350+0000","last_change":"2024-01-30T08:08:42.290524+0000","last_active":"2024-01-30T08:08:49.061350+0000","last_peered":"2024-01-30T08:08:49.061350+0000","last_clean":"2024-01-30T08:08:49.061350+0000","last_became_active":"2024-01-30T08:08:42.290271+0000","last_became_peered":"2024-01-30T08:08:42.290271+0000","last_unstale":"2024-01-30T08:08:49.061350+0000","last_undegraded":"2024-01-30T08:08:49.061350+0000","last_fullsized":"2024-01-30T08:08:49.061350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:19.978105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062197+0000","last_change":"2024-01-30T08:08:42.291250+0000","last_active":"2024-01-30T08:08:49.062197+0000","last_peered":"2024-01-30T08:08:49.062197+0000","last_clean":"2024-01-30T08:08:49.062197+0000","last_became_active":"2024-01-30T08:08:42.290996+0000","last_became_peered":"2024-01-30T08:08:42.290996+0000","last_unstale":"2024-01-30T08:08:49.062197+0000","last_undegraded":"2024-01-30T08:08:49.062197+0000","last_fullsized":"2024-01-30T08:08:49.062197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:25.994167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062296+0000","last_change":"2024-01-30T08:08:42.274737+0000","last_active":"2024-01-30T08:08:49.062296+0000","last_peered":"2024-01-30T08:08:49.062296+0000","last_clean":"2024-01-30T08:08:49.062296+0000","last_became_active":"2024-01-30T08:08:42.274400+0000","last_became_peered":"2024-01-30T08:08:42.274400+0000","last_unstale":"2024-01-30T08:08:49.062296+0000","last_undegraded":"2024-01-30T08:08:49.062296+0000","last_fullsized":"2024-01-30T08:08:49.062296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:30:39.631576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063741+0000","last_change":"2024-01-30T08:08:42.279330+0000","last_active":"2024-01-30T08:08:49.063741+0000","last_peered":"2024-01-30T08:08:49.063741+0000","last_clean":"2024-01-30T08:08:49.063741+0000","last_became_active":"2024-01-30T08:08:42.279149+0000","last_became_peered":"2024-01-30T08:08:42.279149+0000","last_unstale":"2024-01-30T08:08:49.063741+0000","last_undegraded":"2024-01-30T08:08:49.063741+0000","last_fullsized":"2024-01-30T08:08:49.063741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061155+0000","last_change":"2024-01-30T08:08:42.293738+0000","last_active":"2024-01-30T08:08:49.061155+0000","last_peered":"2024-01-30T08:08:49.061155+0000","last_clean":"2024-01-30T08:08:49.061155+0000","last_became_active":"2024-01-30T08:08:42.293398+0000","last_became_peered":"2024-01-30T08:08:42.293398+0000","last_unstale":"2024-01-30T08:08:49.061155+0000","last_undegraded":"2024-01-30T08:08:49.061155+0000","last_fullsized":"2024-01-30T08:08:49.061155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:43.542616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":694227,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9550000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9830000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2629999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1139999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0780000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":694283,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:09:11.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:12.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f1782600640 1 Processor -- start 2024-01-30T08:09:12.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f1782600640 1 -- start start 2024-01-30T08:09:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f1782600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f177c0af780 0x7f177c158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f1782600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c0c7fc0 con 0x7f177c0abf80 2024-01-30T08:09:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f1782600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c0c4a40 con 0x7f177c0abb20 2024-01-30T08:09:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f1782600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c152220 con 0x7f177c0af780 2024-01-30T08:09:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177be00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f177c0abf80 0x7f177c15f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37780/0 (socket says 172.21.15.50:37780) 2024-01-30T08:09:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177be00640 1 -- 172.21.15.50:0/1053279431 learned_addr learned my addr 172.21.15.50:0/1053279431 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177b400640 1 --2- 172.21.15.50:0/1053279431 >> v2:172.21.15.125:3300/0 conn(0x7f177c0af780 0x7f177c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177a000640 1 -- 172.21.15.50:0/1053279431 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313127730 0 0) 0x7f177c0c7fc0 con 0x7f177c0abf80 2024-01-30T08:09:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177a000640 1 -- 172.21.15.50:0/1053279431 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f175c003530 con 0x7f177c0abf80 2024-01-30T08:09:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177b400640 1 -- 172.21.15.50:0/1053279431 >> v1:172.21.15.125:6789/0 conn(0x7f177c0abb20 legacy=0x7f177c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177b400640 1 -- 172.21.15.50:0/1053279431 >> v1:172.21.15.50:6789/0 conn(0x7f177c0abf80 legacy=0x7f177c15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.151+0000 7f177b400640 1 -- 172.21.15.50:0/1053279431 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c158c70 con 0x7f177c0af780 2024-01-30T08:09:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f177b400640 1 --2- 172.21.15.50:0/1053279431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0af780 0x7f177c158730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f176c0097c0 tx=0x7f176c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db0eb9da5b5ff9d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f177a000640 1 -- 172.21.15.50:0/1053279431 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0ab600 con 0x7f177c0af780 2024-01-30T08:09:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f177a000640 1 -- 172.21.15.50:0/1053279431 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0a7050 con 0x7f177c0af780 2024-01-30T08:09:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f177a000640 1 -- 172.21.15.50:0/1053279431 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0ab980 con 0x7f177c0af780 2024-01-30T08:09:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f1782600640 1 -- 172.21.15.50:0/1053279431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0af780 msgr2=0x7f177c158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f1782600640 1 --2- 172.21.15.50:0/1053279431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0af780 0x7f177c158730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f176c0097c0 tx=0x7f176c01c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f1782600640 1 -- 172.21.15.50:0/1053279431 shutdown_connections 2024-01-30T08:09:12.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f1782600640 1 --2- 172.21.15.50:0/1053279431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0af780 0x7f177c158730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f1782600640 1 -- 172.21.15.50:0/1053279431 >> 172.21.15.50:0/1053279431 conn(0x7f177c072470 msgr2=0x7f177c0ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:12.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f1782600640 1 -- 172.21.15.50:0/1053279431 shutdown_connections 2024-01-30T08:09:12.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.155+0000 7f1782600640 1 -- 172.21.15.50:0/1053279431 wait complete. 2024-01-30T08:09:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 Processor -- start 2024-01-30T08:09:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 -- start start 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f177c0abb20 0x7f177c14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0abf80 0x7f177c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177c0af780 0x7f177c14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c150fc0 con 0x7f177c0af780 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c1f1580 con 0x7f177c0abf80 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c1f1000 con 0x7f177c0abb20 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177c0af780 0x7f177c14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177c0af780 0x7f177c14adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49718/0 (socket says 172.21.15.50:49718) 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 -- 172.21.15.50:0/3340067875 learned_addr learned my addr 172.21.15.50:0/3340067875 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177aa00640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0abf80 0x7f177c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177b400640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f177c0abb20 0x7f177c14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 -- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f177c0abb20 msgr2=0x7f177c14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f177c0abb20 0x7f177c14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 -- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0abf80 msgr2=0x7f177c156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0abf80 0x7f177c156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 -- 172.21.15.50:0/3340067875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c009420 con 0x7f177c0af780 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177aa00640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0abf80 0x7f177c156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f177be00640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177c0af780 0x7f177c14adf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f177400caa0 tx=0x7f177400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1773400640 1 -- 172.21.15.50:0/3340067875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400ac00 con 0x7f177c0af780 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1773400640 1 -- 172.21.15.50:0/3340067875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400ad60 con 0x7f177c0af780 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1773400640 1 -- 172.21.15.50:0/3340067875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774012620 con 0x7f177c0af780 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.159+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c1f12a0 con 0x7f177c0af780 2024-01-30T08:09:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.163+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c150720 con 0x7f177c0af780 2024-01-30T08:09:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.163+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c074a20 con 0x7f177c0af780 2024-01-30T08:09:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.163+0000 7f1773400640 1 -- 172.21.15.50:0/3340067875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1774007070 con 0x7f177c0af780 2024-01-30T08:09:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.163+0000 7f1773400640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1754066530 0x7f17540689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.163+0000 7f1773400640 1 -- 172.21.15.50:0/3340067875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17740840f0 con 0x7f177c0af780 2024-01-30T08:09:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.163+0000 7f177b400640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1754066530 0x7f17540689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.167+0000 7f177b400640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1754066530 0x7f17540689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f176c0ad000 tx=0x7f176c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.167+0000 7f1773400640 1 -- 172.21.15.50:0/3340067875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1774051090 con 0x7f177c0af780 2024-01-30T08:09:12.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.327+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f177c155250 con 0x7f1754066530 2024-01-30T08:09:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.335+0000 7f1773400640 1 -- 172.21.15.50:0/3340067875 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345349 (secure 0 0 0) 0x7f176c0b5410 con 0x7f1754066530 2024-01-30T08:09:12.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:12.344 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:12.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1754066530 msgr2=0x7f17540689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1754066530 0x7f17540689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f176c0ad000 tx=0x7f176c008040 comp rx=0 tx=0).stop 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177c0af780 msgr2=0x7f177c14adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177c0af780 0x7f177c14adf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f177400caa0 tx=0x7f177400cf60 comp rx=0 tx=0).stop 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 shutdown_connections 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f177c0abf80 0x7f177c156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1754066530 0x7f17540689f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177c0af780 0x7f177c14adf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 --2- 172.21.15.50:0/3340067875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f177c0abb20 0x7f177c14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 >> 172.21.15.50:0/3340067875 conn(0x7f177c072470 msgr2=0x7f177c06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 shutdown_connections 2024-01-30T08:09:12.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.339+0000 7f1782600640 1 -- 172.21.15.50:0/3340067875 wait complete. 2024-01-30T08:09:12.363 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-01-30T08:09:11.056356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218404,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756316,"statfs":{"total":773094113280,"available":772870467584,"internally_reserved":0,"allocated":2293760,"data_stored":2016230,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003442"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062910+0000","last_change":"2024-01-30T08:08:41.284386+0000","last_active":"2024-01-30T08:08:49.062910+0000","last_peered":"2024-01-30T08:08:49.062910+0000","last_clean":"2024-01-30T08:08:49.062910+0000","last_became_active":"2024-01-30T08:08:41.284070+0000","last_became_peered":"2024-01-30T08:08:41.284070+0000","last_unstale":"2024-01-30T08:08:49.062910+0000","last_undegraded":"2024-01-30T08:08:49.062910+0000","last_fullsized":"2024-01-30T08:08:49.062910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:49:56.992264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305887+0000","last_change":"2024-01-30T08:08:42.279355+0000","last_active":"2024-01-30T08:08:47.305887+0000","last_peered":"2024-01-30T08:08:47.305887+0000","last_clean":"2024-01-30T08:08:47.305887+0000","last_became_active":"2024-01-30T08:08:42.276213+0000","last_became_peered":"2024-01-30T08:08:42.276213+0000","last_unstale":"2024-01-30T08:08:47.305887+0000","last_undegraded":"2024-01-30T08:08:47.305887+0000","last_fullsized":"2024-01-30T08:08:47.305887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.562412+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.561547+0000","last_became_peered":"2024-01-30T08:08:46.561547+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:25.519672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306121+0000","last_change":"2024-01-30T08:08:41.277142+0000","last_active":"2024-01-30T08:08:47.306121+0000","last_peered":"2024-01-30T08:08:47.306121+0000","last_clean":"2024-01-30T08:08:47.306121+0000","last_became_active":"2024-01-30T08:08:41.276876+0000","last_became_peered":"2024-01-30T08:08:41.276876+0000","last_unstale":"2024-01-30T08:08:47.306121+0000","last_undegraded":"2024-01-30T08:08:47.306121+0000","last_fullsized":"2024-01-30T08:08:47.306121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062659+0000","last_change":"2024-01-30T08:08:42.289777+0000","last_active":"2024-01-30T08:08:49.062659+0000","last_peered":"2024-01-30T08:08:49.062659+0000","last_clean":"2024-01-30T08:08:49.062659+0000","last_became_active":"2024-01-30T08:08:42.288789+0000","last_became_peered":"2024-01-30T08:08:42.288789+0000","last_unstale":"2024-01-30T08:08:49.062659+0000","last_undegraded":"2024-01-30T08:08:49.062659+0000","last_fullsized":"2024-01-30T08:08:49.062659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:47:56.164414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305170+0000","last_change":"2024-01-30T08:08:46.315655+0000","last_active":"2024-01-30T08:08:47.305170+0000","last_peered":"2024-01-30T08:08:47.305170+0000","last_clean":"2024-01-30T08:08:47.305170+0000","last_became_active":"2024-01-30T08:08:46.314644+0000","last_became_peered":"2024-01-30T08:08:46.314644+0000","last_unstale":"2024-01-30T08:08:47.305170+0000","last_undegraded":"2024-01-30T08:08:47.305170+0000","last_fullsized":"2024-01-30T08:08:47.305170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:15.180621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061282+0000","last_change":"2024-01-30T08:08:41.289340+0000","last_active":"2024-01-30T08:08:49.061282+0000","last_peered":"2024-01-30T08:08:49.061282+0000","last_clean":"2024-01-30T08:08:49.061282+0000","last_became_active":"2024-01-30T08:08:41.288491+0000","last_became_peered":"2024-01-30T08:08:41.288491+0000","last_unstale":"2024-01-30T08:08:49.061282+0000","last_undegraded":"2024-01-30T08:08:49.061282+0000","last_fullsized":"2024-01-30T08:08:49.061282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062248+0000","last_change":"2024-01-30T08:08:42.297915+0000","last_active":"2024-01-30T08:08:49.062248+0000","last_peered":"2024-01-30T08:08:49.062248+0000","last_clean":"2024-01-30T08:08:49.062248+0000","last_became_active":"2024-01-30T08:08:42.297662+0000","last_became_peered":"2024-01-30T08:08:42.297662+0000","last_unstale":"2024-01-30T08:08:49.062248+0000","last_undegraded":"2024-01-30T08:08:49.062248+0000","last_fullsized":"2024-01-30T08:08:49.062248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:59:23.741905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306032+0000","last_change":"2024-01-30T08:08:46.308032+0000","last_active":"2024-01-30T08:08:47.306032+0000","last_peered":"2024-01-30T08:08:47.306032+0000","last_clean":"2024-01-30T08:08:47.306032+0000","last_became_active":"2024-01-30T08:08:46.307399+0000","last_became_peered":"2024-01-30T08:08:46.307399+0000","last_unstale":"2024-01-30T08:08:47.306032+0000","last_undegraded":"2024-01-30T08:08:47.306032+0000","last_fullsized":"2024-01-30T08:08:47.306032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:00.921167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060898+0000","last_change":"2024-01-30T08:08:41.291632+0000","last_active":"2024-01-30T08:08:49.060898+0000","last_peered":"2024-01-30T08:08:49.060898+0000","last_clean":"2024-01-30T08:08:49.060898+0000","last_became_active":"2024-01-30T08:08:41.291202+0000","last_became_peered":"2024-01-30T08:08:41.291202+0000","last_unstale":"2024-01-30T08:08:49.060898+0000","last_undegraded":"2024-01-30T08:08:49.060898+0000","last_fullsized":"2024-01-30T08:08:49.060898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062453+0000","last_change":"2024-01-30T08:08:42.295783+0000","last_active":"2024-01-30T08:08:49.062453+0000","last_peered":"2024-01-30T08:08:49.062453+0000","last_clean":"2024-01-30T08:08:49.062453+0000","last_became_active":"2024-01-30T08:08:42.295323+0000","last_became_peered":"2024-01-30T08:08:42.295323+0000","last_unstale":"2024-01-30T08:08:49.062453+0000","last_undegraded":"2024-01-30T08:08:49.062453+0000","last_fullsized":"2024-01-30T08:08:49.062453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:19:42.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306102+0000","last_change":"2024-01-30T08:08:46.315845+0000","last_active":"2024-01-30T08:08:47.306102+0000","last_peered":"2024-01-30T08:08:47.306102+0000","last_clean":"2024-01-30T08:08:47.306102+0000","last_became_active":"2024-01-30T08:08:46.315351+0000","last_became_peered":"2024-01-30T08:08:46.315351+0000","last_unstale":"2024-01-30T08:08:47.306102+0000","last_undegraded":"2024-01-30T08:08:47.306102+0000","last_fullsized":"2024-01-30T08:08:47.306102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:05.115925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306123+0000","last_change":"2024-01-30T08:08:42.276052+0000","last_active":"2024-01-30T08:08:47.306123+0000","last_peered":"2024-01-30T08:08:47.306123+0000","last_clean":"2024-01-30T08:08:47.306123+0000","last_became_active":"2024-01-30T08:08:42.275642+0000","last_became_peered":"2024-01-30T08:08:42.275642+0000","last_unstale":"2024-01-30T08:08:47.306123+0000","last_undegraded":"2024-01-30T08:08:47.306123+0000","last_fullsized":"2024-01-30T08:08:47.306123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:38.647109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061678+0000","last_change":"2024-01-30T08:08:41.284716+0000","last_active":"2024-01-30T08:08:49.061678+0000","last_peered":"2024-01-30T08:08:49.061678+0000","last_clean":"2024-01-30T08:08:49.061678+0000","last_became_active":"2024-01-30T08:08:41.284434+0000","last_became_peered":"2024-01-30T08:08:41.284434+0000","last_unstale":"2024-01-30T08:08:49.061678+0000","last_undegraded":"2024-01-30T08:08:49.061678+0000","last_fullsized":"2024-01-30T08:08:49.061678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:49.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306435+0000","last_change":"2024-01-30T08:08:46.304711+0000","last_active":"2024-01-30T08:08:47.306435+0000","last_peered":"2024-01-30T08:08:47.306435+0000","last_clean":"2024-01-30T08:08:47.306435+0000","last_became_active":"2024-01-30T08:08:46.304246+0000","last_became_peered":"2024-01-30T08:08:46.304246+0000","last_unstale":"2024-01-30T08:08:47.306435+0000","last_undegraded":"2024-01-30T08:08:47.306435+0000","last_fullsized":"2024-01-30T08:08:47.306435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305525+0000","last_change":"2024-01-30T08:08:42.284398+0000","last_active":"2024-01-30T08:08:47.305525+0000","last_peered":"2024-01-30T08:08:47.305525+0000","last_clean":"2024-01-30T08:08:47.305525+0000","last_became_active":"2024-01-30T08:08:42.284058+0000","last_became_peered":"2024-01-30T08:08:42.284058+0000","last_unstale":"2024-01-30T08:08:47.305525+0000","last_undegraded":"2024-01-30T08:08:47.305525+0000","last_fullsized":"2024-01-30T08:08:47.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063365+0000","last_change":"2024-01-30T08:08:41.283040+0000","last_active":"2024-01-30T08:08:49.063365+0000","last_peered":"2024-01-30T08:08:49.063365+0000","last_clean":"2024-01-30T08:08:49.063365+0000","last_became_active":"2024-01-30T08:08:41.275704+0000","last_became_peered":"2024-01-30T08:08:41.275704+0000","last_unstale":"2024-01-30T08:08:49.063365+0000","last_undegraded":"2024-01-30T08:08:49.063365+0000","last_fullsized":"2024-01-30T08:08:49.063365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:46.318981+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:46.318487+0000","last_became_peered":"2024-01-30T08:08:46.318487+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305403+0000","last_change":"2024-01-30T08:08:42.276779+0000","last_active":"2024-01-30T08:08:47.305403+0000","last_peered":"2024-01-30T08:08:47.305403+0000","last_clean":"2024-01-30T08:08:47.305403+0000","last_became_active":"2024-01-30T08:08:42.276293+0000","last_became_peered":"2024-01-30T08:08:42.276293+0000","last_unstale":"2024-01-30T08:08:47.305403+0000","last_undegraded":"2024-01-30T08:08:47.305403+0000","last_fullsized":"2024-01-30T08:08:47.305403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062313+0000","last_change":"2024-01-30T08:08:41.280606+0000","last_active":"2024-01-30T08:08:49.062313+0000","last_peered":"2024-01-30T08:08:49.062313+0000","last_clean":"2024-01-30T08:08:49.062313+0000","last_became_active":"2024-01-30T08:08:41.280257+0000","last_became_peered":"2024-01-30T08:08:41.280257+0000","last_unstale":"2024-01-30T08:08:49.062313+0000","last_undegraded":"2024-01-30T08:08:49.062313+0000","last_fullsized":"2024-01-30T08:08:49.062313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063823+0000","last_change":"2024-01-30T08:08:46.564137+0000","last_active":"2024-01-30T08:08:49.063823+0000","last_peered":"2024-01-30T08:08:49.063823+0000","last_clean":"2024-01-30T08:08:49.063823+0000","last_became_active":"2024-01-30T08:08:46.563422+0000","last_became_peered":"2024-01-30T08:08:46.563422+0000","last_unstale":"2024-01-30T08:08:49.063823+0000","last_undegraded":"2024-01-30T08:08:49.063823+0000","last_fullsized":"2024-01-30T08:08:49.063823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:53.755351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305710+0000","last_change":"2024-01-30T08:08:42.271792+0000","last_active":"2024-01-30T08:08:47.305710+0000","last_peered":"2024-01-30T08:08:47.305710+0000","last_clean":"2024-01-30T08:08:47.305710+0000","last_became_active":"2024-01-30T08:08:42.271488+0000","last_became_peered":"2024-01-30T08:08:42.271488+0000","last_unstale":"2024-01-30T08:08:47.305710+0000","last_undegraded":"2024-01-30T08:08:47.305710+0000","last_fullsized":"2024-01-30T08:08:47.305710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:43.028344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060650+0000","last_change":"2024-01-30T08:08:41.289206+0000","last_active":"2024-01-30T08:08:49.060650+0000","last_peered":"2024-01-30T08:08:49.060650+0000","last_clean":"2024-01-30T08:08:49.060650+0000","last_became_active":"2024-01-30T08:08:41.288158+0000","last_became_peered":"2024-01-30T08:08:41.288158+0000","last_unstale":"2024-01-30T08:08:49.060650+0000","last_undegraded":"2024-01-30T08:08:49.060650+0000","last_fullsized":"2024-01-30T08:08:49.060650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306652+0000","last_change":"2024-01-30T08:08:46.315546+0000","last_active":"2024-01-30T08:08:47.306652+0000","last_peered":"2024-01-30T08:08:47.306652+0000","last_clean":"2024-01-30T08:08:47.306652+0000","last_became_active":"2024-01-30T08:08:46.314665+0000","last_became_peered":"2024-01-30T08:08:46.314665+0000","last_unstale":"2024-01-30T08:08:47.306652+0000","last_undegraded":"2024-01-30T08:08:47.306652+0000","last_fullsized":"2024-01-30T08:08:47.306652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062963+0000","last_change":"2024-01-30T08:08:42.278495+0000","last_active":"2024-01-30T08:08:49.062963+0000","last_peered":"2024-01-30T08:08:49.062963+0000","last_clean":"2024-01-30T08:08:49.062963+0000","last_became_active":"2024-01-30T08:08:42.278239+0000","last_became_peered":"2024-01-30T08:08:42.278239+0000","last_unstale":"2024-01-30T08:08:49.062963+0000","last_undegraded":"2024-01-30T08:08:49.062963+0000","last_fullsized":"2024-01-30T08:08:49.062963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:15:30.493486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307419+0000","last_change":"2024-01-30T08:08:41.288843+0000","last_active":"2024-01-30T08:08:47.307419+0000","last_peered":"2024-01-30T08:08:47.307419+0000","last_clean":"2024-01-30T08:08:47.307419+0000","last_became_active":"2024-01-30T08:08:41.287058+0000","last_became_peered":"2024-01-30T08:08:41.287058+0000","last_unstale":"2024-01-30T08:08:47.307419+0000","last_undegraded":"2024-01-30T08:08:47.307419+0000","last_fullsized":"2024-01-30T08:08:47.307419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305476+0000","last_change":"2024-01-30T08:08:46.561858+0000","last_active":"2024-01-30T08:08:47.305476+0000","last_peered":"2024-01-30T08:08:47.305476+0000","last_clean":"2024-01-30T08:08:47.305476+0000","last_became_active":"2024-01-30T08:08:46.561473+0000","last_became_peered":"2024-01-30T08:08:46.561473+0000","last_unstale":"2024-01-30T08:08:47.305476+0000","last_undegraded":"2024-01-30T08:08:47.305476+0000","last_fullsized":"2024-01-30T08:08:47.305476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:55.086903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306212+0000","last_change":"2024-01-30T08:08:42.292374+0000","last_active":"2024-01-30T08:08:47.306212+0000","last_peered":"2024-01-30T08:08:47.306212+0000","last_clean":"2024-01-30T08:08:47.306212+0000","last_became_active":"2024-01-30T08:08:42.292083+0000","last_became_peered":"2024-01-30T08:08:42.292083+0000","last_unstale":"2024-01-30T08:08:47.306212+0000","last_undegraded":"2024-01-30T08:08:47.306212+0000","last_fullsized":"2024-01-30T08:08:47.306212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063796+0000","last_change":"2024-01-30T08:08:41.277386+0000","last_active":"2024-01-30T08:08:49.063796+0000","last_peered":"2024-01-30T08:08:49.063796+0000","last_clean":"2024-01-30T08:08:49.063796+0000","last_became_active":"2024-01-30T08:08:41.276132+0000","last_became_peered":"2024-01-30T08:08:41.276132+0000","last_unstale":"2024-01-30T08:08:49.063796+0000","last_undegraded":"2024-01-30T08:08:49.063796+0000","last_fullsized":"2024-01-30T08:08:49.063796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:44.346673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305152+0000","last_change":"2024-01-30T08:08:46.566162+0000","last_active":"2024-01-30T08:08:47.305152+0000","last_peered":"2024-01-30T08:08:47.305152+0000","last_clean":"2024-01-30T08:08:47.305152+0000","last_became_active":"2024-01-30T08:08:46.565660+0000","last_became_peered":"2024-01-30T08:08:46.565660+0000","last_unstale":"2024-01-30T08:08:47.305152+0000","last_undegraded":"2024-01-30T08:08:47.305152+0000","last_fullsized":"2024-01-30T08:08:47.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063508+0000","last_change":"2024-01-30T08:08:42.271610+0000","last_active":"2024-01-30T08:08:49.063508+0000","last_peered":"2024-01-30T08:08:49.063508+0000","last_clean":"2024-01-30T08:08:49.063508+0000","last_became_active":"2024-01-30T08:08:42.271325+0000","last_became_peered":"2024-01-30T08:08:42.271325+0000","last_unstale":"2024-01-30T08:08:49.063508+0000","last_undegraded":"2024-01-30T08:08:49.063508+0000","last_fullsized":"2024-01-30T08:08:49.063508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061483+0000","last_change":"2024-01-30T08:08:41.289187+0000","last_active":"2024-01-30T08:08:49.061483+0000","last_peered":"2024-01-30T08:08:49.061483+0000","last_clean":"2024-01-30T08:08:49.061483+0000","last_became_active":"2024-01-30T08:08:41.288137+0000","last_became_peered":"2024-01-30T08:08:41.288137+0000","last_unstale":"2024-01-30T08:08:49.061483+0000","last_undegraded":"2024-01-30T08:08:49.061483+0000","last_fullsized":"2024-01-30T08:08:49.061483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062164+0000","last_change":"2024-01-30T08:08:46.562867+0000","last_active":"2024-01-30T08:08:49.062164+0000","last_peered":"2024-01-30T08:08:49.062164+0000","last_clean":"2024-01-30T08:08:49.062164+0000","last_became_active":"2024-01-30T08:08:46.562382+0000","last_became_peered":"2024-01-30T08:08:46.562382+0000","last_unstale":"2024-01-30T08:08:49.062164+0000","last_undegraded":"2024-01-30T08:08:49.062164+0000","last_fullsized":"2024-01-30T08:08:49.062164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:44.788175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062441+0000","last_change":"2024-01-30T08:08:42.287858+0000","last_active":"2024-01-30T08:08:49.062441+0000","last_peered":"2024-01-30T08:08:49.062441+0000","last_clean":"2024-01-30T08:08:49.062441+0000","last_became_active":"2024-01-30T08:08:42.287567+0000","last_became_peered":"2024-01-30T08:08:42.287567+0000","last_unstale":"2024-01-30T08:08:49.062441+0000","last_undegraded":"2024-01-30T08:08:49.062441+0000","last_fullsized":"2024-01-30T08:08:49.062441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:40.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063597+0000","last_change":"2024-01-30T08:08:41.278170+0000","last_active":"2024-01-30T08:08:49.063597+0000","last_peered":"2024-01-30T08:08:49.063597+0000","last_clean":"2024-01-30T08:08:49.063597+0000","last_became_active":"2024-01-30T08:08:41.277887+0000","last_became_peered":"2024-01-30T08:08:41.277887+0000","last_unstale":"2024-01-30T08:08:49.063597+0000","last_undegraded":"2024-01-30T08:08:49.063597+0000","last_fullsized":"2024-01-30T08:08:49.063597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063213+0000","last_change":"2024-01-30T08:08:46.307067+0000","last_active":"2024-01-30T08:08:49.063213+0000","last_peered":"2024-01-30T08:08:49.063213+0000","last_clean":"2024-01-30T08:08:49.063213+0000","last_became_active":"2024-01-30T08:08:46.306645+0000","last_became_peered":"2024-01-30T08:08:46.306645+0000","last_unstale":"2024-01-30T08:08:49.063213+0000","last_undegraded":"2024-01-30T08:08:49.063213+0000","last_fullsized":"2024-01-30T08:08:49.063213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:47.571595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306470+0000","last_change":"2024-01-30T08:08:42.283427+0000","last_active":"2024-01-30T08:08:47.306470+0000","last_peered":"2024-01-30T08:08:47.306470+0000","last_clean":"2024-01-30T08:08:47.306470+0000","last_became_active":"2024-01-30T08:08:42.281444+0000","last_became_peered":"2024-01-30T08:08:42.281444+0000","last_unstale":"2024-01-30T08:08:47.306470+0000","last_undegraded":"2024-01-30T08:08:47.306470+0000","last_fullsized":"2024-01-30T08:08:47.306470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:42.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062249+0000","last_change":"2024-01-30T08:08:41.275140+0000","last_active":"2024-01-30T08:08:49.062249+0000","last_peered":"2024-01-30T08:08:49.062249+0000","last_clean":"2024-01-30T08:08:49.062249+0000","last_became_active":"2024-01-30T08:08:41.274851+0000","last_became_peered":"2024-01-30T08:08:41.274851+0000","last_unstale":"2024-01-30T08:08:49.062249+0000","last_undegraded":"2024-01-30T08:08:49.062249+0000","last_fullsized":"2024-01-30T08:08:49.062249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:40:25.984103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063589+0000","last_change":"2024-01-30T08:08:46.320651+0000","last_active":"2024-01-30T08:08:49.063589+0000","last_peered":"2024-01-30T08:08:49.063589+0000","last_clean":"2024-01-30T08:08:49.063589+0000","last_became_active":"2024-01-30T08:08:46.320138+0000","last_became_peered":"2024-01-30T08:08:46.320138+0000","last_unstale":"2024-01-30T08:08:49.063589+0000","last_undegraded":"2024-01-30T08:08:49.063589+0000","last_fullsized":"2024-01-30T08:08:49.063589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:08.547055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062056+0000","last_change":"2024-01-30T08:08:42.271482+0000","last_active":"2024-01-30T08:08:49.062056+0000","last_peered":"2024-01-30T08:08:49.062056+0000","last_clean":"2024-01-30T08:08:49.062056+0000","last_became_active":"2024-01-30T08:08:42.271232+0000","last_became_peered":"2024-01-30T08:08:42.271232+0000","last_unstale":"2024-01-30T08:08:49.062056+0000","last_undegraded":"2024-01-30T08:08:49.062056+0000","last_fullsized":"2024-01-30T08:08:49.062056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789511+0000","last_change":"2024-01-30T08:08:41.277419+0000","last_active":"2024-01-30T08:08:47.789511+0000","last_peered":"2024-01-30T08:08:47.789511+0000","last_clean":"2024-01-30T08:08:47.789511+0000","last_became_active":"2024-01-30T08:08:41.277104+0000","last_became_peered":"2024-01-30T08:08:41.277104+0000","last_unstale":"2024-01-30T08:08:47.789511+0000","last_undegraded":"2024-01-30T08:08:47.789511+0000","last_fullsized":"2024-01-30T08:08:47.789511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063871+0000","last_change":"2024-01-30T08:08:46.321512+0000","last_active":"2024-01-30T08:08:49.063871+0000","last_peered":"2024-01-30T08:08:49.063871+0000","last_clean":"2024-01-30T08:08:49.063871+0000","last_became_active":"2024-01-30T08:08:46.320112+0000","last_became_peered":"2024-01-30T08:08:46.320112+0000","last_unstale":"2024-01-30T08:08:49.063871+0000","last_undegraded":"2024-01-30T08:08:49.063871+0000","last_fullsized":"2024-01-30T08:08:49.063871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:47.443249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061695+0000","last_change":"2024-01-30T08:08:42.296060+0000","last_active":"2024-01-30T08:08:49.061695+0000","last_peered":"2024-01-30T08:08:49.061695+0000","last_clean":"2024-01-30T08:08:49.061695+0000","last_became_active":"2024-01-30T08:08:42.295753+0000","last_became_peered":"2024-01-30T08:08:42.295753+0000","last_unstale":"2024-01-30T08:08:49.061695+0000","last_undegraded":"2024-01-30T08:08:49.061695+0000","last_fullsized":"2024-01-30T08:08:49.061695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:29:48.979595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060657+0000","last_change":"2024-01-30T08:08:41.286271+0000","last_active":"2024-01-30T08:08:49.060657+0000","last_peered":"2024-01-30T08:08:49.060657+0000","last_clean":"2024-01-30T08:08:49.060657+0000","last_became_active":"2024-01-30T08:08:41.285958+0000","last_became_peered":"2024-01-30T08:08:41.285958+0000","last_unstale":"2024-01-30T08:08:49.060657+0000","last_undegraded":"2024-01-30T08:08:49.060657+0000","last_fullsized":"2024-01-30T08:08:49.060657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062773+0000","last_change":"2024-01-30T08:08:46.562368+0000","last_active":"2024-01-30T08:08:49.062773+0000","last_peered":"2024-01-30T08:08:49.062773+0000","last_clean":"2024-01-30T08:08:49.062773+0000","last_became_active":"2024-01-30T08:08:46.561511+0000","last_became_peered":"2024-01-30T08:08:46.561511+0000","last_unstale":"2024-01-30T08:08:49.062773+0000","last_undegraded":"2024-01-30T08:08:49.062773+0000","last_fullsized":"2024-01-30T08:08:49.062773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:55.340433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305463+0000","last_change":"2024-01-30T08:08:42.284518+0000","last_active":"2024-01-30T08:08:47.305463+0000","last_peered":"2024-01-30T08:08:47.305463+0000","last_clean":"2024-01-30T08:08:47.305463+0000","last_became_active":"2024-01-30T08:08:42.284043+0000","last_became_peered":"2024-01-30T08:08:42.284043+0000","last_unstale":"2024-01-30T08:08:47.305463+0000","last_undegraded":"2024-01-30T08:08:47.305463+0000","last_fullsized":"2024-01-30T08:08:47.305463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061950+0000","last_change":"2024-01-30T08:08:41.280995+0000","last_active":"2024-01-30T08:08:49.061950+0000","last_peered":"2024-01-30T08:08:49.061950+0000","last_clean":"2024-01-30T08:08:49.061950+0000","last_became_active":"2024-01-30T08:08:41.280455+0000","last_became_peered":"2024-01-30T08:08:41.280455+0000","last_unstale":"2024-01-30T08:08:49.061950+0000","last_undegraded":"2024-01-30T08:08:49.061950+0000","last_fullsized":"2024-01-30T08:08:49.061950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:29.471243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061322+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:08:49.061322+0000","last_peered":"2024-01-30T08:08:49.061322+0000","last_clean":"2024-01-30T08:08:49.061322+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:08:49.061322+0000","last_undegraded":"2024-01-30T08:08:49.061322+0000","last_fullsized":"2024-01-30T08:08:49.061322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307091+0000","last_change":"2024-01-30T08:08:46.565243+0000","last_active":"2024-01-30T08:08:47.307091+0000","last_peered":"2024-01-30T08:08:47.307091+0000","last_clean":"2024-01-30T08:08:47.307091+0000","last_became_active":"2024-01-30T08:08:46.564876+0000","last_became_peered":"2024-01-30T08:08:46.564876+0000","last_unstale":"2024-01-30T08:08:47.307091+0000","last_undegraded":"2024-01-30T08:08:47.307091+0000","last_fullsized":"2024-01-30T08:08:47.307091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061006+0000","last_change":"2024-01-30T08:08:42.296681+0000","last_active":"2024-01-30T08:08:49.061006+0000","last_peered":"2024-01-30T08:08:49.061006+0000","last_clean":"2024-01-30T08:08:49.061006+0000","last_became_active":"2024-01-30T08:08:42.296349+0000","last_became_peered":"2024-01-30T08:08:42.296349+0000","last_unstale":"2024-01-30T08:08:49.061006+0000","last_undegraded":"2024-01-30T08:08:49.061006+0000","last_fullsized":"2024-01-30T08:08:49.061006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:35.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789843+0000","last_change":"2024-01-30T08:08:41.288774+0000","last_active":"2024-01-30T08:08:47.789843+0000","last_peered":"2024-01-30T08:08:47.789843+0000","last_clean":"2024-01-30T08:08:47.789843+0000","last_became_active":"2024-01-30T08:08:41.288519+0000","last_became_peered":"2024-01-30T08:08:41.288519+0000","last_unstale":"2024-01-30T08:08:47.789843+0000","last_undegraded":"2024-01-30T08:08:47.789843+0000","last_fullsized":"2024-01-30T08:08:47.789843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305155+0000","last_change":"2024-01-30T08:08:46.560657+0000","last_active":"2024-01-30T08:08:47.305155+0000","last_peered":"2024-01-30T08:08:47.305155+0000","last_clean":"2024-01-30T08:08:47.305155+0000","last_became_active":"2024-01-30T08:08:46.559970+0000","last_became_peered":"2024-01-30T08:08:46.559970+0000","last_unstale":"2024-01-30T08:08:47.305155+0000","last_undegraded":"2024-01-30T08:08:47.305155+0000","last_fullsized":"2024-01-30T08:08:47.305155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:24.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062304+0000","last_change":"2024-01-30T08:08:42.290969+0000","last_active":"2024-01-30T08:08:49.062304+0000","last_peered":"2024-01-30T08:08:49.062304+0000","last_clean":"2024-01-30T08:08:49.062304+0000","last_became_active":"2024-01-30T08:08:42.290605+0000","last_became_peered":"2024-01-30T08:08:42.290605+0000","last_unstale":"2024-01-30T08:08:49.062304+0000","last_undegraded":"2024-01-30T08:08:49.062304+0000","last_fullsized":"2024-01-30T08:08:49.062304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:47:41.957325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063753+0000","last_change":"2024-01-30T08:08:41.283051+0000","last_active":"2024-01-30T08:08:49.063753+0000","last_peered":"2024-01-30T08:08:49.063753+0000","last_clean":"2024-01-30T08:08:49.063753+0000","last_became_active":"2024-01-30T08:08:41.282773+0000","last_became_peered":"2024-01-30T08:08:41.282773+0000","last_unstale":"2024-01-30T08:08:49.063753+0000","last_undegraded":"2024-01-30T08:08:49.063753+0000","last_fullsized":"2024-01-30T08:08:49.063753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:18.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062287+0000","last_change":"2024-01-30T08:08:46.311779+0000","last_active":"2024-01-30T08:08:49.062287+0000","last_peered":"2024-01-30T08:08:49.062287+0000","last_clean":"2024-01-30T08:08:49.062287+0000","last_became_active":"2024-01-30T08:08:46.311314+0000","last_became_peered":"2024-01-30T08:08:46.311314+0000","last_unstale":"2024-01-30T08:08:49.062287+0000","last_undegraded":"2024-01-30T08:08:49.062287+0000","last_fullsized":"2024-01-30T08:08:49.062287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:17:02.056713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061327+0000","last_change":"2024-01-30T08:08:42.305456+0000","last_active":"2024-01-30T08:08:49.061327+0000","last_peered":"2024-01-30T08:08:49.061327+0000","last_clean":"2024-01-30T08:08:49.061327+0000","last_became_active":"2024-01-30T08:08:42.305210+0000","last_became_peered":"2024-01-30T08:08:42.305210+0000","last_unstale":"2024-01-30T08:08:49.061327+0000","last_undegraded":"2024-01-30T08:08:49.061327+0000","last_fullsized":"2024-01-30T08:08:49.061327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:18:49.726372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789981+0000","last_change":"2024-01-30T08:08:41.267098+0000","last_active":"2024-01-30T08:08:47.789981+0000","last_peered":"2024-01-30T08:08:47.789981+0000","last_clean":"2024-01-30T08:08:47.789981+0000","last_became_active":"2024-01-30T08:08:41.266760+0000","last_became_peered":"2024-01-30T08:08:41.266760+0000","last_unstale":"2024-01-30T08:08:47.789981+0000","last_undegraded":"2024-01-30T08:08:47.789981+0000","last_fullsized":"2024-01-30T08:08:47.789981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:28:09.280144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060608+0000","last_change":"2024-01-30T08:08:46.564824+0000","last_active":"2024-01-30T08:08:49.060608+0000","last_peered":"2024-01-30T08:08:49.060608+0000","last_clean":"2024-01-30T08:08:49.060608+0000","last_became_active":"2024-01-30T08:08:46.564330+0000","last_became_peered":"2024-01-30T08:08:46.564330+0000","last_unstale":"2024-01-30T08:08:49.060608+0000","last_undegraded":"2024-01-30T08:08:49.060608+0000","last_fullsized":"2024-01-30T08:08:49.060608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:30:28.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061676+0000","last_change":"2024-01-30T08:08:42.305183+0000","last_active":"2024-01-30T08:08:49.061676+0000","last_peered":"2024-01-30T08:08:49.061676+0000","last_clean":"2024-01-30T08:08:49.061676+0000","last_became_active":"2024-01-30T08:08:42.304786+0000","last_became_peered":"2024-01-30T08:08:42.304786+0000","last_unstale":"2024-01-30T08:08:49.061676+0000","last_undegraded":"2024-01-30T08:08:49.061676+0000","last_fullsized":"2024-01-30T08:08:49.061676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:14.376017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305702+0000","last_change":"2024-01-30T08:08:41.277848+0000","last_active":"2024-01-30T08:08:47.305702+0000","last_peered":"2024-01-30T08:08:47.305702+0000","last_clean":"2024-01-30T08:08:47.305702+0000","last_became_active":"2024-01-30T08:08:41.276589+0000","last_became_peered":"2024-01-30T08:08:41.276589+0000","last_unstale":"2024-01-30T08:08:47.305702+0000","last_undegraded":"2024-01-30T08:08:47.305702+0000","last_fullsized":"2024-01-30T08:08:47.305702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305158+0000","last_change":"2024-01-30T08:08:46.307894+0000","last_active":"2024-01-30T08:08:47.305158+0000","last_peered":"2024-01-30T08:08:47.305158+0000","last_clean":"2024-01-30T08:08:47.305158+0000","last_became_active":"2024-01-30T08:08:46.307456+0000","last_became_peered":"2024-01-30T08:08:46.307456+0000","last_unstale":"2024-01-30T08:08:47.305158+0000","last_undegraded":"2024-01-30T08:08:47.305158+0000","last_fullsized":"2024-01-30T08:08:47.305158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:29.212048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060944+0000","last_change":"2024-01-30T08:08:42.300225+0000","last_active":"2024-01-30T08:08:49.060944+0000","last_peered":"2024-01-30T08:08:49.060944+0000","last_clean":"2024-01-30T08:08:49.060944+0000","last_became_active":"2024-01-30T08:08:42.299982+0000","last_became_peered":"2024-01-30T08:08:42.299982+0000","last_unstale":"2024-01-30T08:08:49.060944+0000","last_undegraded":"2024-01-30T08:08:49.060944+0000","last_fullsized":"2024-01-30T08:08:49.060944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789401+0000","last_change":"2024-01-30T08:08:41.281155+0000","last_active":"2024-01-30T08:08:47.789401+0000","last_peered":"2024-01-30T08:08:47.789401+0000","last_clean":"2024-01-30T08:08:47.789401+0000","last_became_active":"2024-01-30T08:08:41.280684+0000","last_became_peered":"2024-01-30T08:08:41.280684+0000","last_unstale":"2024-01-30T08:08:47.789401+0000","last_undegraded":"2024-01-30T08:08:47.789401+0000","last_fullsized":"2024-01-30T08:08:47.789401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062626+0000","last_change":"2024-01-30T08:08:46.312867+0000","last_active":"2024-01-30T08:08:49.062626+0000","last_peered":"2024-01-30T08:08:49.062626+0000","last_clean":"2024-01-30T08:08:49.062626+0000","last_became_active":"2024-01-30T08:08:46.312450+0000","last_became_peered":"2024-01-30T08:08:46.312450+0000","last_unstale":"2024-01-30T08:08:49.062626+0000","last_undegraded":"2024-01-30T08:08:49.062626+0000","last_fullsized":"2024-01-30T08:08:49.062626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:01.538569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305554+0000","last_change":"2024-01-30T08:08:42.277590+0000","last_active":"2024-01-30T08:08:47.305554+0000","last_peered":"2024-01-30T08:08:47.305554+0000","last_clean":"2024-01-30T08:08:47.305554+0000","last_became_active":"2024-01-30T08:08:42.277197+0000","last_became_peered":"2024-01-30T08:08:42.277197+0000","last_unstale":"2024-01-30T08:08:47.305554+0000","last_undegraded":"2024-01-30T08:08:47.305554+0000","last_fullsized":"2024-01-30T08:08:47.305554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305769+0000","last_change":"2024-01-30T08:08:41.282399+0000","last_active":"2024-01-30T08:08:47.305769+0000","last_peered":"2024-01-30T08:08:47.305769+0000","last_clean":"2024-01-30T08:08:47.305769+0000","last_became_active":"2024-01-30T08:08:41.282056+0000","last_became_peered":"2024-01-30T08:08:41.282056+0000","last_unstale":"2024-01-30T08:08:47.305769+0000","last_undegraded":"2024-01-30T08:08:47.305769+0000","last_fullsized":"2024-01-30T08:08:47.305769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:52.703085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306153+0000","last_change":"2024-01-30T08:08:46.564745+0000","last_active":"2024-01-30T08:08:47.306153+0000","last_peered":"2024-01-30T08:08:47.306153+0000","last_clean":"2024-01-30T08:08:47.306153+0000","last_became_active":"2024-01-30T08:08:46.562228+0000","last_became_peered":"2024-01-30T08:08:46.562228+0000","last_unstale":"2024-01-30T08:08:47.306153+0000","last_undegraded":"2024-01-30T08:08:47.306153+0000","last_fullsized":"2024-01-30T08:08:47.306153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:52:13.466128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061539+0000","last_change":"2024-01-30T08:08:42.305622+0000","last_active":"2024-01-30T08:08:49.061539+0000","last_peered":"2024-01-30T08:08:49.061539+0000","last_clean":"2024-01-30T08:08:49.061539+0000","last_became_active":"2024-01-30T08:08:42.305341+0000","last_became_peered":"2024-01-30T08:08:42.305341+0000","last_unstale":"2024-01-30T08:08:49.061539+0000","last_undegraded":"2024-01-30T08:08:49.061539+0000","last_fullsized":"2024-01-30T08:08:49.061539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:48:56.892188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062120+0000","last_change":"2024-01-30T08:08:41.283528+0000","last_active":"2024-01-30T08:08:49.062120+0000","last_peered":"2024-01-30T08:08:49.062120+0000","last_clean":"2024-01-30T08:08:49.062120+0000","last_became_active":"2024-01-30T08:08:41.283251+0000","last_became_peered":"2024-01-30T08:08:41.283251+0000","last_unstale":"2024-01-30T08:08:49.062120+0000","last_undegraded":"2024-01-30T08:08:49.062120+0000","last_fullsized":"2024-01-30T08:08:49.062120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:48:28.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306255+0000","last_change":"2024-01-30T08:08:46.562419+0000","last_active":"2024-01-30T08:08:47.306255+0000","last_peered":"2024-01-30T08:08:47.306255+0000","last_clean":"2024-01-30T08:08:47.306255+0000","last_became_active":"2024-01-30T08:08:46.562016+0000","last_became_peered":"2024-01-30T08:08:46.562016+0000","last_unstale":"2024-01-30T08:08:47.306255+0000","last_undegraded":"2024-01-30T08:08:47.306255+0000","last_fullsized":"2024-01-30T08:08:47.306255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:52.532600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061999+0000","last_change":"2024-01-30T08:08:42.286331+0000","last_active":"2024-01-30T08:08:49.061999+0000","last_peered":"2024-01-30T08:08:49.061999+0000","last_clean":"2024-01-30T08:08:49.061999+0000","last_became_active":"2024-01-30T08:08:42.286070+0000","last_became_peered":"2024-01-30T08:08:42.286070+0000","last_unstale":"2024-01-30T08:08:49.061999+0000","last_undegraded":"2024-01-30T08:08:49.061999+0000","last_fullsized":"2024-01-30T08:08:49.061999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:49:29.159312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062387+0000","last_change":"2024-01-30T08:08:41.279978+0000","last_active":"2024-01-30T08:08:49.062387+0000","last_peered":"2024-01-30T08:08:49.062387+0000","last_clean":"2024-01-30T08:08:49.062387+0000","last_became_active":"2024-01-30T08:08:41.279673+0000","last_became_peered":"2024-01-30T08:08:41.279673+0000","last_unstale":"2024-01-30T08:08:49.062387+0000","last_undegraded":"2024-01-30T08:08:49.062387+0000","last_fullsized":"2024-01-30T08:08:49.062387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:24.278733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062307+0000","last_change":"2024-01-30T08:08:46.561776+0000","last_active":"2024-01-30T08:08:49.062307+0000","last_peered":"2024-01-30T08:08:49.062307+0000","last_clean":"2024-01-30T08:08:49.062307+0000","last_became_active":"2024-01-30T08:08:46.561227+0000","last_became_peered":"2024-01-30T08:08:46.561227+0000","last_unstale":"2024-01-30T08:08:49.062307+0000","last_undegraded":"2024-01-30T08:08:49.062307+0000","last_fullsized":"2024-01-30T08:08:49.062307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:07.684344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060787+0000","last_change":"2024-01-30T08:08:42.289925+0000","last_active":"2024-01-30T08:08:49.060787+0000","last_peered":"2024-01-30T08:08:49.060787+0000","last_clean":"2024-01-30T08:08:49.060787+0000","last_became_active":"2024-01-30T08:08:42.289634+0000","last_became_peered":"2024-01-30T08:08:42.289634+0000","last_unstale":"2024-01-30T08:08:49.060787+0000","last_undegraded":"2024-01-30T08:08:49.060787+0000","last_fullsized":"2024-01-30T08:08:49.060787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:57.307398+0000","last_change":"2024-01-30T08:08:41.274369+0000","last_active":"2024-01-30T08:08:57.307398+0000","last_peered":"2024-01-30T08:08:57.307398+0000","last_clean":"2024-01-30T08:08:57.307398+0000","last_became_active":"2024-01-30T08:08:41.274054+0000","last_became_peered":"2024-01-30T08:08:41.274054+0000","last_unstale":"2024-01-30T08:08:57.307398+0000","last_undegraded":"2024-01-30T08:08:57.307398+0000","last_fullsized":"2024-01-30T08:08:57.307398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:40:42.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063316+0000","last_change":"2024-01-30T08:08:46.309278+0000","last_active":"2024-01-30T08:08:49.063316+0000","last_peered":"2024-01-30T08:08:49.063316+0000","last_clean":"2024-01-30T08:08:49.063316+0000","last_became_active":"2024-01-30T08:08:46.308827+0000","last_became_peered":"2024-01-30T08:08:46.308827+0000","last_unstale":"2024-01-30T08:08:49.063316+0000","last_undegraded":"2024-01-30T08:08:49.063316+0000","last_fullsized":"2024-01-30T08:08:49.063316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:47:18.404996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306375+0000","last_change":"2024-01-30T08:08:42.295489+0000","last_active":"2024-01-30T08:08:47.306375+0000","last_peered":"2024-01-30T08:08:47.306375+0000","last_clean":"2024-01-30T08:08:47.306375+0000","last_became_active":"2024-01-30T08:08:42.295174+0000","last_became_peered":"2024-01-30T08:08:42.295174+0000","last_unstale":"2024-01-30T08:08:47.306375+0000","last_undegraded":"2024-01-30T08:08:47.306375+0000","last_fullsized":"2024-01-30T08:08:47.306375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:26:45.352887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063672+0000","last_change":"2024-01-30T08:08:41.285933+0000","last_active":"2024-01-30T08:08:49.063672+0000","last_peered":"2024-01-30T08:08:49.063672+0000","last_clean":"2024-01-30T08:08:49.063672+0000","last_became_active":"2024-01-30T08:08:41.285666+0000","last_became_peered":"2024-01-30T08:08:41.285666+0000","last_unstale":"2024-01-30T08:08:49.063672+0000","last_undegraded":"2024-01-30T08:08:49.063672+0000","last_fullsized":"2024-01-30T08:08:49.063672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:47.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306259+0000","last_change":"2024-01-30T08:08:46.309394+0000","last_active":"2024-01-30T08:08:47.306259+0000","last_peered":"2024-01-30T08:08:47.306259+0000","last_clean":"2024-01-30T08:08:47.306259+0000","last_became_active":"2024-01-30T08:08:46.308580+0000","last_became_peered":"2024-01-30T08:08:46.308580+0000","last_unstale":"2024-01-30T08:08:47.306259+0000","last_undegraded":"2024-01-30T08:08:47.306259+0000","last_fullsized":"2024-01-30T08:08:47.306259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:39:39.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062825+0000","last_change":"2024-01-30T08:08:42.278568+0000","last_active":"2024-01-30T08:08:49.062825+0000","last_peered":"2024-01-30T08:08:49.062825+0000","last_clean":"2024-01-30T08:08:49.062825+0000","last_became_active":"2024-01-30T08:08:42.278276+0000","last_became_peered":"2024-01-30T08:08:42.278276+0000","last_unstale":"2024-01-30T08:08:49.062825+0000","last_undegraded":"2024-01-30T08:08:49.062825+0000","last_fullsized":"2024-01-30T08:08:49.062825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:58:32.360625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062543+0000","last_change":"2024-01-30T08:08:41.282653+0000","last_active":"2024-01-30T08:08:49.062543+0000","last_peered":"2024-01-30T08:08:49.062543+0000","last_clean":"2024-01-30T08:08:49.062543+0000","last_became_active":"2024-01-30T08:08:41.282366+0000","last_became_peered":"2024-01-30T08:08:41.282366+0000","last_unstale":"2024-01-30T08:08:49.062543+0000","last_undegraded":"2024-01-30T08:08:49.062543+0000","last_fullsized":"2024-01-30T08:08:49.062543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:46:13.875970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305335+0000","last_change":"2024-01-30T08:08:46.315140+0000","last_active":"2024-01-30T08:08:47.305335+0000","last_peered":"2024-01-30T08:08:47.305335+0000","last_clean":"2024-01-30T08:08:47.305335+0000","last_became_active":"2024-01-30T08:08:46.314739+0000","last_became_peered":"2024-01-30T08:08:46.314739+0000","last_unstale":"2024-01-30T08:08:47.305335+0000","last_undegraded":"2024-01-30T08:08:47.305335+0000","last_fullsized":"2024-01-30T08:08:47.305335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:44:48.427798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062325+0000","last_change":"2024-01-30T08:08:42.291387+0000","last_active":"2024-01-30T08:08:49.062325+0000","last_peered":"2024-01-30T08:08:49.062325+0000","last_clean":"2024-01-30T08:08:49.062325+0000","last_became_active":"2024-01-30T08:08:42.290925+0000","last_became_peered":"2024-01-30T08:08:42.290925+0000","last_unstale":"2024-01-30T08:08:49.062325+0000","last_undegraded":"2024-01-30T08:08:49.062325+0000","last_fullsized":"2024-01-30T08:08:49.062325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:18:35.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307293+0000","last_change":"2024-01-30T08:08:41.287404+0000","last_active":"2024-01-30T08:08:47.307293+0000","last_peered":"2024-01-30T08:08:47.307293+0000","last_clean":"2024-01-30T08:08:47.307293+0000","last_became_active":"2024-01-30T08:08:41.287106+0000","last_became_peered":"2024-01-30T08:08:41.287106+0000","last_unstale":"2024-01-30T08:08:47.307293+0000","last_undegraded":"2024-01-30T08:08:47.307293+0000","last_fullsized":"2024-01-30T08:08:47.307293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:46:41.226420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305221+0000","last_change":"2024-01-30T08:08:46.565452+0000","last_active":"2024-01-30T08:08:47.305221+0000","last_peered":"2024-01-30T08:08:47.305221+0000","last_clean":"2024-01-30T08:08:47.305221+0000","last_became_active":"2024-01-30T08:08:46.564941+0000","last_became_peered":"2024-01-30T08:08:46.564941+0000","last_unstale":"2024-01-30T08:08:47.305221+0000","last_undegraded":"2024-01-30T08:08:47.305221+0000","last_fullsized":"2024-01-30T08:08:47.305221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:02:06.216545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062488+0000","last_change":"2024-01-30T08:08:46.561905+0000","last_active":"2024-01-30T08:08:49.062488+0000","last_peered":"2024-01-30T08:08:49.062488+0000","last_clean":"2024-01-30T08:08:49.062488+0000","last_became_active":"2024-01-30T08:08:46.561585+0000","last_became_peered":"2024-01-30T08:08:46.561585+0000","last_unstale":"2024-01-30T08:08:49.062488+0000","last_undegraded":"2024-01-30T08:08:49.062488+0000","last_fullsized":"2024-01-30T08:08:49.062488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:30.023145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061874+0000","last_change":"2024-01-30T08:08:42.268086+0000","last_active":"2024-01-30T08:08:49.061874+0000","last_peered":"2024-01-30T08:08:49.061874+0000","last_clean":"2024-01-30T08:08:49.061874+0000","last_became_active":"2024-01-30T08:08:42.267843+0000","last_became_peered":"2024-01-30T08:08:42.267843+0000","last_unstale":"2024-01-30T08:08:49.061874+0000","last_undegraded":"2024-01-30T08:08:49.061874+0000","last_fullsized":"2024-01-30T08:08:49.061874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060969+0000","last_change":"2024-01-30T08:08:41.286334+0000","last_active":"2024-01-30T08:08:49.060969+0000","last_peered":"2024-01-30T08:08:49.060969+0000","last_clean":"2024-01-30T08:08:49.060969+0000","last_became_active":"2024-01-30T08:08:41.286076+0000","last_became_peered":"2024-01-30T08:08:41.286076+0000","last_unstale":"2024-01-30T08:08:49.060969+0000","last_undegraded":"2024-01-30T08:08:49.060969+0000","last_fullsized":"2024-01-30T08:08:49.060969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:28:13.810152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307178+0000","last_change":"2024-01-30T08:08:46.310557+0000","last_active":"2024-01-30T08:08:47.307178+0000","last_peered":"2024-01-30T08:08:47.307178+0000","last_clean":"2024-01-30T08:08:47.307178+0000","last_became_active":"2024-01-30T08:08:46.310122+0000","last_became_peered":"2024-01-30T08:08:46.310122+0000","last_unstale":"2024-01-30T08:08:47.307178+0000","last_undegraded":"2024-01-30T08:08:47.307178+0000","last_fullsized":"2024-01-30T08:08:47.307178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:54.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305285+0000","last_change":"2024-01-30T08:08:42.287557+0000","last_active":"2024-01-30T08:08:47.305285+0000","last_peered":"2024-01-30T08:08:47.305285+0000","last_clean":"2024-01-30T08:08:47.305285+0000","last_became_active":"2024-01-30T08:08:42.287258+0000","last_became_peered":"2024-01-30T08:08:42.287258+0000","last_unstale":"2024-01-30T08:08:47.305285+0000","last_undegraded":"2024-01-30T08:08:47.305285+0000","last_fullsized":"2024-01-30T08:08:47.305285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305479+0000","last_change":"2024-01-30T08:08:41.275268+0000","last_active":"2024-01-30T08:08:47.305479+0000","last_peered":"2024-01-30T08:08:47.305479+0000","last_clean":"2024-01-30T08:08:47.305479+0000","last_became_active":"2024-01-30T08:08:41.274599+0000","last_became_peered":"2024-01-30T08:08:41.274599+0000","last_unstale":"2024-01-30T08:08:47.305479+0000","last_undegraded":"2024-01-30T08:08:47.305479+0000","last_fullsized":"2024-01-30T08:08:47.305479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:53.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306322+0000","last_change":"2024-01-30T08:08:41.278792+0000","last_active":"2024-01-30T08:08:47.306322+0000","last_peered":"2024-01-30T08:08:47.306322+0000","last_clean":"2024-01-30T08:08:47.306322+0000","last_became_active":"2024-01-30T08:08:41.278539+0000","last_became_peered":"2024-01-30T08:08:41.278539+0000","last_unstale":"2024-01-30T08:08:47.306322+0000","last_undegraded":"2024-01-30T08:08:47.306322+0000","last_fullsized":"2024-01-30T08:08:47.306322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:22:57.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062352+0000","last_change":"2024-01-30T08:08:42.297069+0000","last_active":"2024-01-30T08:08:49.062352+0000","last_peered":"2024-01-30T08:08:49.062352+0000","last_clean":"2024-01-30T08:08:49.062352+0000","last_became_active":"2024-01-30T08:08:42.296723+0000","last_became_peered":"2024-01-30T08:08:42.296723+0000","last_unstale":"2024-01-30T08:08:49.062352+0000","last_undegraded":"2024-01-30T08:08:49.062352+0000","last_fullsized":"2024-01-30T08:08:49.062352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789787+0000","last_change":"2024-01-30T08:08:46.310759+0000","last_active":"2024-01-30T08:08:47.789787+0000","last_peered":"2024-01-30T08:08:47.789787+0000","last_clean":"2024-01-30T08:08:47.789787+0000","last_became_active":"2024-01-30T08:08:46.310380+0000","last_became_peered":"2024-01-30T08:08:46.310380+0000","last_unstale":"2024-01-30T08:08:47.789787+0000","last_undegraded":"2024-01-30T08:08:47.789787+0000","last_fullsized":"2024-01-30T08:08:47.789787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:24.682030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305625+0000","last_change":"2024-01-30T08:08:41.283970+0000","last_active":"2024-01-30T08:08:47.305625+0000","last_peered":"2024-01-30T08:08:47.305625+0000","last_clean":"2024-01-30T08:08:47.305625+0000","last_became_active":"2024-01-30T08:08:41.283694+0000","last_became_peered":"2024-01-30T08:08:41.283694+0000","last_unstale":"2024-01-30T08:08:47.305625+0000","last_undegraded":"2024-01-30T08:08:47.305625+0000","last_fullsized":"2024-01-30T08:08:47.305625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:40.241870+0000","last_clean_scrub_stamp":"2024-01-30T08:08:40.241870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:41:46.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306325+0000","last_change":"2024-01-30T08:08:42.274162+0000","last_active":"2024-01-30T08:08:47.306325+0000","last_peered":"2024-01-30T08:08:47.306325+0000","last_clean":"2024-01-30T08:08:47.306325+0000","last_became_active":"2024-01-30T08:08:42.273902+0000","last_became_peered":"2024-01-30T08:08:42.273902+0000","last_unstale":"2024-01-30T08:08:47.306325+0000","last_undegraded":"2024-01-30T08:08:47.306325+0000","last_fullsized":"2024-01-30T08:08:47.306325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:53.709299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305982+0000","last_change":"2024-01-30T08:08:46.314987+0000","last_active":"2024-01-30T08:08:47.305982+0000","last_peered":"2024-01-30T08:08:47.305982+0000","last_clean":"2024-01-30T08:08:47.305982+0000","last_became_active":"2024-01-30T08:08:46.314692+0000","last_became_peered":"2024-01-30T08:08:46.314692+0000","last_unstale":"2024-01-30T08:08:47.305982+0000","last_undegraded":"2024-01-30T08:08:47.305982+0000","last_fullsized":"2024-01-30T08:08:47.305982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:45.277063+0000","last_clean_scrub_stamp":"2024-01-30T08:08:45.277063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:49:27.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305354+0000","last_change":"2024-01-30T08:08:42.282230+0000","last_active":"2024-01-30T08:08:47.305354+0000","last_peered":"2024-01-30T08:08:47.305354+0000","last_clean":"2024-01-30T08:08:47.305354+0000","last_became_active":"2024-01-30T08:08:42.281857+0000","last_became_peered":"2024-01-30T08:08:42.281857+0000","last_unstale":"2024-01-30T08:08:47.305354+0000","last_undegraded":"2024-01-30T08:08:47.305354+0000","last_fullsized":"2024-01-30T08:08:47.305354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:19:37.564318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789483+0000","last_change":"2024-01-30T08:08:42.272404+0000","last_active":"2024-01-30T08:08:47.789483+0000","last_peered":"2024-01-30T08:08:47.789483+0000","last_clean":"2024-01-30T08:08:47.789483+0000","last_became_active":"2024-01-30T08:08:42.272041+0000","last_became_peered":"2024-01-30T08:08:42.272041+0000","last_unstale":"2024-01-30T08:08:47.789483+0000","last_undegraded":"2024-01-30T08:08:47.789483+0000","last_fullsized":"2024-01-30T08:08:47.789483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:51:50.188325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062098+0000","last_change":"2024-01-30T08:08:42.288942+0000","last_active":"2024-01-30T08:08:49.062098+0000","last_peered":"2024-01-30T08:08:49.062098+0000","last_clean":"2024-01-30T08:08:49.062098+0000","last_became_active":"2024-01-30T08:08:42.288707+0000","last_became_peered":"2024-01-30T08:08:42.288707+0000","last_unstale":"2024-01-30T08:08:49.062098+0000","last_undegraded":"2024-01-30T08:08:49.062098+0000","last_fullsized":"2024-01-30T08:08:49.062098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:51:37.937923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062259+0000","last_change":"2024-01-30T08:08:42.286293+0000","last_active":"2024-01-30T08:08:49.062259+0000","last_peered":"2024-01-30T08:08:49.062259+0000","last_clean":"2024-01-30T08:08:49.062259+0000","last_became_active":"2024-01-30T08:08:42.285945+0000","last_became_peered":"2024-01-30T08:08:42.285945+0000","last_unstale":"2024-01-30T08:08:49.062259+0000","last_undegraded":"2024-01-30T08:08:49.062259+0000","last_fullsized":"2024-01-30T08:08:49.062259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:54:46.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306359+0000","last_change":"2024-01-30T08:08:42.288572+0000","last_active":"2024-01-30T08:08:47.306359+0000","last_peered":"2024-01-30T08:08:47.306359+0000","last_clean":"2024-01-30T08:08:47.306359+0000","last_became_active":"2024-01-30T08:08:42.288269+0000","last_became_peered":"2024-01-30T08:08:42.288269+0000","last_unstale":"2024-01-30T08:08:47.306359+0000","last_undegraded":"2024-01-30T08:08:47.306359+0000","last_fullsized":"2024-01-30T08:08:47.306359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:00:01.086946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063564+0000","last_change":"2024-01-30T08:08:42.266640+0000","last_active":"2024-01-30T08:08:49.063564+0000","last_peered":"2024-01-30T08:08:49.063564+0000","last_clean":"2024-01-30T08:08:49.063564+0000","last_became_active":"2024-01-30T08:08:42.266344+0000","last_became_peered":"2024-01-30T08:08:42.266344+0000","last_unstale":"2024-01-30T08:08:49.063564+0000","last_undegraded":"2024-01-30T08:08:49.063564+0000","last_fullsized":"2024-01-30T08:08:49.063564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307432+0000","last_change":"2024-01-30T08:08:42.292452+0000","last_active":"2024-01-30T08:08:47.307432+0000","last_peered":"2024-01-30T08:08:47.307432+0000","last_clean":"2024-01-30T08:08:47.307432+0000","last_became_active":"2024-01-30T08:08:42.291993+0000","last_became_peered":"2024-01-30T08:08:42.291993+0000","last_unstale":"2024-01-30T08:08:47.307432+0000","last_undegraded":"2024-01-30T08:08:47.307432+0000","last_fullsized":"2024-01-30T08:08:47.307432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:08:04.051649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306131+0000","last_change":"2024-01-30T08:08:42.284303+0000","last_active":"2024-01-30T08:08:47.306131+0000","last_peered":"2024-01-30T08:08:47.306131+0000","last_clean":"2024-01-30T08:08:47.306131+0000","last_became_active":"2024-01-30T08:08:42.283629+0000","last_became_peered":"2024-01-30T08:08:42.283629+0000","last_unstale":"2024-01-30T08:08:47.306131+0000","last_undegraded":"2024-01-30T08:08:47.306131+0000","last_fullsized":"2024-01-30T08:08:47.306131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060891+0000","last_change":"2024-01-30T08:08:42.289085+0000","last_active":"2024-01-30T08:08:49.060891+0000","last_peered":"2024-01-30T08:08:49.060891+0000","last_clean":"2024-01-30T08:08:49.060891+0000","last_became_active":"2024-01-30T08:08:42.288819+0000","last_became_peered":"2024-01-30T08:08:42.288819+0000","last_unstale":"2024-01-30T08:08:49.060891+0000","last_undegraded":"2024-01-30T08:08:49.060891+0000","last_fullsized":"2024-01-30T08:08:49.060891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:25:34.589630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305290+0000","last_change":"2024-01-30T08:08:42.285165+0000","last_active":"2024-01-30T08:08:47.305290+0000","last_peered":"2024-01-30T08:08:47.305290+0000","last_clean":"2024-01-30T08:08:47.305290+0000","last_became_active":"2024-01-30T08:08:42.284761+0000","last_became_peered":"2024-01-30T08:08:42.284761+0000","last_unstale":"2024-01-30T08:08:47.305290+0000","last_undegraded":"2024-01-30T08:08:47.305290+0000","last_fullsized":"2024-01-30T08:08:47.305290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061938+0000","last_change":"2024-01-30T08:08:42.284896+0000","last_active":"2024-01-30T08:08:49.061938+0000","last_peered":"2024-01-30T08:08:49.061938+0000","last_clean":"2024-01-30T08:08:49.061938+0000","last_became_active":"2024-01-30T08:08:42.284608+0000","last_became_peered":"2024-01-30T08:08:42.284608+0000","last_unstale":"2024-01-30T08:08:49.061938+0000","last_undegraded":"2024-01-30T08:08:49.061938+0000","last_fullsized":"2024-01-30T08:08:49.061938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:02:49.552868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062131+0000","last_change":"2024-01-30T08:08:42.287556+0000","last_active":"2024-01-30T08:08:49.062131+0000","last_peered":"2024-01-30T08:08:49.062131+0000","last_clean":"2024-01-30T08:08:49.062131+0000","last_became_active":"2024-01-30T08:08:42.287220+0000","last_became_peered":"2024-01-30T08:08:42.287220+0000","last_unstale":"2024-01-30T08:08:49.062131+0000","last_undegraded":"2024-01-30T08:08:49.062131+0000","last_fullsized":"2024-01-30T08:08:49.062131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:26:23.553412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306921+0000","last_change":"2024-01-30T08:08:42.279526+0000","last_active":"2024-01-30T08:08:47.306921+0000","last_peered":"2024-01-30T08:08:47.306921+0000","last_clean":"2024-01-30T08:08:47.306921+0000","last_became_active":"2024-01-30T08:08:42.279278+0000","last_became_peered":"2024-01-30T08:08:42.279278+0000","last_unstale":"2024-01-30T08:08:47.306921+0000","last_undegraded":"2024-01-30T08:08:47.306921+0000","last_fullsized":"2024-01-30T08:08:47.306921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:08.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061442+0000","last_change":"2024-01-30T08:08:42.289284+0000","last_active":"2024-01-30T08:08:49.061442+0000","last_peered":"2024-01-30T08:08:49.061442+0000","last_clean":"2024-01-30T08:08:49.061442+0000","last_became_active":"2024-01-30T08:08:42.289033+0000","last_became_peered":"2024-01-30T08:08:42.289033+0000","last_unstale":"2024-01-30T08:08:49.061442+0000","last_undegraded":"2024-01-30T08:08:49.061442+0000","last_fullsized":"2024-01-30T08:08:49.061442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:57:50.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.789921+0000","last_change":"2024-01-30T08:08:42.275565+0000","last_active":"2024-01-30T08:08:47.789921+0000","last_peered":"2024-01-30T08:08:47.789921+0000","last_clean":"2024-01-30T08:08:47.789921+0000","last_became_active":"2024-01-30T08:08:42.275279+0000","last_became_peered":"2024-01-30T08:08:42.275279+0000","last_unstale":"2024-01-30T08:08:47.789921+0000","last_undegraded":"2024-01-30T08:08:47.789921+0000","last_fullsized":"2024-01-30T08:08:47.789921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:19.520174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062744+0000","last_change":"2024-01-30T08:08:42.300035+0000","last_active":"2024-01-30T08:08:49.062744+0000","last_peered":"2024-01-30T08:08:49.062744+0000","last_clean":"2024-01-30T08:08:49.062744+0000","last_became_active":"2024-01-30T08:08:42.299735+0000","last_became_peered":"2024-01-30T08:08:42.299735+0000","last_unstale":"2024-01-30T08:08:49.062744+0000","last_undegraded":"2024-01-30T08:08:49.062744+0000","last_fullsized":"2024-01-30T08:08:49.062744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:16:58.027734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060796+0000","last_change":"2024-01-30T08:08:42.274180+0000","last_active":"2024-01-30T08:08:49.060796+0000","last_peered":"2024-01-30T08:08:49.060796+0000","last_clean":"2024-01-30T08:08:49.060796+0000","last_became_active":"2024-01-30T08:08:42.273798+0000","last_became_peered":"2024-01-30T08:08:42.273798+0000","last_unstale":"2024-01-30T08:08:49.060796+0000","last_undegraded":"2024-01-30T08:08:49.060796+0000","last_fullsized":"2024-01-30T08:08:49.060796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:25:18.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062221+0000","last_change":"2024-01-30T08:08:42.272239+0000","last_active":"2024-01-30T08:08:49.062221+0000","last_peered":"2024-01-30T08:08:49.062221+0000","last_clean":"2024-01-30T08:08:49.062221+0000","last_became_active":"2024-01-30T08:08:42.270429+0000","last_became_peered":"2024-01-30T08:08:42.270429+0000","last_unstale":"2024-01-30T08:08:49.062221+0000","last_undegraded":"2024-01-30T08:08:49.062221+0000","last_fullsized":"2024-01-30T08:08:49.062221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061945+0000","last_change":"2024-01-30T08:08:42.279383+0000","last_active":"2024-01-30T08:08:49.061945+0000","last_peered":"2024-01-30T08:08:49.061945+0000","last_clean":"2024-01-30T08:08:49.061945+0000","last_became_active":"2024-01-30T08:08:42.279081+0000","last_became_peered":"2024-01-30T08:08:42.279081+0000","last_unstale":"2024-01-30T08:08:49.061945+0000","last_undegraded":"2024-01-30T08:08:49.061945+0000","last_fullsized":"2024-01-30T08:08:49.061945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:11:44.572777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305417+0000","last_change":"2024-01-30T08:08:42.277550+0000","last_active":"2024-01-30T08:08:47.305417+0000","last_peered":"2024-01-30T08:08:47.305417+0000","last_clean":"2024-01-30T08:08:47.305417+0000","last_became_active":"2024-01-30T08:08:42.276237+0000","last_became_peered":"2024-01-30T08:08:42.276237+0000","last_unstale":"2024-01-30T08:08:47.305417+0000","last_undegraded":"2024-01-30T08:08:47.305417+0000","last_fullsized":"2024-01-30T08:08:47.305417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:40:25.183069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.306274+0000","last_change":"2024-01-30T08:08:42.282127+0000","last_active":"2024-01-30T08:08:47.306274+0000","last_peered":"2024-01-30T08:08:47.306274+0000","last_clean":"2024-01-30T08:08:47.306274+0000","last_became_active":"2024-01-30T08:08:42.281546+0000","last_became_peered":"2024-01-30T08:08:42.281546+0000","last_unstale":"2024-01-30T08:08:47.306274+0000","last_undegraded":"2024-01-30T08:08:47.306274+0000","last_fullsized":"2024-01-30T08:08:47.306274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:58:48.497646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307235+0000","last_change":"2024-01-30T08:08:42.280580+0000","last_active":"2024-01-30T08:08:47.307235+0000","last_peered":"2024-01-30T08:08:47.307235+0000","last_clean":"2024-01-30T08:08:47.307235+0000","last_became_active":"2024-01-30T08:08:42.280215+0000","last_became_peered":"2024-01-30T08:08:42.280215+0000","last_unstale":"2024-01-30T08:08:47.307235+0000","last_undegraded":"2024-01-30T08:08:47.307235+0000","last_fullsized":"2024-01-30T08:08:47.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:02:54.000350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.307392+0000","last_change":"2024-01-30T08:08:42.274307+0000","last_active":"2024-01-30T08:08:47.307392+0000","last_peered":"2024-01-30T08:08:47.307392+0000","last_clean":"2024-01-30T08:08:47.307392+0000","last_became_active":"2024-01-30T08:08:42.273219+0000","last_became_peered":"2024-01-30T08:08:42.273219+0000","last_unstale":"2024-01-30T08:08:47.307392+0000","last_undegraded":"2024-01-30T08:08:47.307392+0000","last_fullsized":"2024-01-30T08:08:47.307392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:16:47.051895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061291+0000","last_change":"2024-01-30T08:08:42.298549+0000","last_active":"2024-01-30T08:08:49.061291+0000","last_peered":"2024-01-30T08:08:49.061291+0000","last_clean":"2024-01-30T08:08:49.061291+0000","last_became_active":"2024-01-30T08:08:42.298085+0000","last_became_peered":"2024-01-30T08:08:42.298085+0000","last_unstale":"2024-01-30T08:08:49.061291+0000","last_undegraded":"2024-01-30T08:08:49.061291+0000","last_fullsized":"2024-01-30T08:08:49.061291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:03:04.518076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:47.305168+0000","last_change":"2024-01-30T08:08:42.278935+0000","last_active":"2024-01-30T08:08:47.305168+0000","last_peered":"2024-01-30T08:08:47.305168+0000","last_clean":"2024-01-30T08:08:47.305168+0000","last_became_active":"2024-01-30T08:08:42.278462+0000","last_became_peered":"2024-01-30T08:08:42.278462+0000","last_unstale":"2024-01-30T08:08:47.305168+0000","last_undegraded":"2024-01-30T08:08:47.305168+0000","last_fullsized":"2024-01-30T08:08:47.305168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:31:20.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.060808+0000","last_change":"2024-01-30T08:08:42.287564+0000","last_active":"2024-01-30T08:08:49.060808+0000","last_peered":"2024-01-30T08:08:49.060808+0000","last_clean":"2024-01-30T08:08:49.060808+0000","last_became_active":"2024-01-30T08:08:42.287236+0000","last_became_peered":"2024-01-30T08:08:42.287236+0000","last_unstale":"2024-01-30T08:08:49.060808+0000","last_undegraded":"2024-01-30T08:08:49.060808+0000","last_fullsized":"2024-01-30T08:08:49.060808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:51.057924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061935+0000","last_change":"2024-01-30T08:08:42.273849+0000","last_active":"2024-01-30T08:08:49.061935+0000","last_peered":"2024-01-30T08:08:49.061935+0000","last_clean":"2024-01-30T08:08:49.061935+0000","last_became_active":"2024-01-30T08:08:42.273535+0000","last_became_peered":"2024-01-30T08:08:42.273535+0000","last_unstale":"2024-01-30T08:08:49.061935+0000","last_undegraded":"2024-01-30T08:08:49.061935+0000","last_fullsized":"2024-01-30T08:08:49.061935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T20:05:19.851128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061350+0000","last_change":"2024-01-30T08:08:42.290524+0000","last_active":"2024-01-30T08:08:49.061350+0000","last_peered":"2024-01-30T08:08:49.061350+0000","last_clean":"2024-01-30T08:08:49.061350+0000","last_became_active":"2024-01-30T08:08:42.290271+0000","last_became_peered":"2024-01-30T08:08:42.290271+0000","last_unstale":"2024-01-30T08:08:49.061350+0000","last_undegraded":"2024-01-30T08:08:49.061350+0000","last_fullsized":"2024-01-30T08:08:49.061350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:09:19.978105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062197+0000","last_change":"2024-01-30T08:08:42.291250+0000","last_active":"2024-01-30T08:08:49.062197+0000","last_peered":"2024-01-30T08:08:49.062197+0000","last_clean":"2024-01-30T08:08:49.062197+0000","last_became_active":"2024-01-30T08:08:42.290996+0000","last_became_peered":"2024-01-30T08:08:42.290996+0000","last_unstale":"2024-01-30T08:08:49.062197+0000","last_undegraded":"2024-01-30T08:08:49.062197+0000","last_fullsized":"2024-01-30T08:08:49.062197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:44:25.994167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.062296+0000","last_change":"2024-01-30T08:08:42.274737+0000","last_active":"2024-01-30T08:08:49.062296+0000","last_peered":"2024-01-30T08:08:49.062296+0000","last_clean":"2024-01-30T08:08:49.062296+0000","last_became_active":"2024-01-30T08:08:42.274400+0000","last_became_peered":"2024-01-30T08:08:42.274400+0000","last_unstale":"2024-01-30T08:08:49.062296+0000","last_undegraded":"2024-01-30T08:08:49.062296+0000","last_fullsized":"2024-01-30T08:08:49.062296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:30:39.631576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.063741+0000","last_change":"2024-01-30T08:08:42.279330+0000","last_active":"2024-01-30T08:08:49.063741+0000","last_peered":"2024-01-30T08:08:49.063741+0000","last_clean":"2024-01-30T08:08:49.063741+0000","last_became_active":"2024-01-30T08:08:42.279149+0000","last_became_peered":"2024-01-30T08:08:42.279149+0000","last_unstale":"2024-01-30T08:08:49.063741+0000","last_undegraded":"2024-01-30T08:08:49.063741+0000","last_fullsized":"2024-01-30T08:08:49.063741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:22:11.151643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-30T08:08:49.061155+0000","last_change":"2024-01-30T08:08:42.293738+0000","last_active":"2024-01-30T08:08:49.061155+0000","last_peered":"2024-01-30T08:08:49.061155+0000","last_clean":"2024-01-30T08:08:49.061155+0000","last_became_active":"2024-01-30T08:08:42.293398+0000","last_became_peered":"2024-01-30T08:08:42.293398+0000","last_unstale":"2024-01-30T08:08:49.061155+0000","last_undegraded":"2024-01-30T08:08:49.061155+0000","last_fullsized":"2024-01-30T08:08:49.061155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:41.248084+0000","last_clean_scrub_stamp":"2024-01-30T08:08:41.248084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:43.542616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":694227,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9550000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9830000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2629999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1139999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0780000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":694283,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:09:12.367 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-30T08:09:12.367 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-30T08:09:12.368 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-30T08:09:12.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-30T08:09:12.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.539+0000 7f1445600640 1 Processor -- start 2024-01-30T08:09:12.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f1445600640 1 -- start start 2024-01-30T08:09:12.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f1445600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144006de40 0x7f144006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f1445600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1440153390 0x7f14400a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f1445600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14400c4310 0x7f1440155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f1445600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1440152f00 con 0x7f1440153390 2024-01-30T08:09:12.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f1445600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14401525f0 con 0x7f14400c4310 2024-01-30T08:09:12.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f1445600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400a7680 con 0x7f144006de40 2024-01-30T08:09:12.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1440153390 0x7f14400a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1440153390 0x7f14400a6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49720/0 (socket says 172.21.15.50:49720) 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 -- 172.21.15.50:0/854374168 learned_addr learned my addr 172.21.15.50:0/854374168 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143f400640 1 --2- 172.21.15.50:0/854374168 >> v2:172.21.15.125:3300/0 conn(0x7f14400c4310 0x7f1440155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143ea00640 1 --2- 172.21.15.50:0/854374168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144006de40 0x7f144006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 -- 172.21.15.50:0/854374168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144006de40 msgr2=0x7f144006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 --2- 172.21.15.50:0/854374168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144006de40 0x7f144006e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 -- 172.21.15.50:0/854374168 >> v2:172.21.15.125:3300/0 conn(0x7f14400c4310 msgr2=0x7f1440155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 --2- 172.21.15.50:0/854374168 >> v2:172.21.15.125:3300/0 conn(0x7f14400c4310 0x7f1440155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143e000640 1 -- 172.21.15.50:0/854374168 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14401528b0 con 0x7f1440153390 2024-01-30T08:09:12.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.543+0000 7f143ea00640 1 --2- 172.21.15.50:0/854374168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144006de40 0x7f144006e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:12.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f143e000640 1 --2- 172.21.15.50:0/854374168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440153390 0x7f14400a6de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f144004f120 tx=0x7f142801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97847ae0172e8bb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f143d600640 1 -- 172.21.15.50:0/854374168 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280ab600 con 0x7f1440153390 2024-01-30T08:09:12.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f143d600640 1 -- 172.21.15.50:0/854374168 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280a7050 con 0x7f1440153390 2024-01-30T08:09:12.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f143d600640 1 -- 172.21.15.50:0/854374168 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280ab980 con 0x7f1440153390 2024-01-30T08:09:12.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 -- 172.21.15.50:0/854374168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440153390 msgr2=0x7f14400a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 --2- 172.21.15.50:0/854374168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440153390 0x7f14400a6de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f144004f120 tx=0x7f142801c3b0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 -- 172.21.15.50:0/854374168 shutdown_connections 2024-01-30T08:09:12.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 --2- 172.21.15.50:0/854374168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440153390 0x7f14400a6de0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 --2- 172.21.15.50:0/854374168 >> v2:172.21.15.125:3300/0 conn(0x7f14400c4310 0x7f1440155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 --2- 172.21.15.50:0/854374168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f144006de40 0x7f144006e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 -- 172.21.15.50:0/854374168 >> 172.21.15.50:0/854374168 conn(0x7f14400c4830 msgr2=0x7f14400c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:12.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 -- 172.21.15.50:0/854374168 shutdown_connections 2024-01-30T08:09:12.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 -- 172.21.15.50:0/854374168 wait complete. 2024-01-30T08:09:12.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.547+0000 7f1445600640 1 Processor -- start 2024-01-30T08:09:12.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 -- start start 2024-01-30T08:09:12.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144006de40 0x7f14401f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14400c4310 0x7f144014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1440153390 0x7f144014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144014bb50 con 0x7f14400c4310 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400ab910 con 0x7f144006de40 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400ab420 con 0x7f1440153390 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14400c4310 0x7f144014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14400c4310 0x7f144014b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49732/0 (socket says 172.21.15.50:49732) 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 -- 172.21.15.50:0/2094962218 learned_addr learned my addr 172.21.15.50:0/2094962218 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143f400640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1440153390 0x7f144014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143ea00640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144006de40 0x7f14401f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 -- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1440153390 msgr2=0x7f144014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1440153390 0x7f144014b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 -- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144006de40 msgr2=0x7f14401f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144006de40 0x7f14401f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 -- 172.21.15.50:0/2094962218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280094d0 con 0x7f14400c4310 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f143e000640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14400c4310 0x7f144014b0d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f14280ae040 tx=0x7f1428019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1436a00640 1 -- 172.21.15.50:0/2094962218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280b4620 con 0x7f14400c4310 2024-01-30T08:09:12.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1436a00640 1 -- 172.21.15.50:0/2094962218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280b4780 con 0x7f14400c4310 2024-01-30T08:09:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144014be50 con 0x7f14400c4310 2024-01-30T08:09:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1436a00640 1 -- 172.21.15.50:0/2094962218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280b4b30 con 0x7f14400c4310 2024-01-30T08:09:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14400aa6e0 con 0x7f14400c4310 2024-01-30T08:09:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.551+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440074a20 con 0x7f14400c4310 2024-01-30T08:09:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.555+0000 7f1436a00640 1 -- 172.21.15.50:0/2094962218 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f14280b2070 con 0x7f14400c4310 2024-01-30T08:09:12.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.555+0000 7f1436a00640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1418066500 0x7f14180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.555+0000 7f1436a00640 1 -- 172.21.15.50:0/2094962218 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f142811dd50 con 0x7f14400c4310 2024-01-30T08:09:12.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.555+0000 7f143ea00640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1418066500 0x7f14180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.555+0000 7f143ea00640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1418066500 0x7f14180689c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1430006b20 tx=0x7f1430008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.559+0000 7f1436a00640 1 -- 172.21.15.50:0/2094962218 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f14280eacf0 con 0x7f14400c4310 2024-01-30T08:09:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.747+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f144006f050 con 0x7f14400c4310 2024-01-30T08:09:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.747+0000 7f1436a00640 1 -- 172.21.15.50:0/2094962218 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f14280b0040 con 0x7f14400c4310 2024-01-30T08:09:12.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:12.752 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1418066500 msgr2=0x7f14180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1418066500 0x7f14180689c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1430006b20 tx=0x7f1430008040 comp rx=0 tx=0).stop 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14400c4310 msgr2=0x7f144014b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14400c4310 0x7f144014b0d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f14280ae040 tx=0x7f1428019150 comp rx=0 tx=0).stop 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 shutdown_connections 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1418066500 0x7f14180689c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1440153390 0x7f144014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14400c4310 0x7f144014b0d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 --2- 172.21.15.50:0/2094962218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f144006de40 0x7f14401f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 >> 172.21.15.50:0/2094962218 conn(0x7f14400c4830 msgr2=0x7f14400c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 shutdown_connections 2024-01-30T08:09:12.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.751+0000 7f1445600640 1 -- 172.21.15.50:0/2094962218 wait complete. 2024-01-30T08:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-30T08:09:12.774 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.911+0000 7f0bf5000640 1 Processor -- start 2024-01-30T08:09:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.911+0000 7f0bf5000640 1 -- start start 2024-01-30T08:09:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bf5000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0bf00c4760 0x7f0bf006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bf5000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf00a8cf0 con 0x7f0bf00c1840 2024-01-30T08:09:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bf5000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf0072a30 con 0x7f0bf00c5650 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bf5000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf00a8f40 con 0x7f0bf00c4760 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bede00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0bf00c1840 0x7f0bf00a4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37788/0 (socket says 172.21.15.50:37788) 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bede00640 1 -- 172.21.15.50:0/1501594066 learned_addr learned my addr 172.21.15.50:0/1501594066 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bee800640 1 --2- 172.21.15.50:0/1501594066 >> v2:172.21.15.125:3300/0 conn(0x7f0bf00c4760 0x7f0bf006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497845895 0 0) 0x7f0bf00a8cf0 con 0x7f0bf00c1840 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd0005740 con 0x7f0bf00c1840 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051445905 0 0) 0x7f0bf0072a30 con 0x7f0bf00c5650 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf00a8cf0 con 0x7f0bf00c5650 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bee800640 1 -- 172.21.15.50:0/1501594066 >> v1:172.21.15.125:6789/0 conn(0x7f0bf00c5650 legacy=0x7f0bf006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bee800640 1 -- 172.21.15.50:0/1501594066 >> v1:172.21.15.50:6789/0 conn(0x7f0bf00c1840 legacy=0x7f0bf00a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2922419681 0 0) 0x7f0bd0005740 con 0x7f0bf00c1840 2024-01-30T08:09:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.915+0000 7f0bee800640 1 -- 172.21.15.50:0/1501594066 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0072cd0 con 0x7f0bf00c4760 2024-01-30T08:09:12.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bee800640 1 --2- 172.21.15.50:0/1501594066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 0x7f0bf006d610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009d90 tx=0x7f0be801c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872153e49d9283b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be0001680 con 0x7f0bf00c4760 2024-01-30T08:09:12.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80a5540 con 0x7f0bf00c4760 2024-01-30T08:09:12.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0beca00640 1 -- 172.21.15.50:0/1501594066 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80a58d0 con 0x7f0bf00c4760 2024-01-30T08:09:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 -- 172.21.15.50:0/1501594066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 msgr2=0x7f0bf006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 --2- 172.21.15.50:0/1501594066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 0x7f0bf006d610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009d90 tx=0x7f0be801c7e0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 -- 172.21.15.50:0/1501594066 shutdown_connections 2024-01-30T08:09:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 --2- 172.21.15.50:0/1501594066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 0x7f0bf006d610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 -- 172.21.15.50:0/1501594066 >> 172.21.15.50:0/1501594066 conn(0x7f0bf00c5b50 msgr2=0x7f0bf00c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 -- 172.21.15.50:0/1501594066 shutdown_connections 2024-01-30T08:09:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 -- 172.21.15.50:0/1501594066 wait complete. 2024-01-30T08:09:12.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 Processor -- start 2024-01-30T08:09:12.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.919+0000 7f0bf5000640 1 -- start start 2024-01-30T08:09:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bf00c1840 0x7f0bf01594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 0x7f0bf00c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf00c5650 0x7f0bf01ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0099a80 con 0x7f0bf00c5650 2024-01-30T08:09:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01f0fa0 con 0x7f0bf00c4760 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01f1280 con 0x7f0bf00c1840 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf00c5650 0x7f0bf01ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf00c5650 0x7f0bf01ecf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49746/0 (socket says 172.21.15.50:49746) 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 -- 172.21.15.50:0/3247957472 learned_addr learned my addr 172.21.15.50:0/3247957472 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bede00640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bf00c1840 0x7f0bf01594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 -- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bf00c1840 msgr2=0x7f0bf01594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bf00c1840 0x7f0bf01594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 -- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 msgr2=0x7f0bf00c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 0x7f0bf00c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 -- 172.21.15.50:0/3247957472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009a70 con 0x7f0bf00c5650 2024-01-30T08:09:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bee800640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf00c5650 0x7f0bf01ecf80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0be80b0040 tx=0x7f0be8019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0be6000640 1 -- 172.21.15.50:0/3247957472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8003ba0 con 0x7f0bf00c5650 2024-01-30T08:09:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0be6000640 1 -- 172.21.15.50:0/3247957472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8003d20 con 0x7f0bf00c5650 2024-01-30T08:09:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf00c63a0 con 0x7f0bf00c5650 2024-01-30T08:09:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0be6000640 1 -- 172.21.15.50:0/3247957472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004260 con 0x7f0bf00c5650 2024-01-30T08:09:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf0099d60 con 0x7f0bf00c5650 2024-01-30T08:09:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf00c3510 con 0x7f0bf00c5650 2024-01-30T08:09:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.923+0000 7f0be6000640 1 -- 172.21.15.50:0/3247957472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0be80043c0 con 0x7f0bf00c5650 2024-01-30T08:09:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.927+0000 7f0be6000640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0bc8066500 0x7f0bc80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.927+0000 7f0be6000640 1 -- 172.21.15.50:0/3247957472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0be811ef50 con 0x7f0bf00c5650 2024-01-30T08:09:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.927+0000 7f0bede00640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0bc8066500 0x7f0bc80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.927+0000 7f0bede00640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0bc8066500 0x7f0bc80689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0be0000fe0 tx=0x7f0be0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:12.931+0000 7f0be6000640 1 -- 172.21.15.50:0/3247957472 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0be80ebef0 con 0x7f0bf00c5650 2024-01-30T08:09:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.091+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bf01f1440 con 0x7f0bf00c5650 2024-01-30T08:09:13.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.091+0000 7f0be6000640 1 -- 172.21.15.50:0/3247957472 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f0bf01f1440 con 0x7f0bf00c5650 2024-01-30T08:09:13.095 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:13.095 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0bc8066500 msgr2=0x7f0bc80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0bc8066500 0x7f0bc80689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0be0000fe0 tx=0x7f0be0009040 comp rx=0 tx=0).stop 2024-01-30T08:09:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf00c5650 msgr2=0x7f0bf01ecf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf00c5650 0x7f0bf01ecf80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0be80b0040 tx=0x7f0be8019580 comp rx=0 tx=0).stop 2024-01-30T08:09:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 shutdown_connections 2024-01-30T08:09:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bf00c4760 0x7f0bf00c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0bc8066500 0x7f0bc80689c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bf00c5650 0x7f0bf01ecf80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 --2- 172.21.15.50:0/3247957472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bf00c1840 0x7f0bf01594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 >> 172.21.15.50:0/3247957472 conn(0x7f0bf00c5b50 msgr2=0x7f0bf00a57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 shutdown_connections 2024-01-30T08:09:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.095+0000 7f0bf5000640 1 -- 172.21.15.50:0/3247957472 wait complete. 2024-01-30T08:09:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:13.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:13.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.259+0000 7fbe4c800640 1 Processor -- start 2024-01-30T08:09:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.259+0000 7fbe4c800640 1 -- start start 2024-01-30T08:09:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe4c800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe440c50d0 0x7fbe44156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe4c800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c7ae0 0x7fbe441566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe4c800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe440c8a50 con 0x7fbe440c5c90 2024-01-30T08:09:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe4c800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe440c7070 con 0x7fbe440c50d0 2024-01-30T08:09:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe4c800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440c8d30 con 0x7fbe440c7ae0 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe49400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c7ae0 0x7fbe441566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe49e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe440c50d0 0x7fbe44156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe4a800640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbe440c5c90 0x7fbe440c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55176/0 (socket says 172.21.15.50:55176) 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe4a800640 1 -- 172.21.15.50:0/3638073034 learned_addr learned my addr 172.21.15.50:0/3638073034 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe48a00640 1 -- 172.21.15.50:0/3638073034 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163017830 0 0) 0x7fbe440c8a50 con 0x7fbe440c5c90 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe48a00640 1 -- 172.21.15.50:0/3638073034 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe24003530 con 0x7fbe440c5c90 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe49400640 1 -- 172.21.15.50:0/3638073034 >> v2:172.21.15.125:3300/0 conn(0x7fbe440c50d0 msgr2=0x7fbe44156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe49400640 1 --2- 172.21.15.50:0/3638073034 >> v2:172.21.15.125:3300/0 conn(0x7fbe440c50d0 0x7fbe44156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe49400640 1 -- 172.21.15.50:0/3638073034 >> v1:172.21.15.125:6789/0 conn(0x7fbe440c5c90 legacy=0x7fbe440c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe49400640 1 -- 172.21.15.50:0/3638073034 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440c66d0 con 0x7fbe440c7ae0 2024-01-30T08:09:13.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.263+0000 7fbe49e00640 1 --2- 172.21.15.50:0/3638073034 >> v2:172.21.15.125:3300/0 conn(0x7fbe440c50d0 0x7fbe44156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:13.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe49400640 1 --2- 172.21.15.50:0/3638073034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c7ae0 0x7fbe441566d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0097c0 tx=0x7fbe2c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379953ef88468e0f server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe48a00640 1 -- 172.21.15.50:0/3638073034 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c0ac620 con 0x7fbe440c7ae0 2024-01-30T08:09:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe48a00640 1 -- 172.21.15.50:0/3638073034 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c0ac780 con 0x7fbe440c7ae0 2024-01-30T08:09:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe48a00640 1 -- 172.21.15.50:0/3638073034 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c0acb10 con 0x7fbe440c7ae0 2024-01-30T08:09:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 -- 172.21.15.50:0/3638073034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c7ae0 msgr2=0x7fbe441566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 --2- 172.21.15.50:0/3638073034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c7ae0 0x7fbe441566d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0097c0 tx=0x7fbe2c01c3c0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 -- 172.21.15.50:0/3638073034 shutdown_connections 2024-01-30T08:09:13.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 --2- 172.21.15.50:0/3638073034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c7ae0 0x7fbe441566d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 --2- 172.21.15.50:0/3638073034 >> v2:172.21.15.125:3300/0 conn(0x7fbe440c50d0 0x7fbe44156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 -- 172.21.15.50:0/3638073034 >> 172.21.15.50:0/3638073034 conn(0x7fbe440727c0 msgr2=0x7fbe4406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:13.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 -- 172.21.15.50:0/3638073034 shutdown_connections 2024-01-30T08:09:13.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 -- 172.21.15.50:0/3638073034 wait complete. 2024-01-30T08:09:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 Processor -- start 2024-01-30T08:09:13.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.267+0000 7fbe4c800640 1 -- start start 2024-01-30T08:09:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c50d0 0x7fbe4414b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe440c5c90 0x7fbe4414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe440c7ae0 0x7fbe4414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440ab470 con 0x7fbe440c7ae0 2024-01-30T08:09:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4414c510 con 0x7fbe440c5c90 2024-01-30T08:09:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440aaaf0 con 0x7fbe440c50d0 2024-01-30T08:09:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe440c7ae0 0x7fbe4414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c50d0 0x7fbe4414b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe440c5c90 0x7fbe4414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c50d0 0x7fbe4414b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56292/0 (socket says 172.21.15.50:56292) 2024-01-30T08:09:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 -- 172.21.15.50:0/1579248346 learned_addr learned my addr 172.21.15.50:0/1579248346 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe440c7ae0 0x7fbe4414d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49752/0 (socket says 172.21.15.50:49752) 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 -- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe440c5c90 msgr2=0x7fbe4414d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe440c5c90 0x7fbe4414d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 -- 172.21.15.50:0/1579248346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe440c7ae0 msgr2=0x7fbe4414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe440c7ae0 0x7fbe4414d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 -- 172.21.15.50:0/1579248346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34009420 con 0x7fbe440c50d0 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe49e00640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c50d0 0x7fbe4414b7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400ebe0 tx=0x7fbe3400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe42000640 1 -- 172.21.15.50:0/1579248346 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400eee0 con 0x7fbe440c50d0 2024-01-30T08:09:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe42000640 1 -- 172.21.15.50:0/1579248346 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400cc30 con 0x7fbe440c50d0 2024-01-30T08:09:13.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c009420 con 0x7fbe440c50d0 2024-01-30T08:09:13.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe440aadb0 con 0x7fbe440c50d0 2024-01-30T08:09:13.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe42000640 1 -- 172.21.15.50:0/1579248346 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34013470 con 0x7fbe440c50d0 2024-01-30T08:09:13.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.271+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe140052a0 con 0x7fbe440c50d0 2024-01-30T08:09:13.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.275+0000 7fbe42000640 1 -- 172.21.15.50:0/1579248346 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbe340135d0 con 0x7fbe440c50d0 2024-01-30T08:09:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.275+0000 7fbe42000640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbe1c066530 0x7fbe1c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.275+0000 7fbe42000640 1 -- 172.21.15.50:0/1579248346 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe34084760 con 0x7fbe440c50d0 2024-01-30T08:09:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.275+0000 7fbe49400640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbe1c066530 0x7fbe1c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.275+0000 7fbe49400640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbe1c066530 0x7fbe1c0689f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0ae000 tx=0x7fbe2c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.279+0000 7fbe42000640 1 -- 172.21.15.50:0/1579248346 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbe340517b0 con 0x7fbe440c50d0 2024-01-30T08:09:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.439+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe14005ad0 con 0x7fbe440c50d0 2024-01-30T08:09:13.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.439+0000 7fbe42000640 1 -- 172.21.15.50:0/1579248346 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe34054dd0 con 0x7fbe440c50d0 2024-01-30T08:09:13.443 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbe1c066530 msgr2=0x7fbe1c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbe1c066530 0x7fbe1c0689f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0ae000 tx=0x7fbe2c0a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c50d0 msgr2=0x7fbe4414b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c50d0 0x7fbe4414b7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400ebe0 tx=0x7fbe3400c520 comp rx=0 tx=0).stop 2024-01-30T08:09:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 shutdown_connections 2024-01-30T08:09:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe440c5c90 0x7fbe4414d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbe1c066530 0x7fbe1c0689f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe440c7ae0 0x7fbe4414d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 --2- 172.21.15.50:0/1579248346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe440c50d0 0x7fbe4414b7e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 >> 172.21.15.50:0/1579248346 conn(0x7fbe440727c0 msgr2=0x7fbe440c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 shutdown_connections 2024-01-30T08:09:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.443+0000 7fbe4c800640 1 -- 172.21.15.50:0/1579248346 wait complete. 2024-01-30T08:09:13.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea86e00640 1 Processor -- start 2024-01-30T08:09:13.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea86e00640 1 -- start start 2024-01-30T08:09:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea86e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea8014fbf0 0x7fea80153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea86e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea800c54e0 con 0x7fea800c04b0 2024-01-30T08:09:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea86e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea80152bf0 con 0x7fea800a4da0 2024-01-30T08:09:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea86e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea80072d90 con 0x7fea8014fbf0 2024-01-30T08:09:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea84e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea800c04b0 0x7fea8006ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37796/0 (socket says 172.21.15.50:37796) 2024-01-30T08:09:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea84e00640 1 -- 172.21.15.50:0/219233346 learned_addr learned my addr 172.21.15.50:0/219233346 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea7fe00640 1 --2- 172.21.15.50:0/219233346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea8014fbf0 0x7fea80153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea7ea00640 1 -- 172.21.15.50:0/219233346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770736004 0 0) 0x7fea800c54e0 con 0x7fea800c04b0 2024-01-30T08:09:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea7fe00640 1 -- 172.21.15.50:0/219233346 >> v1:172.21.15.125:6789/0 conn(0x7fea800a4da0 legacy=0x7fea800c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea7fe00640 1 -- 172.21.15.50:0/219233346 >> v1:172.21.15.50:6789/0 conn(0x7fea800c04b0 legacy=0x7fea8006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.607+0000 7fea7fe00640 1 -- 172.21.15.50:0/219233346 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea801525e0 con 0x7fea8014fbf0 2024-01-30T08:09:13.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea7fe00640 1 --2- 172.21.15.50:0/219233346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea8014fbf0 0x7fea80153080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea70009770 tx=0x7fea7001c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a8200082f9c4ff server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea7ea00640 1 -- 172.21.15.50:0/219233346 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea700ab600 con 0x7fea8014fbf0 2024-01-30T08:09:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea7ea00640 1 -- 172.21.15.50:0/219233346 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea700a7050 con 0x7fea8014fbf0 2024-01-30T08:09:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea7ea00640 1 -- 172.21.15.50:0/219233346 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea700ab980 con 0x7fea8014fbf0 2024-01-30T08:09:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea86e00640 1 -- 172.21.15.50:0/219233346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea8014fbf0 msgr2=0x7fea80153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea86e00640 1 --2- 172.21.15.50:0/219233346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea8014fbf0 0x7fea80153080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea70009770 tx=0x7fea7001c260 comp rx=0 tx=0).stop 2024-01-30T08:09:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea86e00640 1 -- 172.21.15.50:0/219233346 shutdown_connections 2024-01-30T08:09:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea86e00640 1 --2- 172.21.15.50:0/219233346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea8014fbf0 0x7fea80153080 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea86e00640 1 -- 172.21.15.50:0/219233346 >> 172.21.15.50:0/219233346 conn(0x7fea800c5b30 msgr2=0x7fea800c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea86e00640 1 -- 172.21.15.50:0/219233346 shutdown_connections 2024-01-30T08:09:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.611+0000 7fea86e00640 1 -- 172.21.15.50:0/219233346 wait complete. 2024-01-30T08:09:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 Processor -- start 2024-01-30T08:09:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 -- start start 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a4da0 0x7fea80155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea800c04b0 0x7fea800a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea8014fbf0 0x7fea80154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801564d0 con 0x7fea800c04b0 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea800ab210 con 0x7fea8014fbf0 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea801562a0 con 0x7fea800a4da0 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea800c04b0 0x7fea800a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea800c04b0 0x7fea800a9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49758/0 (socket says 172.21.15.50:49758) 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 -- 172.21.15.50:0/3187235058 learned_addr learned my addr 172.21.15.50:0/3187235058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:13.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea84e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea8014fbf0 0x7fea80154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7fe00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a4da0 0x7fea80155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 -- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a4da0 msgr2=0x7fea80155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a4da0 0x7fea80155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 -- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea8014fbf0 msgr2=0x7fea80154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea8014fbf0 0x7fea80154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 -- 172.21.15.50:0/3187235058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea70009420 con 0x7fea800c04b0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea84e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea8014fbf0 0x7fea80154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7fe00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a4da0 0x7fea80155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea7f400640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea800c04b0 0x7fea800a9640 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fea6800c780 tx=0x7fea6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea77e00640 1 -- 172.21.15.50:0/3187235058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68005480 con 0x7fea800c04b0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea77e00640 1 -- 172.21.15.50:0/3187235058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6800ce30 con 0x7fea800c04b0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea77e00640 1 -- 172.21.15.50:0/3187235058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6800a880 con 0x7fea800c04b0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea800ab440 con 0x7fea800c04b0 2024-01-30T08:09:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea800aba00 con 0x7fea800c04b0 2024-01-30T08:09:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.615+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea80074a20 con 0x7fea800c04b0 2024-01-30T08:09:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.619+0000 7fea77e00640 1 -- 172.21.15.50:0/3187235058 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fea6800a9e0 con 0x7fea800c04b0 2024-01-30T08:09:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.619+0000 7fea77e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fea58066500 0x7fea580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.619+0000 7fea77e00640 1 -- 172.21.15.50:0/3187235058 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea68083990 con 0x7fea800c04b0 2024-01-30T08:09:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.619+0000 7fea7fe00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fea58066500 0x7fea580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.619+0000 7fea7fe00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fea58066500 0x7fea580689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea700ad000 tx=0x7fea70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.623+0000 7fea77e00640 1 -- 172.21.15.50:0/3187235058 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fea680508b0 con 0x7fea800c04b0 2024-01-30T08:09:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.779+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea800c2320 con 0x7fea800c04b0 2024-01-30T08:09:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.779+0000 7fea77e00640 1 -- 172.21.15.50:0/3187235058 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea68001360 con 0x7fea800c04b0 2024-01-30T08:09:13.783 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fea58066500 msgr2=0x7fea580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fea58066500 0x7fea580689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea700ad000 tx=0x7fea70008040 comp rx=0 tx=0).stop 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea800c04b0 msgr2=0x7fea800a9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea800c04b0 0x7fea800a9640 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fea6800c780 tx=0x7fea6800cc40 comp rx=0 tx=0).stop 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 shutdown_connections 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea8014fbf0 0x7fea80154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fea58066500 0x7fea580689c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea800c04b0 0x7fea800a9640 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 --2- 172.21.15.50:0/3187235058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea800a4da0 0x7fea80155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 >> 172.21.15.50:0/3187235058 conn(0x7fea800c5b30 msgr2=0x7fea80150970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 shutdown_connections 2024-01-30T08:09:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.783+0000 7fea86e00640 1 -- 172.21.15.50:0/3187235058 wait complete. 2024-01-30T08:09:13.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa1a0a00640 1 Processor -- start 2024-01-30T08:09:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa1a0a00640 1 -- start start 2024-01-30T08:09:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa1a0a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa198155500 0x7fa1980c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa1a0a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa19806f240 0x7fa19806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa1a0a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa198158b70 con 0x7fa1980c1200 2024-01-30T08:09:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa1a0a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa198157f60 con 0x7fa19806f240 2024-01-30T08:09:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa1a0a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa198158240 con 0x7fa198155500 2024-01-30T08:09:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19d600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa19806f240 0x7fa19806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19ea00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa1980c1200 0x7fa1980c1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37804/0 (socket says 172.21.15.50:37804) 2024-01-30T08:09:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19ea00640 1 -- 172.21.15.50:0/190173370 learned_addr learned my addr 172.21.15.50:0/190173370 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19e000640 1 --2- 172.21.15.50:0/190173370 >> v2:172.21.15.125:3300/0 conn(0x7fa198155500 0x7fa1980c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19d600640 1 -- 172.21.15.50:0/190173370 >> v2:172.21.15.125:3300/0 conn(0x7fa198155500 msgr2=0x7fa1980c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:13.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19d600640 1 --2- 172.21.15.50:0/190173370 >> v2:172.21.15.125:3300/0 conn(0x7fa198155500 0x7fa1980c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19cc00640 1 -- 172.21.15.50:0/190173370 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710658415 0 0) 0x7fa198158b70 con 0x7fa1980c1200 2024-01-30T08:09:13.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19d600640 1 -- 172.21.15.50:0/190173370 >> v1:172.21.15.50:6789/0 conn(0x7fa1980c1200 legacy=0x7fa1980c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19d600640 1 -- 172.21.15.50:0/190173370 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198158520 con 0x7fa19806f240 2024-01-30T08:09:13.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.947+0000 7fa19e000640 1 --2- 172.21.15.50:0/190173370 >> v2:172.21.15.125:3300/0 conn(0x7fa198155500 0x7fa1980c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:13.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa19d600640 1 --2- 172.21.15.50:0/190173370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19806f240 0x7fa19806f6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa1980aaaf0 tx=0x7fa18001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f5ea996624c136 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa19cc00640 1 -- 172.21.15.50:0/190173370 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800ab600 con 0x7fa19806f240 2024-01-30T08:09:13.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa19cc00640 1 -- 172.21.15.50:0/190173370 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1800a7050 con 0x7fa19806f240 2024-01-30T08:09:13.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa19cc00640 1 -- 172.21.15.50:0/190173370 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800ab980 con 0x7fa19806f240 2024-01-30T08:09:13.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 -- 172.21.15.50:0/190173370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19806f240 msgr2=0x7fa19806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/190173370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19806f240 0x7fa19806f6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa1980aaaf0 tx=0x7fa18001c310 comp rx=0 tx=0).stop 2024-01-30T08:09:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 -- 172.21.15.50:0/190173370 shutdown_connections 2024-01-30T08:09:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/190173370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19806f240 0x7fa19806f6d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/190173370 >> v2:172.21.15.125:3300/0 conn(0x7fa198155500 0x7fa1980c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 -- 172.21.15.50:0/190173370 >> 172.21.15.50:0/190173370 conn(0x7fa1980727c0 msgr2=0x7fa19806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 -- 172.21.15.50:0/190173370 shutdown_connections 2024-01-30T08:09:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.951+0000 7fa1a0a00640 1 -- 172.21.15.50:0/190173370 wait complete. 2024-01-30T08:09:13.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 Processor -- start 2024-01-30T08:09:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 -- start start 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19806f240 0x7fa1981ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1980c1200 0x7fa19815e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa198155500 0x7fa1981ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa198154db0 con 0x7fa1980c1200 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1981ed7b0 con 0x7fa19806f240 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1981537b0 con 0x7fa198155500 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1980c1200 0x7fa19815e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1980c1200 0x7fa19815e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49774/0 (socket says 172.21.15.50:49774) 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 -- 172.21.15.50:0/4248008996 learned_addr learned my addr 172.21.15.50:0/4248008996 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19e000640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19806f240 0x7fa1981ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19ea00640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa198155500 0x7fa1981ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 -- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa198155500 msgr2=0x7fa1981ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa198155500 0x7fa1981ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 -- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19806f240 msgr2=0x7fa1981ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19806f240 0x7fa1981ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 -- 172.21.15.50:0/4248008996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180009420 con 0x7fa1980c1200 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa19d600640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1980c1200 0x7fa19815e5f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa1800ae040 tx=0x7fa1800190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa196000640 1 -- 172.21.15.50:0/4248008996 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800b4610 con 0x7fa1980c1200 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa196000640 1 -- 172.21.15.50:0/4248008996 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1800b4790 con 0x7fa1980c1200 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa198154ad0 con 0x7fa1980c1200 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa196000640 1 -- 172.21.15.50:0/4248008996 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800b4b40 con 0x7fa1980c1200 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.955+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa198153440 con 0x7fa1980c1200 2024-01-30T08:09:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.959+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa198152fc0 con 0x7fa1980c1200 2024-01-30T08:09:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.959+0000 7fa196000640 1 -- 172.21.15.50:0/4248008996 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa1800b2040 con 0x7fa1980c1200 2024-01-30T08:09:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.959+0000 7fa196000640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa170066500 0x7fa1700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.959+0000 7fa196000640 1 -- 172.21.15.50:0/4248008996 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa18011e1c0 con 0x7fa1980c1200 2024-01-30T08:09:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.959+0000 7fa19e000640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa170066500 0x7fa1700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.959+0000 7fa19e000640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa170066500 0x7fa1700689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa18800ab60 tx=0x7fa188008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:13.963+0000 7fa196000640 1 -- 172.21.15.50:0/4248008996 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa198152fc0 con 0x7fa1980c1200 2024-01-30T08:09:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.123+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa198152fc0 con 0x7fa1980c1200 2024-01-30T08:09:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.123+0000 7fa196000640 1 -- 172.21.15.50:0/4248008996 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa198152fc0 con 0x7fa1980c1200 2024-01-30T08:09:14.126 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.123+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa170066500 msgr2=0x7fa1700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.123+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa170066500 0x7fa1700689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa18800ab60 tx=0x7fa188008040 comp rx=0 tx=0).stop 2024-01-30T08:09:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.123+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1980c1200 msgr2=0x7fa19815e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.123+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1980c1200 0x7fa19815e5f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa1800ae040 tx=0x7fa1800190b0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 shutdown_connections 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa170066500 0x7fa1700689c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa198155500 0x7fa1981ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1980c1200 0x7fa19815e5f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 --2- 172.21.15.50:0/4248008996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa19806f240 0x7fa1981ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 >> 172.21.15.50:0/4248008996 conn(0x7fa1980727c0 msgr2=0x7fa1980c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 shutdown_connections 2024-01-30T08:09:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.127+0000 7fa1a0a00640 1 -- 172.21.15.50:0/4248008996 wait complete. 2024-01-30T08:09:14.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:14.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf19400640 1 Processor -- start 2024-01-30T08:09:14.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf19400640 1 -- start start 2024-01-30T08:09:14.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf19400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf141568a0 0x7fbf140c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf19400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf140c8a50 con 0x7fbf140c7ae0 2024-01-30T08:09:14.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf19400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf140c66d0 con 0x7fbf140c50d0 2024-01-30T08:09:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf19400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c7070 con 0x7fbf141568a0 2024-01-30T08:09:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf13200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf140c7ae0 0x7fbf140c35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37810/0 (socket says 172.21.15.50:37810) 2024-01-30T08:09:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf13200640 1 -- 172.21.15.50:0/2080670981 learned_addr learned my addr 172.21.15.50:0/2080670981 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf11e00640 1 --2- 172.21.15.50:0/2080670981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf141568a0 0x7fbf140c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf11400640 1 -- 172.21.15.50:0/2080670981 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045172050 0 0) 0x7fbf140c8a50 con 0x7fbf140c7ae0 2024-01-30T08:09:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.291+0000 7fbf11400640 1 -- 172.21.15.50:0/2080670981 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef4003530 con 0x7fbf140c7ae0 2024-01-30T08:09:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11400640 1 -- 172.21.15.50:0/2080670981 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546445141 0 0) 0x7fbf140c66d0 con 0x7fbf140c50d0 2024-01-30T08:09:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11400640 1 -- 172.21.15.50:0/2080670981 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf140c8a50 con 0x7fbf140c50d0 2024-01-30T08:09:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11e00640 1 -- 172.21.15.50:0/2080670981 >> v1:172.21.15.125:6789/0 conn(0x7fbf140c50d0 legacy=0x7fbf14156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11e00640 1 -- 172.21.15.50:0/2080670981 >> v1:172.21.15.50:6789/0 conn(0x7fbf140c7ae0 legacy=0x7fbf140c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11e00640 1 -- 172.21.15.50:0/2080670981 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140c69b0 con 0x7fbf141568a0 2024-01-30T08:09:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11e00640 1 --2- 172.21.15.50:0/2080670981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf141568a0 0x7fbf140c30b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0097f0 tx=0x7fbefc01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48fe52f33e20293 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11400640 1 -- 172.21.15.50:0/2080670981 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0ab620 con 0x7fbf141568a0 2024-01-30T08:09:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11400640 1 -- 172.21.15.50:0/2080670981 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc0ab780 con 0x7fbf141568a0 2024-01-30T08:09:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.295+0000 7fbf11400640 1 -- 172.21.15.50:0/2080670981 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0abb10 con 0x7fbf141568a0 2024-01-30T08:09:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- 172.21.15.50:0/2080670981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf141568a0 msgr2=0x7fbf140c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 --2- 172.21.15.50:0/2080670981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf141568a0 0x7fbf140c30b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0097f0 tx=0x7fbefc01c400 comp rx=0 tx=0).stop 2024-01-30T08:09:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- 172.21.15.50:0/2080670981 shutdown_connections 2024-01-30T08:09:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 --2- 172.21.15.50:0/2080670981 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf141568a0 0x7fbf140c30b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- 172.21.15.50:0/2080670981 >> 172.21.15.50:0/2080670981 conn(0x7fbf140727c0 msgr2=0x7fbf1406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- 172.21.15.50:0/2080670981 shutdown_connections 2024-01-30T08:09:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- 172.21.15.50:0/2080670981 wait complete. 2024-01-30T08:09:14.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 Processor -- start 2024-01-30T08:09:14.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- start start 2024-01-30T08:09:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf140c50d0 0x7fbf140aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf140c7ae0 0x7fbf140ab030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf141568a0 0x7fbf140a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c8d30 con 0x7fbf141568a0 2024-01-30T08:09:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141ee840 con 0x7fbf140c7ae0 2024-01-30T08:09:14.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf19400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140a7830 con 0x7fbf140c50d0 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf13200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf141568a0 0x7fbf140a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf13200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf141568a0 0x7fbf140a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49788/0 (socket says 172.21.15.50:49788) 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf13200640 1 -- 172.21.15.50:0/3583510934 learned_addr learned my addr 172.21.15.50:0/3583510934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.299+0000 7fbf12800640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf140c50d0 0x7fbf140aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf11e00640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf140c7ae0 0x7fbf140ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf13200640 1 -- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf140c50d0 msgr2=0x7fbf140aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf13200640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf140c50d0 0x7fbf140aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf13200640 1 -- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf140c7ae0 msgr2=0x7fbf140ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf13200640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf140c7ae0 0x7fbf140ab030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf13200640 1 -- 172.21.15.50:0/3583510934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc009420 con 0x7fbf141568a0 2024-01-30T08:09:14.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf13200640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf141568a0 0x7fbf140a9520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00cb40 tx=0x7fbf0c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:14.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf0aa00640 1 -- 172.21.15.50:0/3583510934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00aca0 con 0x7fbf141568a0 2024-01-30T08:09:14.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf0aa00640 1 -- 172.21.15.50:0/3583510934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00ae00 con 0x7fbf141568a0 2024-01-30T08:09:14.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf140a7db0 con 0x7fbf141568a0 2024-01-30T08:09:14.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf0aa00640 1 -- 172.21.15.50:0/3583510934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c012600 con 0x7fbf141568a0 2024-01-30T08:09:14.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf140aa380 con 0x7fbf141568a0 2024-01-30T08:09:14.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1414ccb0 con 0x7fbf141568a0 2024-01-30T08:09:14.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.303+0000 7fbf0aa00640 1 -- 172.21.15.50:0/3583510934 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbf0c007070 con 0x7fbf141568a0 2024-01-30T08:09:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.307+0000 7fbf0aa00640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbeec066530 0x7fbeec0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.307+0000 7fbf0aa00640 1 -- 172.21.15.50:0/3583510934 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf0c083ff0 con 0x7fbf141568a0 2024-01-30T08:09:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.307+0000 7fbf12800640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbeec066530 0x7fbeec0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.307+0000 7fbf12800640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbeec066530 0x7fbeec0689f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf141551b0 tx=0x7fbf04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.311+0000 7fbf0aa00640 1 -- 172.21.15.50:0/3583510934 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbf0c051040 con 0x7fbf141568a0 2024-01-30T08:09:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.467+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbf14074a20 con 0x7fbf141568a0 2024-01-30T08:09:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf0aa00640 1 -- 172.21.15.50:0/3583510934 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbf0c017020 con 0x7fbf141568a0 2024-01-30T08:09:14.473 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbeec066530 msgr2=0x7fbeec0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbeec066530 0x7fbeec0689f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf141551b0 tx=0x7fbf04009040 comp rx=0 tx=0).stop 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf141568a0 msgr2=0x7fbf140a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf141568a0 0x7fbf140a9520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00cb40 tx=0x7fbf0c00a060 comp rx=0 tx=0).stop 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 shutdown_connections 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf140c7ae0 0x7fbf140ab030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbeec066530 0x7fbeec0689f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf141568a0 0x7fbf140a9520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 --2- 172.21.15.50:0/3583510934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf140c50d0 0x7fbf140aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 >> 172.21.15.50:0/3583510934 conn(0x7fbf140727c0 msgr2=0x7fbf140c3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 shutdown_connections 2024-01-30T08:09:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.471+0000 7fbf19400640 1 -- 172.21.15.50:0/3583510934 wait complete. 2024-01-30T08:09:14.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.631+0000 7fb3c8c00640 1 Processor -- start 2024-01-30T08:09:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.631+0000 7fb3c8c00640 1 -- start start 2024-01-30T08:09:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 0x7fb3c415fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c8c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c406af90 con 0x7fb3c406a740 2024-01-30T08:09:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c8c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c40c40c0 con 0x7fb3c40c4b60 2024-01-30T08:09:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c8c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40aa350 con 0x7fb3c406ab20 2024-01-30T08:09:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb3c406a740 0x7fb3c40c0cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37824/0 (socket says 172.21.15.50:37824) 2024-01-30T08:09:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1e00640 1 -- 172.21.15.50:0/2839003025 learned_addr learned my addr 172.21.15.50:0/2839003025 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c2800640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 0x7fb3c415fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302142754 0 0) 0x7fb3c406af90 con 0x7fb3c406a740 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a4003530 con 0x7fb3c406a740 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488829758 0 0) 0x7fb3c40c40c0 con 0x7fb3c40c4b60 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3c406af90 con 0x7fb3c40c4b60 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2967225195 0 0) 0x7fb3a4003530 con 0x7fb3c406a740 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 msgr2=0x7fb3c415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 0x7fb3c415fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 >> v1:172.21.15.125:6789/0 conn(0x7fb3c40c4b60 legacy=0x7fb3c40a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40aa070 con 0x7fb3c406a740 2024-01-30T08:09:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fb3b4001680 con 0x7fb3c406a740 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 >> v1:172.21.15.50:6789/0 conn(0x7fb3c406a740 legacy=0x7fb3c40c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 0x7fb3a4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40aa350 con 0x7fb3a40040a0 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a400bb20 con 0x7fb3a4004d10 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a400bcb0 con 0x7fb3c406ab20 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1400640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1e00640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 0x7fb3a4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c2800640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1400640 1 -- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 msgr2=0x7fb3a4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1400640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c406ab20 0x7fb3a4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1400640 1 -- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3a4004d10 msgr2=0x7fb3a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1400640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c1400640 1 -- 172.21.15.50:0/2839003025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4003530 con 0x7fb3a40040a0 2024-01-30T08:09:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.635+0000 7fb3c2800640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c1400640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3a40047d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0018d0 tx=0x7fb3ac01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b658a236144297 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0052d0 con 0x7fb3a40040a0 2024-01-30T08:09:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac0a7050 con 0x7fb3a40040a0 2024-01-30T08:09:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c0a00640 1 -- 172.21.15.50:0/2839003025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac003600 con 0x7fb3a40040a0 2024-01-30T08:09:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c8c00640 1 -- 172.21.15.50:0/2839003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 msgr2=0x7fb3a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c8c00640 1 --2- 172.21.15.50:0/2839003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3a40047d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0018d0 tx=0x7fb3ac01c560 comp rx=0 tx=0).stop 2024-01-30T08:09:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c2800640 1 -- 172.21.15.50:0/2839003025 reap_dead start 2024-01-30T08:09:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c8c00640 1 -- 172.21.15.50:0/2839003025 shutdown_connections 2024-01-30T08:09:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c8c00640 1 -- 172.21.15.50:0/2839003025 >> 172.21.15.50:0/2839003025 conn(0x7fb3c40c5b50 msgr2=0x7fb3c40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c8c00640 1 -- 172.21.15.50:0/2839003025 shutdown_connections 2024-01-30T08:09:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.639+0000 7fb3c8c00640 1 -- 172.21.15.50:0/2839003025 wait complete. 2024-01-30T08:09:14.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 Processor -- start 2024-01-30T08:09:14.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 -- start start 2024-01-30T08:09:14.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3c406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c4152f90 0x7fb3c40a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c40a6310 0x7fb3c415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41eca00 con 0x7fb3a40040a0 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41ed9b0 con 0x7fb3c40a6310 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41ecbf0 con 0x7fb3c4152f90 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3c406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3c406cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49804/0 (socket says 172.21.15.50:49804) 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 -- 172.21.15.50:0/227934834 learned_addr learned my addr 172.21.15.50:0/227934834 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c2800640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c40a6310 0x7fb3c415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1400640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c4152f90 0x7fb3c40a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 -- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c4152f90 msgr2=0x7fb3c40a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c4152f90 0x7fb3c40a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 -- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c40a6310 msgr2=0x7fb3c415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c40a6310 0x7fb3c415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 -- 172.21.15.50:0/227934834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c41eced0 con 0x7fb3a40040a0 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c1e00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3c406cfe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4007370 tx=0x7fb3b4007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3ba000640 1 -- 172.21.15.50:0/227934834 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400f960 con 0x7fb3a40040a0 2024-01-30T08:09:14.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3ba000640 1 -- 172.21.15.50:0/227934834 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b400fac0 con 0x7fb3a40040a0 2024-01-30T08:09:14.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3ba000640 1 -- 172.21.15.50:0/227934834 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400fe50 con 0x7fb3a40040a0 2024-01-30T08:09:14.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c41ed1b0 con 0x7fb3a40040a0 2024-01-30T08:09:14.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c406d520 con 0x7fb3a40040a0 2024-01-30T08:09:14.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.643+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c4074a20 con 0x7fb3a40040a0 2024-01-30T08:09:14.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.647+0000 7fb3ba000640 1 -- 172.21.15.50:0/227934834 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb3b401e3b0 con 0x7fb3a40040a0 2024-01-30T08:09:14.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.647+0000 7fb3ba000640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb39c066500 0x7fb39c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:14.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.647+0000 7fb3ba000640 1 -- 172.21.15.50:0/227934834 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3b4083c50 con 0x7fb3a40040a0 2024-01-30T08:09:14.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.647+0000 7fb3c1400640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb39c066500 0x7fb39c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.647+0000 7fb3c1400640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb39c066500 0x7fb39c0689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0ac000 tx=0x7fb3ac0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.651+0000 7fb3ba000640 1 -- 172.21.15.50:0/227934834 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb3b4050c90 con 0x7fb3a40040a0 2024-01-30T08:09:14.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3c415d830 con 0x7fb3a40040a0 2024-01-30T08:09:14.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3ba000640 1 -- 172.21.15.50:0/227934834 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7fb3b401a020 con 0x7fb3a40040a0 2024-01-30T08:09:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:14.846 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:14.846 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb39c066500 msgr2=0x7fb39c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb39c066500 0x7fb39c0689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0ac000 tx=0x7fb3ac0a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 msgr2=0x7fb3c406cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3c406cfe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4007370 tx=0x7fb3b4007830 comp rx=0 tx=0).stop 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 shutdown_connections 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3c40a6310 0x7fb3c415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb39c066500 0x7fb39c0689c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3c4152f90 0x7fb3c40a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 --2- 172.21.15.50:0/227934834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a40040a0 0x7fb3c406cfe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 >> 172.21.15.50:0/227934834 conn(0x7fb3c40c5b50 msgr2=0x7fb3c4070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 shutdown_connections 2024-01-30T08:09:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:14.843+0000 7fb3c8c00640 1 -- 172.21.15.50:0/227934834 wait complete. 2024-01-30T08:09:14.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8008400640 1 Processor -- start 2024-01-30T08:09:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8008400640 1 -- start start 2024-01-30T08:09:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8008400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80000c0080 0x7f800006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8008400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8000152230 0x7f80000c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8008400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800006c6e0 con 0x7f80000c63e0 2024-01-30T08:09:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8008400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8000154b40 con 0x7f80000c0080 2024-01-30T08:09:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8008400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8000154e20 con 0x7f8000152230 2024-01-30T08:09:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8006400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8000152230 0x7f80000c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8006400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8000152230 0x7f80000c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:56368/0 (socket says 172.21.15.50:56368) 2024-01-30T08:09:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8006400640 1 -- 172.21.15.50:0/1156494469 learned_addr learned my addr 172.21.15.50:0/1156494469 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8005000640 1 --1- 172.21.15.50:0/1156494469 >> v1:172.21.15.125:6789/0 conn(0x7f80000c63e0 0x7f8000151b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:55200/0 (socket says 172.21.15.50:55200) 2024-01-30T08:09:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8005a00640 1 --2- 172.21.15.50:0/1156494469 >> v2:172.21.15.125:3300/0 conn(0x7f80000c0080 0x7f800006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8006400640 1 -- 172.21.15.50:0/1156494469 >> v2:172.21.15.125:3300/0 conn(0x7f80000c0080 msgr2=0x7f800006c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8006400640 1 --2- 172.21.15.50:0/1156494469 >> v2:172.21.15.125:3300/0 conn(0x7f80000c0080 0x7f800006c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8006400640 1 -- 172.21.15.50:0/1156494469 >> v1:172.21.15.125:6789/0 conn(0x7f80000c63e0 legacy=0x7f8000151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f8006400640 1 -- 172.21.15.50:0/1156494469 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000155100 con 0x7f8000152230 2024-01-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.007+0000 7f7fffe00640 1 -- 172.21.15.50:0/1156494469 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088531969 0 0) 0x7f800006c6e0 con 0x7f80000c63e0 2024-01-30T08:09:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8006400640 1 --2- 172.21.15.50:0/1156494469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8000152230 0x7f80000c0460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009e50 tx=0x7f7ff801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26dfda58c9711241 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f7fffe00640 1 -- 172.21.15.50:0/1156494469 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80a57f0 con 0x7f8000152230 2024-01-30T08:09:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f7fffe00640 1 -- 172.21.15.50:0/1156494469 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff80a5950 con 0x7f8000152230 2024-01-30T08:09:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f7fffe00640 1 -- 172.21.15.50:0/1156494469 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80a5ce0 con 0x7f8000152230 2024-01-30T08:09:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 -- 172.21.15.50:0/1156494469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8000152230 msgr2=0x7f80000c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 --2- 172.21.15.50:0/1156494469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8000152230 0x7f80000c0460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009e50 tx=0x7f7ff801ca10 comp rx=0 tx=0).stop 2024-01-30T08:09:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 -- 172.21.15.50:0/1156494469 shutdown_connections 2024-01-30T08:09:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 --2- 172.21.15.50:0/1156494469 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8000152230 0x7f80000c0460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 --2- 172.21.15.50:0/1156494469 >> v2:172.21.15.125:3300/0 conn(0x7f80000c0080 0x7f800006c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 -- 172.21.15.50:0/1156494469 >> 172.21.15.50:0/1156494469 conn(0x7f80000a9590 msgr2=0x7f80000c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:15.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 -- 172.21.15.50:0/1156494469 shutdown_connections 2024-01-30T08:09:15.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.011+0000 7f8008400640 1 -- 172.21.15.50:0/1156494469 wait complete. 2024-01-30T08:09:15.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 Processor -- start 2024-01-30T08:09:15.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 -- start start 2024-01-30T08:09:15.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80000c0080 0x7f8000152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80000c63e0 0x7f80001451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000152230 0x7f8000145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800014e7c0 con 0x7f8000152230 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000aa810 con 0x7f80000c63e0 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80001ed3f0 con 0x7f80000c0080 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000152230 0x7f8000145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000152230 0x7f8000145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49806/0 (socket says 172.21.15.50:49806) 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 -- 172.21.15.50:0/2860205420 learned_addr learned my addr 172.21.15.50:0/2860205420 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8005a00640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80000c0080 0x7f8000152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8005000640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80000c63e0 0x7f80001451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 -- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80000c0080 msgr2=0x7f8000152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80000c0080 0x7f8000152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 -- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80000c63e0 msgr2=0x7f80001451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80000c63e0 0x7f80001451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 -- 172.21.15.50:0/2860205420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8009b30 con 0x7f8000152230 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8005000640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80000c63e0 0x7f80001451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8006400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000152230 0x7f8000145730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ff801a640 tx=0x7f7ff80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f7ffd600640 1 -- 172.21.15.50:0/2860205420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80b8670 con 0x7f8000152230 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f7ffd600640 1 -- 172.21.15.50:0/2860205420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff80b87d0 con 0x7f8000152230 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f7ffd600640 1 -- 172.21.15.50:0/2860205420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80b8b80 con 0x7f8000152230 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80000ab570 con 0x7f8000152230 2024-01-30T08:09:15.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.015+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800014e100 con 0x7f8000152230 2024-01-30T08:09:15.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.019+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800014e900 con 0x7f8000152230 2024-01-30T08:09:15.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.019+0000 7f7ffd600640 1 -- 172.21.15.50:0/2860205420 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7ff80b8ce0 con 0x7f8000152230 2024-01-30T08:09:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.019+0000 7f7ffd600640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7fd8066530 0x7f7fd80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.019+0000 7f7ffd600640 1 -- 172.21.15.50:0/2860205420 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ff811f530 con 0x7f8000152230 2024-01-30T08:09:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.019+0000 7f8005a00640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7fd8066530 0x7f7fd80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.019+0000 7f8005a00640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7fd8066530 0x7f7fd80689f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009b60 tx=0x7f7ff0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.023+0000 7f7ffd600640 1 -- 172.21.15.50:0/2860205420 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f800014e900 con 0x7f8000152230 2024-01-30T08:09:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.183+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f800014e900 con 0x7f8000152230 2024-01-30T08:09:15.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.183+0000 7f7ffd600640 1 -- 172.21.15.50:0/2860205420 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f800014e900 con 0x7f8000152230 2024-01-30T08:09:15.188 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:15.188 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7fd8066530 msgr2=0x7f7fd80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7fd8066530 0x7f7fd80689f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009b60 tx=0x7f7ff0009190 comp rx=0 tx=0).stop 2024-01-30T08:09:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000152230 msgr2=0x7f8000145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000152230 0x7f8000145730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ff801a640 tx=0x7f7ff80197b0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 shutdown_connections 2024-01-30T08:09:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80000c63e0 0x7f80001451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7fd8066530 0x7f7fd80689f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8000152230 0x7f8000145730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 --2- 172.21.15.50:0/2860205420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80000c0080 0x7f8000152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 >> 172.21.15.50:0/2860205420 conn(0x7f80000a9590 msgr2=0x7f800006be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 shutdown_connections 2024-01-30T08:09:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.187+0000 7f8008400640 1 -- 172.21.15.50:0/2860205420 wait complete. 2024-01-30T08:09:15.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:15.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:15.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c8a00640 1 Processor -- start 2024-01-30T08:09:15.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c8a00640 1 -- start start 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c8a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2c0071e10 0x7fa2c00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c8a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c8a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00c22b0 con 0x7fa2c00c4800 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c8a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00c5890 con 0x7fa2c0071e10 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c8a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c52d0 con 0x7fa2c006c960 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2c0071e10 0x7fa2c00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa2c00c4800 0x7fa2c0154290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37834/0 (socket says 172.21.15.50:37834) 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6a00640 1 -- 172.21.15.50:0/433098916 learned_addr learned my addr 172.21.15.50:0/433098916 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2c0071e10 0x7fa2c00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49816/0 (socket says 172.21.15.50:49816) 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c5600640 1 --2- 172.21.15.50:0/433098916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6000640 1 -- 172.21.15.50:0/433098916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 msgr2=0x7fa2c00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6000640 1 --2- 172.21.15.50:0/433098916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6000640 1 -- 172.21.15.50:0/433098916 >> v1:172.21.15.50:6789/0 conn(0x7fa2c00c4800 legacy=0x7fa2c0154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c4c00640 1 -- 172.21.15.50:0/433098916 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481623724 0 0) 0x7fa2c00c22b0 con 0x7fa2c00c4800 2024-01-30T08:09:15.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.355+0000 7fa2c6000640 1 -- 172.21.15.50:0/433098916 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00c55b0 con 0x7fa2c0071e10 2024-01-30T08:09:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c6000640 1 --2- 172.21.15.50:0/433098916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c00727b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00097c0 tx=0x7fa2b001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b63c7d99a1dc7c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c4c00640 1 -- 172.21.15.50:0/433098916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00ab600 con 0x7fa2c0071e10 2024-01-30T08:09:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c4c00640 1 -- 172.21.15.50:0/433098916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b00a7050 con 0x7fa2c0071e10 2024-01-30T08:09:15.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c4c00640 1 -- 172.21.15.50:0/433098916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00ab980 con 0x7fa2c0071e10 2024-01-30T08:09:15.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c8a00640 1 -- 172.21.15.50:0/433098916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 msgr2=0x7fa2c00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/433098916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c00727b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00097c0 tx=0x7fa2b001c360 comp rx=0 tx=0).stop 2024-01-30T08:09:15.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c8a00640 1 -- 172.21.15.50:0/433098916 shutdown_connections 2024-01-30T08:09:15.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/433098916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/433098916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c00727b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.359+0000 7fa2c8a00640 1 -- 172.21.15.50:0/433098916 >> 172.21.15.50:0/433098916 conn(0x7fa2c00c5b30 msgr2=0x7fa2c00c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:15.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 -- 172.21.15.50:0/433098916 shutdown_connections 2024-01-30T08:09:15.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 -- 172.21.15.50:0/433098916 wait complete. 2024-01-30T08:09:15.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 Processor -- start 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 -- start start 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2c00c4800 0x7fa2c01f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c014e210 con 0x7fa2c0071e10 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0151c20 con 0x7fa2c00c4800 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c8a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00a88b0 con 0x7fa2c006c960 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c014dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49832/0 (socket says 172.21.15.50:49832) 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 -- 172.21.15.50:0/1010944901 learned_addr learned my addr 172.21.15.50:0/1010944901 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c6000640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c6a00640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2c00c4800 0x7fa2c01f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 -- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 msgr2=0x7fa2c00a8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00a8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 -- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2c00c4800 msgr2=0x7fa2c01f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2c00c4800 0x7fa2c01f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 -- 172.21.15.50:0/1010944901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0009420 con 0x7fa2c0071e10 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.363+0000 7fa2c5600640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c014dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800d5f0 tx=0x7fa2a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2be000640 1 -- 172.21.15.50:0/1010944901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80125f0 con 0x7fa2c0071e10 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2be000640 1 -- 172.21.15.50:0/1010944901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a8012750 con 0x7fa2c0071e10 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c014d9f0 con 0x7fa2c0071e10 2024-01-30T08:09:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2be000640 1 -- 172.21.15.50:0/1010944901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8012ae0 con 0x7fa2c0071e10 2024-01-30T08:09:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c01f0ee0 con 0x7fa2c0071e10 2024-01-30T08:09:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c01f1070 con 0x7fa2c0071e10 2024-01-30T08:09:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2be000640 1 -- 172.21.15.50:0/1010944901 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa2a8012c40 con 0x7fa2c0071e10 2024-01-30T08:09:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2be000640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa298066530 0x7fa2980689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2be000640 1 -- 172.21.15.50:0/1010944901 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2a80845a0 con 0x7fa2c0071e10 2024-01-30T08:09:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.367+0000 7fa2c6000640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa298066530 0x7fa2980689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.371+0000 7fa2c6000640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa298066530 0x7fa2980689f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ad000 tx=0x7fa2b00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.371+0000 7fa2be000640 1 -- 172.21.15.50:0/1010944901 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa2a8051570 con 0x7fa2c0071e10 2024-01-30T08:09:15.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.531+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2c0074a20 con 0x7fa2c0071e10 2024-01-30T08:09:15.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.531+0000 7fa2be000640 1 -- 172.21.15.50:0/1010944901 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a8054b90 con 0x7fa2c0071e10 2024-01-30T08:09:15.535 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa298066530 msgr2=0x7fa2980689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa298066530 0x7fa2980689f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ad000 tx=0x7fa2b00a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 msgr2=0x7fa2c014dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c014dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800d5f0 tx=0x7fa2a800dab0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 shutdown_connections 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2c00c4800 0x7fa2c01f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa298066530 0x7fa2980689f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c0071e10 0x7fa2c014dcd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 --2- 172.21.15.50:0/1010944901 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2c006c960 0x7fa2c00a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 >> 172.21.15.50:0/1010944901 conn(0x7fa2c00c5b30 msgr2=0x7fa2c00c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 shutdown_connections 2024-01-30T08:09:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.535+0000 7fa2c8a00640 1 -- 172.21.15.50:0/1010944901 wait complete. 2024-01-30T08:09:15.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f1435a00640 1 Processor -- start 2024-01-30T08:09:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f1435a00640 1 -- start start 2024-01-30T08:09:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f1435a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1430072b60 0x7f14300a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f1435a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 0x7f14300c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f1435a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143006c4c0 con 0x7f143006bfe0 2024-01-30T08:09:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f1435a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300c0550 con 0x7f1430072b60 2024-01-30T08:09:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f1435a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c07c0 con 0x7f14300a51e0 2024-01-30T08:09:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142e000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f143006bfe0 0x7f14300c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37842/0 (socket says 172.21.15.50:37842) 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142e000640 1 -- 172.21.15.50:0/2496189293 learned_addr learned my addr 172.21.15.50:0/2496189293 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142f400640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 0x7f14300c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142ea00640 1 --2- 172.21.15.50:0/2496189293 >> v2:172.21.15.125:3300/0 conn(0x7f1430072b60 0x7f14300a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273131584 0 0) 0x7f143006c4c0 con 0x7f143006bfe0 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1410003530 con 0x7f143006bfe0 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3833146269 0 0) 0x7f1410003530 con 0x7f143006bfe0 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 msgr2=0x7f14300c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 0x7f14300c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 >> v2:172.21.15.125:3300/0 conn(0x7f1430072b60 msgr2=0x7f14300a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 --2- 172.21.15.50:0/2496189293 >> v2:172.21.15.125:3300/0 conn(0x7f1430072b60 0x7f14300a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300c0aa0 con 0x7f143006bfe0 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f14180016a0 con 0x7f143006bfe0 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 >> v1:172.21.15.50:6789/0 conn(0x7f143006bfe0 legacy=0x7f14300c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 0x7f1410003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1410003f00 0x7f14100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1410004d10 0x7f1410005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c0550 con 0x7f1410003f00 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c07c0 con 0x7f1410004d10 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141000ba70 con 0x7f14300a51e0 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142e000640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1410003f00 0x7f14100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.699+0000 7f142ea00640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 0x7f1410003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142f400640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1410004d10 0x7f1410005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142e000640 1 -- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 msgr2=0x7f1410003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142e000640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14300a51e0 0x7f1410003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142e000640 1 -- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1410004d10 msgr2=0x7f1410005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142e000640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1410004d10 0x7f1410005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142e000640 1 -- 172.21.15.50:0/2496189293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410003530 con 0x7f1410003f00 2024-01-30T08:09:15.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142e000640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1410003f00 0x7f14100047d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f143014b9f0 tx=0x7f141801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f9460e06e827c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180a58f0 con 0x7f1410003f00 2024-01-30T08:09:15.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14180a5a50 con 0x7f1410003f00 2024-01-30T08:09:15.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.703+0000 7f142d600640 1 -- 172.21.15.50:0/2496189293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180a5e00 con 0x7f1410003f00 2024-01-30T08:09:15.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- 172.21.15.50:0/2496189293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1410003f00 msgr2=0x7f14100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 --2- 172.21.15.50:0/2496189293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1410003f00 0x7f14100047d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f143014b9f0 tx=0x7f141801cbf0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f142f400640 1 -- 172.21.15.50:0/2496189293 reap_dead start 2024-01-30T08:09:15.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- 172.21.15.50:0/2496189293 shutdown_connections 2024-01-30T08:09:15.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- 172.21.15.50:0/2496189293 >> 172.21.15.50:0/2496189293 conn(0x7f14300c5b30 msgr2=0x7f14300c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:15.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- 172.21.15.50:0/2496189293 shutdown_connections 2024-01-30T08:09:15.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- 172.21.15.50:0/2496189293 wait complete. 2024-01-30T08:09:15.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 Processor -- start 2024-01-30T08:09:15.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- start start 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1410003f00 0x7f14300ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1430155cb0 0x7f14300a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14300a8ff0 0x7f14301edf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14301edb10 con 0x7f14300a8ff0 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300a8a30 con 0x7f1430155cb0 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f1435a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300a8d10 con 0x7f1410003f00 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f142f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14300a8ff0 0x7f14301edf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f142f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14300a8ff0 0x7f14301edf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49854/0 (socket says 172.21.15.50:49854) 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f142f400640 1 -- 172.21.15.50:0/995198186 learned_addr learned my addr 172.21.15.50:0/995198186 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f142e000640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1430155cb0 0x7f14300a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.707+0000 7f142ea00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1410003f00 0x7f14300ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f142f400640 1 -- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1410003f00 msgr2=0x7f14300ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f142f400640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1410003f00 0x7f14300ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f142f400640 1 -- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1430155cb0 msgr2=0x7f14300a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f142f400640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1430155cb0 0x7f14300a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f142f400640 1 -- 172.21.15.50:0/995198186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300a9c40 con 0x7f14300a8ff0 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f142f400640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14300a8ff0 0x7f14301edf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14300abd20 tx=0x7f142800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1426a00640 1 -- 172.21.15.50:0/995198186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800e040 con 0x7f14300a8ff0 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1426a00640 1 -- 172.21.15.50:0/995198186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800f040 con 0x7f14300a8ff0 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1426a00640 1 -- 172.21.15.50:0/995198186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428015430 con 0x7f14300a8ff0 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1430155450 con 0x7f14300a8ff0 2024-01-30T08:09:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14301ee470 con 0x7f14300a8ff0 2024-01-30T08:09:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14301edc50 con 0x7f14300a8ff0 2024-01-30T08:09:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1426a00640 1 -- 172.21.15.50:0/995198186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1428015590 con 0x7f14300a8ff0 2024-01-30T08:09:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.711+0000 7f1426a00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f14080664a0 0x7f1408068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.715+0000 7f1426a00640 1 -- 172.21.15.50:0/995198186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1428084770 con 0x7f14300a8ff0 2024-01-30T08:09:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.715+0000 7f142ea00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f14080664a0 0x7f1408068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.715+0000 7f142ea00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f14080664a0 0x7f1408068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1420009b20 tx=0x7f1420008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.719+0000 7f1426a00640 1 -- 172.21.15.50:0/995198186 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f14301edc50 con 0x7f14300a8ff0 2024-01-30T08:09:15.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14301edc50 con 0x7f14300a8ff0 2024-01-30T08:09:15.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1426a00640 1 -- 172.21.15.50:0/995198186 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14301edc50 con 0x7f14300a8ff0 2024-01-30T08:09:15.878 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:15.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f14080664a0 msgr2=0x7f1408068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f14080664a0 0x7f1408068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1420009b20 tx=0x7f1420008040 comp rx=0 tx=0).stop 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14300a8ff0 msgr2=0x7f14301edf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14300a8ff0 0x7f14301edf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14300abd20 tx=0x7f142800f580 comp rx=0 tx=0).stop 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 shutdown_connections 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1430155cb0 0x7f14300a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f14080664a0 0x7f1408068960 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14300a8ff0 0x7f14301edf30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 --2- 172.21.15.50:0/995198186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1410003f00 0x7f14300ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 >> 172.21.15.50:0/995198186 conn(0x7f14300c5b30 msgr2=0x7f143006cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 shutdown_connections 2024-01-30T08:09:15.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:15.875+0000 7f1435a00640 1 -- 172.21.15.50:0/995198186 wait complete. 2024-01-30T08:09:15.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f981a800640 1 Processor -- start 2024-01-30T08:09:16.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f981a800640 1 -- start start 2024-01-30T08:09:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f981a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f981406c960 0x7f98140727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f981a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f9814154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f981a800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98140c22b0 con 0x7f9814071e10 2024-01-30T08:09:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f981a800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140c5890 con 0x7f981406c960 2024-01-30T08:09:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f981a800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140c52d0 con 0x7f9814154290 2024-01-30T08:09:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f9812a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f981406c960 0x7f98140727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f9812a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f981406c960 0x7f98140727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49860/0 (socket says 172.21.15.50:49860) 2024-01-30T08:09:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.039+0000 7f9812a00640 1 -- 172.21.15.50:0/2770011482 learned_addr learned my addr 172.21.15.50:0/2770011482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9813e00640 1 --2- 172.21.15.50:0/2770011482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f9814154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812a00640 1 -- 172.21.15.50:0/2770011482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 msgr2=0x7f9814154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812a00640 1 --2- 172.21.15.50:0/2770011482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f9814154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812a00640 1 -- 172.21.15.50:0/2770011482 >> v1:172.21.15.125:6789/0 conn(0x7f9814071e10 legacy=0x7f98140c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812a00640 1 -- 172.21.15.50:0/2770011482 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140c55b0 con 0x7f981406c960 2024-01-30T08:09:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812a00640 1 --2- 172.21.15.50:0/2770011482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981406c960 0x7f98140727b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00aa10 tx=0x7f97fc01d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92177ecec0b0f63c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812000640 1 -- 172.21.15.50:0/2770011482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0a76a0 con 0x7f981406c960 2024-01-30T08:09:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812000640 1 -- 172.21.15.50:0/2770011482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc0a7800 con 0x7f981406c960 2024-01-30T08:09:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.043+0000 7f9812000640 1 -- 172.21.15.50:0/2770011482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0a7b90 con 0x7f981406c960 2024-01-30T08:09:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- 172.21.15.50:0/2770011482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981406c960 msgr2=0x7f98140727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 --2- 172.21.15.50:0/2770011482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981406c960 0x7f98140727b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00aa10 tx=0x7f97fc01d7b0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- 172.21.15.50:0/2770011482 shutdown_connections 2024-01-30T08:09:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 --2- 172.21.15.50:0/2770011482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f9814154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 --2- 172.21.15.50:0/2770011482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981406c960 0x7f98140727b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- 172.21.15.50:0/2770011482 >> 172.21.15.50:0/2770011482 conn(0x7f98140c5b30 msgr2=0x7f98140c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- 172.21.15.50:0/2770011482 shutdown_connections 2024-01-30T08:09:16.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- 172.21.15.50:0/2770011482 wait complete. 2024-01-30T08:09:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 Processor -- start 2024-01-30T08:09:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- start start 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f981406c960 0x7f981414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9814071e10 0x7f981414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f98141512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98141ee510 con 0x7f9814071e10 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981414bff0 con 0x7f981406c960 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f981a800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9814159900 con 0x7f9814154290 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9814071e10 0x7f981414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9814071e10 0x7f981414f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49870/0 (socket says 172.21.15.50:49870) 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 -- 172.21.15.50:0/3880330188 learned_addr learned my addr 172.21.15.50:0/3880330188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9813400640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f981406c960 0x7f981414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9813e00640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f98141512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 -- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 msgr2=0x7f98141512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f98141512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 -- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f981406c960 msgr2=0x7f981414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f981406c960 0x7f981414db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.047+0000 7f9812a00640 1 -- 172.21.15.50:0/3880330188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc00a670 con 0x7f9814071e10 2024-01-30T08:09:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f9812a00640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9814071e10 0x7f981414f4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97fc01e050 tx=0x7f97fc01a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f980b400640 1 -- 172.21.15.50:0/3880330188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0a8890 con 0x7f9814071e10 2024-01-30T08:09:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f980b400640 1 -- 172.21.15.50:0/3880330188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc0a8a10 con 0x7f9814071e10 2024-01-30T08:09:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f980b400640 1 -- 172.21.15.50:0/3880330188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0a8dc0 con 0x7f9814071e10 2024-01-30T08:09:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98141ee130 con 0x7f9814071e10 2024-01-30T08:09:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981415a000 con 0x7f9814071e10 2024-01-30T08:09:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98140aba80 con 0x7f9814071e10 2024-01-30T08:09:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f980b400640 1 -- 172.21.15.50:0/3880330188 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f97fc0b2450 con 0x7f9814071e10 2024-01-30T08:09:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f980b400640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f97ec066500 0x7f97ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f980b400640 1 -- 172.21.15.50:0/3880330188 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f97fc11e910 con 0x7f9814071e10 2024-01-30T08:09:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.051+0000 7f9813400640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f97ec066500 0x7f97ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.055+0000 7f9813400640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f97ec066500 0x7f97ec0689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98141541d0 tx=0x7f9804009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.055+0000 7f980b400640 1 -- 172.21.15.50:0/3880330188 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f97fc0eb960 con 0x7f9814071e10 2024-01-30T08:09:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f981406deb0 con 0x7f9814071e10 2024-01-30T08:09:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f980b400640 1 -- 172.21.15.50:0/3880330188 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97fc0eef80 con 0x7f9814071e10 2024-01-30T08:09:16.218 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f97ec066500 msgr2=0x7f97ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f97ec066500 0x7f97ec0689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98141541d0 tx=0x7f9804009060 comp rx=0 tx=0).stop 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9814071e10 msgr2=0x7f981414f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9814071e10 0x7f981414f4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97fc01e050 tx=0x7f97fc01a550 comp rx=0 tx=0).stop 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 shutdown_connections 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f97ec066500 0x7f97ec0689c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9814154290 0x7f98141512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9814071e10 0x7f981414f4a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 --2- 172.21.15.50:0/3880330188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f981406c960 0x7f981414db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 >> 172.21.15.50:0/3880330188 conn(0x7f98140c5b30 msgr2=0x7f98140bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:16.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 shutdown_connections 2024-01-30T08:09:16.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.215+0000 7f981a800640 1 -- 172.21.15.50:0/3880330188 wait complete. 2024-01-30T08:09:16.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.379+0000 7f1fed400640 1 Processor -- start 2024-01-30T08:09:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.379+0000 7f1fed400640 1 -- start start 2024-01-30T08:09:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fed400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1fe8072b60 0x7f1fe80a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fed400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe806bfe0 0x7f1fe80c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fed400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fe80a51e0 0x7f1fe80c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fed400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe806c4c0 con 0x7f1fe80a51e0 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fed400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe80c0550 con 0x7f1fe8072b60 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fed400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c07c0 con 0x7f1fe806bfe0 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fe80a51e0 0x7f1fe80c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fe80a51e0 0x7f1fe80c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49884/0 (socket says 172.21.15.50:49884) 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 -- 172.21.15.50:0/3324925542 learned_addr learned my addr 172.21.15.50:0/3324925542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe5e00640 1 --2- 172.21.15.50:0/3324925542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe806bfe0 0x7f1fe80c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe6800640 1 --2- 172.21.15.50:0/3324925542 >> v2:172.21.15.125:3300/0 conn(0x7f1fe8072b60 0x7f1fe80a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 -- 172.21.15.50:0/3324925542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe806bfe0 msgr2=0x7f1fe80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 --2- 172.21.15.50:0/3324925542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe806bfe0 0x7f1fe80c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 -- 172.21.15.50:0/3324925542 >> v2:172.21.15.125:3300/0 conn(0x7f1fe8072b60 msgr2=0x7f1fe80a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 --2- 172.21.15.50:0/3324925542 >> v2:172.21.15.125:3300/0 conn(0x7f1fe8072b60 0x7f1fe80a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.383+0000 7f1fe7200640 1 -- 172.21.15.50:0/3324925542 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80c0aa0 con 0x7f1fe80a51e0 2024-01-30T08:09:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fe7200640 1 --2- 172.21.15.50:0/3324925542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe80a51e0 0x7f1fe80c17e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8073fd0 tx=0x7f1fe001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7c2b32a400fe49 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fe5400640 1 -- 172.21.15.50:0/3324925542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000b2d0 con 0x7f1fe80a51e0 2024-01-30T08:09:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fe5400640 1 -- 172.21.15.50:0/3324925542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe000b430 con 0x7f1fe80a51e0 2024-01-30T08:09:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fe5400640 1 -- 172.21.15.50:0/3324925542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00a7b60 con 0x7f1fe80a51e0 2024-01-30T08:09:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 -- 172.21.15.50:0/3324925542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe80a51e0 msgr2=0x7f1fe80c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 --2- 172.21.15.50:0/3324925542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe80a51e0 0x7f1fe80c17e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8073fd0 tx=0x7f1fe001eb10 comp rx=0 tx=0).stop 2024-01-30T08:09:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 -- 172.21.15.50:0/3324925542 shutdown_connections 2024-01-30T08:09:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 --2- 172.21.15.50:0/3324925542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe80a51e0 0x7f1fe80c17e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 --2- 172.21.15.50:0/3324925542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe806bfe0 0x7f1fe80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 --2- 172.21.15.50:0/3324925542 >> v2:172.21.15.125:3300/0 conn(0x7f1fe8072b60 0x7f1fe80a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 -- 172.21.15.50:0/3324925542 >> 172.21.15.50:0/3324925542 conn(0x7f1fe80c5b30 msgr2=0x7f1fe80c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 -- 172.21.15.50:0/3324925542 shutdown_connections 2024-01-30T08:09:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 -- 172.21.15.50:0/3324925542 wait complete. 2024-01-30T08:09:16.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 Processor -- start 2024-01-30T08:09:16.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.387+0000 7f1fed400640 1 -- start start 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe806bfe0 0x7f1fe8144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe8072b60 0x7f1fe8141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe80a51e0 0x7f1fe8142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8154770 con 0x7f1fe806bfe0 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8153fb0 con 0x7f1fe8072b60 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8142ac0 con 0x7f1fe80a51e0 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe806bfe0 0x7f1fe8144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe806bfe0 0x7f1fe8144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49898/0 (socket says 172.21.15.50:49898) 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 -- 172.21.15.50:0/2417523155 learned_addr learned my addr 172.21.15.50:0/2417523155 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe5e00640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe8072b60 0x7f1fe8141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe7200640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe80a51e0 0x7f1fe8142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 -- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe80a51e0 msgr2=0x7f1fe8142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe80a51e0 0x7f1fe8142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 -- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe8072b60 msgr2=0x7f1fe8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe8072b60 0x7f1fe8141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 -- 172.21.15.50:0/2417523155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe000bd40 con 0x7f1fe806bfe0 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fe6800640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe806bfe0 0x7f1fe8144180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800e960 tx=0x7f1fd800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fdea00640 1 -- 172.21.15.50:0/2417523155 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8009690 con 0x7f1fe806bfe0 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fdea00640 1 -- 172.21.15.50:0/2417523155 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800ca00 con 0x7f1fe806bfe0 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe81ec250 con 0x7f1fe806bfe0 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fdea00640 1 -- 172.21.15.50:0/2417523155 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800cd70 con 0x7f1fe806bfe0 2024-01-30T08:09:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe8154490 con 0x7f1fe806bfe0 2024-01-30T08:09:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe8074a20 con 0x7f1fe806bfe0 2024-01-30T08:09:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.391+0000 7f1fdea00640 1 -- 172.21.15.50:0/2417523155 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1fd8013470 con 0x7f1fe806bfe0 2024-01-30T08:09:16.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.395+0000 7f1fdea00640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1fc0066530 0x7f1fc00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.395+0000 7f1fdea00640 1 -- 172.21.15.50:0/2417523155 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1fd8084370 con 0x7f1fe806bfe0 2024-01-30T08:09:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.395+0000 7f1fe5e00640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1fc0066530 0x7f1fc00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.395+0000 7f1fe5e00640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1fc0066530 0x7f1fc00689f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fe81ed310 tx=0x7f1fd0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.399+0000 7f1fdea00640 1 -- 172.21.15.50:0/2417523155 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1fd80513c0 con 0x7f1fe806bfe0 2024-01-30T08:09:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.559+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1fe814ed00 con 0x7f1fe806bfe0 2024-01-30T08:09:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.559+0000 7f1fdea00640 1 -- 172.21.15.50:0/2417523155 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1fd8059e60 con 0x7f1fe806bfe0 2024-01-30T08:09:16.563 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1fc0066530 msgr2=0x7f1fc00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1fc0066530 0x7f1fc00689f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fe81ed310 tx=0x7f1fd0009190 comp rx=0 tx=0).stop 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe806bfe0 msgr2=0x7f1fe8144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe806bfe0 0x7f1fe8144180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800e960 tx=0x7f1fd800ee20 comp rx=0 tx=0).stop 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 shutdown_connections 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fe8072b60 0x7f1fe8141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1fc0066530 0x7f1fc00689f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fe80a51e0 0x7f1fe8142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 --2- 172.21.15.50:0/2417523155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe806bfe0 0x7f1fe8144180 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 >> 172.21.15.50:0/2417523155 conn(0x7f1fe80c5b30 msgr2=0x7f1fe80c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 shutdown_connections 2024-01-30T08:09:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.563+0000 7f1fed400640 1 -- 172.21.15.50:0/2417523155 wait complete. 2024-01-30T08:09:16.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:16.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcffd200640 1 Processor -- start 2024-01-30T08:09:16.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcffd200640 1 -- start start 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcffd200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcff80c5650 0x7fcff806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcffd200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c4760 0x7fcff806d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcffd200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff80a8cf0 con 0x7fcff80c1840 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcffd200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff8072a30 con 0x7fcff80c5650 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcffd200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80a8f40 con 0x7fcff80c4760 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff5e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcff80c1840 0x7fcff80a4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37854/0 (socket says 172.21.15.50:37854) 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff5e00640 1 -- 172.21.15.50:0/1892521755 learned_addr learned my addr 172.21.15.50:0/1892521755 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:16.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff5400640 1 --2- 172.21.15.50:0/1892521755 >> v2:172.21.15.125:3300/0 conn(0x7fcff80c5650 0x7fcff806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff6800640 1 --2- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c4760 0x7fcff806d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff4a00640 1 -- 172.21.15.50:0/1892521755 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591491082 0 0) 0x7fcff80a8cf0 con 0x7fcff80c1840 2024-01-30T08:09:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff4a00640 1 -- 172.21.15.50:0/1892521755 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd8003530 con 0x7fcff80c1840 2024-01-30T08:09:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff5400640 1 -- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c4760 msgr2=0x7fcff806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff5400640 1 --2- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c4760 0x7fcff806d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff5400640 1 -- 172.21.15.50:0/1892521755 >> v1:172.21.15.50:6789/0 conn(0x7fcff80c1840 legacy=0x7fcff80a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.723+0000 7fcff5400640 1 -- 172.21.15.50:0/1892521755 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8072cd0 con 0x7fcff80c5650 2024-01-30T08:09:16.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcff5400640 1 --2- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c5650 0x7fcff806cf00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00097c0 tx=0x7fcfe001e600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf972e055e438384 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcff4a00640 1 -- 172.21.15.50:0/1892521755 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00ab5f0 con 0x7fcff80c5650 2024-01-30T08:09:16.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcff4a00640 1 -- 172.21.15.50:0/1892521755 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe00ab750 con 0x7fcff80c5650 2024-01-30T08:09:16.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcff4a00640 1 -- 172.21.15.50:0/1892521755 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00abae0 con 0x7fcff80c5650 2024-01-30T08:09:16.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 -- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c5650 msgr2=0x7fcff806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 --2- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c5650 0x7fcff806cf00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00097c0 tx=0x7fcfe001e600 comp rx=0 tx=0).stop 2024-01-30T08:09:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 -- 172.21.15.50:0/1892521755 shutdown_connections 2024-01-30T08:09:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 --2- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c4760 0x7fcff806d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 --2- 172.21.15.50:0/1892521755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c5650 0x7fcff806cf00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 -- 172.21.15.50:0/1892521755 >> 172.21.15.50:0/1892521755 conn(0x7fcff80c5b50 msgr2=0x7fcff80c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 -- 172.21.15.50:0/1892521755 shutdown_connections 2024-01-30T08:09:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.727+0000 7fcffd200640 1 -- 172.21.15.50:0/1892521755 wait complete. 2024-01-30T08:09:16.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 Processor -- start 2024-01-30T08:09:16.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 -- start start 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c1840 0x7fcff8150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c4760 0x7fcff81530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff80c5650 0x7fcff8152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81ed470 con 0x7fcff80c5650 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8150680 con 0x7fcff80c4760 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8150960 con 0x7fcff80c1840 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff80c5650 0x7fcff8152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff80c5650 0x7fcff8152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49906/0 (socket says 172.21.15.50:49906) 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 -- 172.21.15.50:0/4203005028 learned_addr learned my addr 172.21.15.50:0/4203005028 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff5e00640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c1840 0x7fcff8150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff5400640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c4760 0x7fcff81530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 -- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c1840 msgr2=0x7fcff8150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c1840 0x7fcff8150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 -- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c4760 msgr2=0x7fcff81530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c4760 0x7fcff81530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 -- 172.21.15.50:0/4203005028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0009420 con 0x7fcff80c5650 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcff6800640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff80c5650 0x7fcff8152690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcff000efc0 tx=0x7fcff000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcfee000640 1 -- 172.21.15.50:0/4203005028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0009ba0 con 0x7fcff80c5650 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcfee000640 1 -- 172.21.15.50:0/4203005028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000f040 con 0x7fcff80c5650 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcfee000640 1 -- 172.21.15.50:0/4203005028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00146c0 con 0x7fcff80c5650 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff8150c40 con 0x7fcff80c5650 2024-01-30T08:09:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.731+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff8152bd0 con 0x7fcff80c5650 2024-01-30T08:09:16.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.735+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff81ed2a0 con 0x7fcff80c5650 2024-01-30T08:09:16.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.735+0000 7fcfee000640 1 -- 172.21.15.50:0/4203005028 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcff0014820 con 0x7fcff80c5650 2024-01-30T08:09:16.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.735+0000 7fcfee000640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfd0066550 0x7fcfd0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:16.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.735+0000 7fcfee000640 1 -- 172.21.15.50:0/4203005028 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcff0084b00 con 0x7fcff80c5650 2024-01-30T08:09:16.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.735+0000 7fcff5e00640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfd0066550 0x7fcfd0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:16.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.735+0000 7fcff5e00640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfd0066550 0x7fcfd0068a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8007fd0 tx=0x7fcfe8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:16.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.739+0000 7fcfee000640 1 -- 172.21.15.50:0/4203005028 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcff0086e60 con 0x7fcff80c5650 2024-01-30T08:09:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcff8074a20 con 0x7fcff80c5650 2024-01-30T08:09:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcfee000640 1 -- 172.21.15.50:0/4203005028 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7fcff0018090 con 0x7fcff80c5650 2024-01-30T08:09:16.937 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:16.937 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfd0066550 msgr2=0x7fcfd0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfd0066550 0x7fcfd0068a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8007fd0 tx=0x7fcfe8009040 comp rx=0 tx=0).stop 2024-01-30T08:09:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff80c5650 msgr2=0x7fcff8152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff80c5650 0x7fcff8152690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcff000efc0 tx=0x7fcff000c490 comp rx=0 tx=0).stop 2024-01-30T08:09:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 shutdown_connections 2024-01-30T08:09:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcff80c4760 0x7fcff81530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfd0066550 0x7fcfd0068a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff80c5650 0x7fcff8152690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 --2- 172.21.15.50:0/4203005028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcff80c1840 0x7fcff8150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 >> 172.21.15.50:0/4203005028 conn(0x7fcff80c5b50 msgr2=0x7fcff80a6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 shutdown_connections 2024-01-30T08:09:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:16.935+0000 7fcffd200640 1 -- 172.21.15.50:0/4203005028 wait complete. 2024-01-30T08:09:16.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.095+0000 7f4d38e00640 1 Processor -- start 2024-01-30T08:09:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.095+0000 7f4d38e00640 1 -- start start 2024-01-30T08:09:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d38e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d340a4e50 0x7f4d340729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d38e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340c3e40 con 0x7f4d340c4e00 2024-01-30T08:09:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d38e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340a8c20 con 0x7f4d34158a00 2024-01-30T08:09:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d38e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d340c42d0 con 0x7f4d340a4e50 2024-01-30T08:09:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d31e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d340c4e00 0x7f4d340a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37866/0 (socket says 172.21.15.50:37866) 2024-01-30T08:09:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d31e00640 1 -- 172.21.15.50:0/784817405 learned_addr learned my addr 172.21.15.50:0/784817405 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d31400640 1 --2- 172.21.15.50:0/784817405 >> v2:172.21.15.125:3300/0 conn(0x7f4d340a4e50 0x7f4d340729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d30a00640 1 -- 172.21.15.50:0/784817405 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569859286 0 0) 0x7f4d340c3e40 con 0x7f4d340c4e00 2024-01-30T08:09:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d30a00640 1 -- 172.21.15.50:0/784817405 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d14003530 con 0x7f4d340c4e00 2024-01-30T08:09:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d30a00640 1 -- 172.21.15.50:0/784817405 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957996534 0 0) 0x7f4d340a8c20 con 0x7f4d34158a00 2024-01-30T08:09:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d30a00640 1 -- 172.21.15.50:0/784817405 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d340c3e40 con 0x7f4d34158a00 2024-01-30T08:09:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d31400640 1 -- 172.21.15.50:0/784817405 >> v1:172.21.15.125:6789/0 conn(0x7f4d34158a00 legacy=0x7f4d3415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d31400640 1 -- 172.21.15.50:0/784817405 >> v1:172.21.15.50:6789/0 conn(0x7f4d340c4e00 legacy=0x7f4d340a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.099+0000 7f4d31400640 1 -- 172.21.15.50:0/784817405 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340c3b10 con 0x7f4d340a4e50 2024-01-30T08:09:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d31400640 1 --2- 172.21.15.50:0/784817405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 0x7f4d340729a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097f0 tx=0x7f4d1c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca954209eff3952e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d30a00640 1 -- 172.21.15.50:0/784817405 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0a8050 con 0x7f4d340a4e50 2024-01-30T08:09:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d30a00640 1 -- 172.21.15.50:0/784817405 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0ac5f0 con 0x7f4d340a4e50 2024-01-30T08:09:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d30a00640 1 -- 172.21.15.50:0/784817405 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0ac980 con 0x7f4d340a4e50 2024-01-30T08:09:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d38e00640 1 -- 172.21.15.50:0/784817405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 msgr2=0x7f4d340729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d38e00640 1 --2- 172.21.15.50:0/784817405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 0x7f4d340729a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097f0 tx=0x7f4d1c01c450 comp rx=0 tx=0).stop 2024-01-30T08:09:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d38e00640 1 -- 172.21.15.50:0/784817405 shutdown_connections 2024-01-30T08:09:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d38e00640 1 --2- 172.21.15.50:0/784817405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 0x7f4d340729a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d38e00640 1 -- 172.21.15.50:0/784817405 >> 172.21.15.50:0/784817405 conn(0x7f4d340c5b50 msgr2=0x7f4d340c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d38e00640 1 -- 172.21.15.50:0/784817405 shutdown_connections 2024-01-30T08:09:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.103+0000 7f4d38e00640 1 -- 172.21.15.50:0/784817405 wait complete. 2024-01-30T08:09:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 Processor -- start 2024-01-30T08:09:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 -- start start 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 0x7f4d34153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340c4e00 0x7f4d3406bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d34158a00 0x7f4d3406c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d341ec9d0 con 0x7f4d34158a00 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3406d940 con 0x7f4d340a4e50 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d341ecc90 con 0x7f4d340c4e00 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d34158a00 0x7f4d3406c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d34158a00 0x7f4d3406c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49916/0 (socket says 172.21.15.50:49916) 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 -- 172.21.15.50:0/1889909375 learned_addr learned my addr 172.21.15.50:0/1889909375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d31e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 0x7f4d34153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d31400640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340c4e00 0x7f4d3406bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 -- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340c4e00 msgr2=0x7f4d3406bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340c4e00 0x7f4d3406bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 -- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 msgr2=0x7f4d34153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 0x7f4d34153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 -- 172.21.15.50:0/1889909375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c009420 con 0x7f4d34158a00 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d32800640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d34158a00 0x7f4d3406c1e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c730 tx=0x7f4d2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d2a000640 1 -- 172.21.15.50:0/1889909375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c003b80 con 0x7f4d34158a00 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d2a000640 1 -- 172.21.15.50:0/1889909375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c003ce0 con 0x7f4d34158a00 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d341ecf70 con 0x7f4d34158a00 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d2a000640 1 -- 172.21.15.50:0/1889909375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00aa30 con 0x7f4d34158a00 2024-01-30T08:09:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d341537c0 con 0x7f4d34158a00 2024-01-30T08:09:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.107+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d34074a20 con 0x7f4d34158a00 2024-01-30T08:09:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.111+0000 7f4d2a000640 1 -- 172.21.15.50:0/1889909375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4d2c00ab90 con 0x7f4d34158a00 2024-01-30T08:09:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.111+0000 7f4d2a000640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d0c066500 0x7f4d0c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.111+0000 7f4d2a000640 1 -- 172.21.15.50:0/1889909375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d2c083ef0 con 0x7f4d34158a00 2024-01-30T08:09:17.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.111+0000 7f4d31e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d0c066500 0x7f4d0c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.111+0000 7f4d31e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d0c066500 0x7f4d0c0689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d24007fd0 tx=0x7f4d24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:17.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.115+0000 7f4d2a000640 1 -- 172.21.15.50:0/1889909375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4d2c050eb0 con 0x7f4d34158a00 2024-01-30T08:09:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.275+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d341ed420 con 0x7f4d34158a00 2024-01-30T08:09:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d2a000640 1 -- 172.21.15.50:0/1889909375 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f4d2c0544d0 con 0x7f4d34158a00 2024-01-30T08:09:17.281 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:17.281 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:17.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d0c066500 msgr2=0x7f4d0c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d0c066500 0x7f4d0c0689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d24007fd0 tx=0x7f4d24009040 comp rx=0 tx=0).stop 2024-01-30T08:09:17.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d34158a00 msgr2=0x7f4d3406c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d34158a00 0x7f4d3406c1e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c730 tx=0x7f4d2c00cbf0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 shutdown_connections 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d0c066500 0x7f4d0c0689c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d34158a00 0x7f4d3406c1e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d340c4e00 0x7f4d3406bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 --2- 172.21.15.50:0/1889909375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d340a4e50 0x7f4d34153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 >> 172.21.15.50:0/1889909375 conn(0x7f4d340c5b50 msgr2=0x7f4d340725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 shutdown_connections 2024-01-30T08:09:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.279+0000 7f4d38e00640 1 -- 172.21.15.50:0/1889909375 wait complete. 2024-01-30T08:09:17.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:17.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.439+0000 7fe8ba000640 1 Processor -- start 2024-01-30T08:09:17.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8ba000640 1 -- start start 2024-01-30T08:09:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8ba000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b414fbf0 0x7fe8b41559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8ba000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b40c3ed0 con 0x7fe8b40c0ee0 2024-01-30T08:09:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8ba000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b406bca0 con 0x7fe8b40c1de0 2024-01-30T08:09:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8ba000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40a5520 con 0x7fe8b414fbf0 2024-01-30T08:09:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b2a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8b40c0ee0 0x7fe8b40a4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37874/0 (socket says 172.21.15.50:37874) 2024-01-30T08:09:17.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b2a00640 1 -- 172.21.15.50:0/3785463142 learned_addr learned my addr 172.21.15.50:0/3785463142 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:17.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b3400640 1 --2- 172.21.15.50:0/3785463142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b414fbf0 0x7fe8b41559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b2000640 1 -- 172.21.15.50:0/3785463142 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726534967 0 0) 0x7fe8b40c3ed0 con 0x7fe8b40c0ee0 2024-01-30T08:09:17.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b2000640 1 -- 172.21.15.50:0/3785463142 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe894003530 con 0x7fe8b40c0ee0 2024-01-30T08:09:17.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b3400640 1 -- 172.21.15.50:0/3785463142 >> v1:172.21.15.125:6789/0 conn(0x7fe8b40c1de0 legacy=0x7fe8b406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b2000640 1 -- 172.21.15.50:0/3785463142 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353521465 0 0) 0x7fe894003530 con 0x7fe8b40c0ee0 2024-01-30T08:09:17.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b3400640 1 -- 172.21.15.50:0/3785463142 >> v1:172.21.15.50:6789/0 conn(0x7fe8b40c0ee0 legacy=0x7fe8b40a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.443+0000 7fe8b3400640 1 -- 172.21.15.50:0/3785463142 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b406bef0 con 0x7fe8b414fbf0 2024-01-30T08:09:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8b3400640 1 --2- 172.21.15.50:0/3785463142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b414fbf0 0x7fe8b41559c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40097f0 tx=0x7fe8a401c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79bfdd445fd9465 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8b2000640 1 -- 172.21.15.50:0/3785463142 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c001680 con 0x7fe8b414fbf0 2024-01-30T08:09:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8b2000640 1 -- 172.21.15.50:0/3785463142 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a40a7050 con 0x7fe8b414fbf0 2024-01-30T08:09:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8b2000640 1 -- 172.21.15.50:0/3785463142 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40ab620 con 0x7fe8b414fbf0 2024-01-30T08:09:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 -- 172.21.15.50:0/3785463142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b414fbf0 msgr2=0x7fe8b41559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3785463142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b414fbf0 0x7fe8b41559c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40097f0 tx=0x7fe8a401c2c0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 -- 172.21.15.50:0/3785463142 shutdown_connections 2024-01-30T08:09:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3785463142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b414fbf0 0x7fe8b41559c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 -- 172.21.15.50:0/3785463142 >> 172.21.15.50:0/3785463142 conn(0x7fe8b40c5b50 msgr2=0x7fe8b40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 -- 172.21.15.50:0/3785463142 shutdown_connections 2024-01-30T08:09:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 -- 172.21.15.50:0/3785463142 wait complete. 2024-01-30T08:09:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.447+0000 7fe8ba000640 1 Processor -- start 2024-01-30T08:09:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 -- start start 2024-01-30T08:09:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b40c0ee0 0x7fe8b41f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8b40c1de0 0x7fe8b415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b414fbf0 0x7fe8b414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41545d0 con 0x7fe8b414fbf0 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40a9970 con 0x7fe8b40c1de0 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4151c70 con 0x7fe8b40c0ee0 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b414fbf0 0x7fe8b414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b414fbf0 0x7fe8b414b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49926/0 (socket says 172.21.15.50:49926) 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 -- 172.21.15.50:0/3820578628 learned_addr learned my addr 172.21.15.50:0/3820578628 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3400640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b40c0ee0 0x7fe8b41f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b2a00640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8b40c1de0 0x7fe8b415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 -- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b40c0ee0 msgr2=0x7fe8b41f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b40c0ee0 0x7fe8b41f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 -- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8b40c1de0 msgr2=0x7fe8b415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8b40c1de0 0x7fe8b415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 -- 172.21.15.50:0/3820578628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4009420 con 0x7fe8b414fbf0 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3400640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b40c0ee0 0x7fe8b41f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8b3e00640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b414fbf0 0x7fe8b414b950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c770 tx=0x7fe8ac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ab400640 1 -- 172.21.15.50:0/3820578628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac003b80 con 0x7fe8b414fbf0 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ab400640 1 -- 172.21.15.50:0/3820578628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac003ce0 con 0x7fe8b414fbf0 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b40a9b80 con 0x7fe8b414fbf0 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ab400640 1 -- 172.21.15.50:0/3820578628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac00aa30 con 0x7fe8b414fbf0 2024-01-30T08:09:17.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b40aa140 con 0x7fe8b414fbf0 2024-01-30T08:09:17.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.451+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b4074a20 con 0x7fe8b414fbf0 2024-01-30T08:09:17.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.455+0000 7fe8ab400640 1 -- 172.21.15.50:0/3820578628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe8ac00ab90 con 0x7fe8b414fbf0 2024-01-30T08:09:17.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.455+0000 7fe8ab400640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe88c066530 0x7fe88c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:17.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.455+0000 7fe8ab400640 1 -- 172.21.15.50:0/3820578628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8ac084000 con 0x7fe8b414fbf0 2024-01-30T08:09:17.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.455+0000 7fe8b3400640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe88c066530 0x7fe88c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:17.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.455+0000 7fe8b3400640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe88c066530 0x7fe88c0689f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40ad000 tx=0x7fe8a40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.459+0000 7fe8ab400640 1 -- 172.21.15.50:0/3820578628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe8ac050f30 con 0x7fe8b414fbf0 2024-01-30T08:09:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8b4156820 con 0x7fe8b414fbf0 2024-01-30T08:09:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ab400640 1 -- 172.21.15.50:0/3820578628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7fe8ac054550 con 0x7fe8b414fbf0 2024-01-30T08:09:17.654 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:17.654 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:17.655 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe88c066530 msgr2=0x7fe88c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe88c066530 0x7fe88c0689f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40ad000 tx=0x7fe8a40a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b414fbf0 msgr2=0x7fe8b414b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b414fbf0 0x7fe8b414b950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c770 tx=0x7fe8ac00cc30 comp rx=0 tx=0).stop 2024-01-30T08:09:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 shutdown_connections 2024-01-30T08:09:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8b40c1de0 0x7fe8b415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe88c066530 0x7fe88c0689f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b414fbf0 0x7fe8b414b950 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 --2- 172.21.15.50:0/3820578628 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8b40c0ee0 0x7fe8b41f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.651+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 >> 172.21.15.50:0/3820578628 conn(0x7fe8b40c5b50 msgr2=0x7fe8b414f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.655+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 shutdown_connections 2024-01-30T08:09:17.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:17.655+0000 7fe8ba000640 1 -- 172.21.15.50:0/3820578628 wait complete. 2024-01-30T08:09:18.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-30T08:08:41.658963+0000', 'modified': '2024-01-30T08:09:05.561508+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/987731246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6835', 'nonce': 987731246}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 987731246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-30T08:09:18.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-30T08:09:18.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-30T08:09:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.219+0000 7ff4b9200640 1 Processor -- start 2024-01-30T08:09:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.219+0000 7ff4b9200640 1 -- start start 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b9200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4b4158630 0x7ff4b40c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b9200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b40c4fb0 con 0x7ff4b40c19d0 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b9200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b40c4680 con 0x7ff4b4151e50 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b9200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40c4960 con 0x7ff4b4158630 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b1400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4b4158630 0x7ff4b40c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b2800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff4b40c19d0 0x7ff4b415ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37878/0 (socket says 172.21.15.50:37878) 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b1400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4b4158630 0x7ff4b40c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49942/0 (socket says 172.21.15.50:49942) 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b2800640 1 -- 172.21.15.50:0/877450202 learned_addr learned my addr 172.21.15.50:0/877450202 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b1400640 1 -- 172.21.15.50:0/877450202 >> v1:172.21.15.125:6789/0 conn(0x7ff4b4151e50 legacy=0x7ff4b40a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b1400640 1 -- 172.21.15.50:0/877450202 >> v1:172.21.15.50:6789/0 conn(0x7ff4b40c19d0 legacy=0x7ff4b415ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b1400640 1 -- 172.21.15.50:0/877450202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40c4c40 con 0x7ff4b4158630 2024-01-30T08:09:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.223+0000 7ff4b0a00640 1 -- 172.21.15.50:0/877450202 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346668273 0 0) 0x7ff4b40c4fb0 con 0x7ff4b40c19d0 2024-01-30T08:09:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b1400640 1 --2- 172.21.15.50:0/877450202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b40c6fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0097c0 tx=0x7ff49c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f142b2d1deccf050 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b0a00640 1 -- 172.21.15.50:0/877450202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0ab600 con 0x7ff4b4158630 2024-01-30T08:09:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b0a00640 1 -- 172.21.15.50:0/877450202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c0a7050 con 0x7ff4b4158630 2024-01-30T08:09:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b0a00640 1 -- 172.21.15.50:0/877450202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0ab980 con 0x7ff4b4158630 2024-01-30T08:09:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 -- 172.21.15.50:0/877450202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 msgr2=0x7ff4b40c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 --2- 172.21.15.50:0/877450202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b40c6fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0097c0 tx=0x7ff49c01c480 comp rx=0 tx=0).stop 2024-01-30T08:09:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 -- 172.21.15.50:0/877450202 shutdown_connections 2024-01-30T08:09:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 --2- 172.21.15.50:0/877450202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b40c6fe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 -- 172.21.15.50:0/877450202 >> 172.21.15.50:0/877450202 conn(0x7ff4b4072870 msgr2=0x7ff4b406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 -- 172.21.15.50:0/877450202 shutdown_connections 2024-01-30T08:09:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 -- 172.21.15.50:0/877450202 wait complete. 2024-01-30T08:09:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 Processor -- start 2024-01-30T08:09:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.227+0000 7ff4b9200640 1 -- start start 2024-01-30T08:09:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b40c19d0 0x7ff4b41ed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b4151e50 0x7ff4b4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b4150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41f0780 con 0x7ff4b4158630 2024-01-30T08:09:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b414ffc0 con 0x7ff4b4151e50 2024-01-30T08:09:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41502a0 con 0x7ff4b40c19d0 2024-01-30T08:09:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b4150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b4150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49946/0 (socket says 172.21.15.50:49946) 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 -- 172.21.15.50:0/3847988095 learned_addr learned my addr 172.21.15.50:0/3847988095 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b40c19d0 0x7ff4b41ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b1400640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b4151e50 0x7ff4b4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 -- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b40c19d0 msgr2=0x7ff4b41ed210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b40c19d0 0x7ff4b41ed210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 -- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b4151e50 msgr2=0x7ff4b4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b4151e50 0x7ff4b4154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 -- 172.21.15.50:0/3847988095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009420 con 0x7ff4b4158630 2024-01-30T08:09:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b2800640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b4150e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c7a0 tx=0x7ff4ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4aa000640 1 -- 172.21.15.50:0/3847988095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00a640 con 0x7ff4b4158630 2024-01-30T08:09:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4aa000640 1 -- 172.21.15.50:0/3847988095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00a7a0 con 0x7ff4b4158630 2024-01-30T08:09:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4aa000640 1 -- 172.21.15.50:0/3847988095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00abd0 con 0x7ff4b4158630 2024-01-30T08:09:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b4150580 con 0x7ff4b4158630 2024-01-30T08:09:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.231+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b41554b0 con 0x7ff4b4158630 2024-01-30T08:09:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4aa000640 1 -- 172.21.15.50:0/3847988095 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff4ac00ad30 con 0x7ff4b4158630 2024-01-30T08:09:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4aa000640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff48c066530 0x7ff48c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4aa000640 1 -- 172.21.15.50:0/3847988095 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4ac0838b0 con 0x7ff4b4158630 2024-01-30T08:09:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff48c066530 0x7ff48c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 Processor -- start 2024-01-30T08:09:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 -- start start 2024-01-30T08:09:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff48c066530 0x7ff48c0689f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4007fd0 tx=0x7ff4a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e65390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844e65cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844eaf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844cd1720 con 0x55c844e658d0 2024-01-30T08:09:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844cbfd70 con 0x55c844e64fb0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.235+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c844cbd2a0 con 0x55c844e661f0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844e65cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844e65cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49952/0 (socket says 172.21.15.50:49952) 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 -- 172.21.15.50:0/524007096 learned_addr learned my addr 172.21.15.50:0/524007096 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e65390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b2800640 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844eaf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 -- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 msgr2=0x55c844eaf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844eaf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 -- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 msgr2=0x55c844e65390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e65390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 -- 172.21.15.50:0/524007096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8449af890 con 0x55c844e658d0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4b1400640 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844e65cb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff49c019090 tx=0x7ff49c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd11e5a56fe88a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4a2a00640 1 -- 172.21.15.50:0/524007096 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0ab970 con 0x55c844e658d0 2024-01-30T08:09:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4a2a00640 1 -- 172.21.15.50:0/524007096 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c0abad0 con 0x55c844e658d0 2024-01-30T08:09:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4a2a00640 1 -- 172.21.15.50:0/524007096 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0abe40 con 0x55c844e658d0 2024-01-30T08:09:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 -- 172.21.15.50:0/524007096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 msgr2=0x55c844e65cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844e65cb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff49c019090 tx=0x7ff49c004740 comp rx=0 tx=0).stop 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 -- 172.21.15.50:0/524007096 shutdown_connections 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844eaf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844e65cb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/524007096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e65390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 -- 172.21.15.50:0/524007096 >> 172.21.15.50:0/524007096 conn(0x55c844ea3270 msgr2=0x55c844ea5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 -- 172.21.15.50:0/524007096 shutdown_connections 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 -- 172.21.15.50:0/524007096 wait complete. 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 -- start start 2024-01-30T08:09:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.239+0000 7ff4bc5be000 1 Processor -- start 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e6db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e658d0 0x55c844e6ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844cb8b90 con 0x55c844e661f0 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844c754c0 con 0x55c844e64fb0 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c844c73e10 con 0x55c844e658d0 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 10 client.0 _ll_register_callbacks cb 0x55c844c6ebe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49958/0 (socket says 172.21.15.50:49958) 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 -- 172.21.15.50:0/3983064357 learned_addr learned my addr 172.21.15.50:0/3983064357 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e6db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b1400640 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e658d0 0x55c844e6ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 -- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e658d0 msgr2=0x55c844e6ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e658d0 0x55c844e6ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 -- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 msgr2=0x55c844e6db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e6db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 -- 172.21.15.50:0/3983064357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40c4c40 con 0x55c844e661f0 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b2800640 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6b070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac054550 tx=0x7ff4ac054680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e82e6ec4e032d68 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 1 -- 172.21.15.50:0/3983064357 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac053cb0 con 0x55c844e661f0 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 1 -- 172.21.15.50:0/3983064357 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4ac05c380 con 0x55c844e661f0 2024-01-30T08:09:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c844c3ee30 con 0x55c844e661f0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 1 -- 172.21.15.50:0/3983064357 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4ac05c540 con 0x55c844e661f0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 10 client.4806 fetch_fsmap learned FSMap version 9 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55c844c78b80 con 0x55c844e661f0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 1 -- 172.21.15.50:0/3983064357 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c844c3ee30 con 0x55c844e661f0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 1 -- 172.21.15.50:0/3983064357 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ff4ac05a410 con 0x55c844e661f0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 10 client.4806 fetch_fsmap finished waiting for FSMap version 9 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 10 client.4806 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 20 client.4806 populate_metadata read hostname 'smithi050' 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ea1ef0 0x55c844ea22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 4 client.4806 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 --> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c844ce5bd0 con 0x55c844ea1ef0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ea1ef0 0x55c844ea22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ea1ef0 0x55c844ea22d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1216339396cfb757 server_cookie=de4d943af54a7e92 in_seq=0 out_seq=0 2024-01-30T08:09:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 10 client.4806 ms_handle_connect on v2:172.21.15.125:6835/987731246 2024-01-30T08:09:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 1 -- 172.21.15.50:0/3983064357 <== mds.0 v2:172.21.15.125:6835/987731246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c844ce5bd0 con 0x55c844ea1ef0 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff49b400640 10 client.4806 handle_command_reply: tid=0 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.243+0000 7ff4bc5be000 1 client.4806 shutdown 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 msgr2=0x55c844e6b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6b070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac054550 tx=0x7ff4ac054680 comp rx=0 tx=0).stop 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 shutdown_connections 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6b070 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e658d0 0x55c844e6ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ea1ef0 0x55c844ea22d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/3983064357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844e6db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 >> 172.21.15.50:0/3983064357 conn(0x55c844ea3270 msgr2=0x55c844e646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff49b400640 0 client.4806 ms_handle_reset on v2:172.21.15.125:6835/987731246 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 shutdown_connections 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 1 -- 172.21.15.50:0/3983064357 wait complete. 2024-01-30T08:09:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.247+0000 7ff4bc5be000 20 client.4806 trim_cache size 0 max 16384 2024-01-30T08:09:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 Processor -- start 2024-01-30T08:09:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- start start 2024-01-30T08:09:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e64fb0 0x55c844ebf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e658d0 0x55c844e6a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844970940 con 0x55c844e661f0 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844ea5890 con 0x55c844e658d0 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c844cc15c0 con 0x55c844e64fb0 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49966/0 (socket says 172.21.15.50:49966) 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 -- 172.21.15.50:0/2543474220 learned_addr learned my addr 172.21.15.50:0/2543474220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b1400640 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e658d0 0x55c844e6a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e64fb0 0x55c844ebf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 -- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e64fb0 msgr2=0x55c844ebf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e64fb0 0x55c844ebf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 -- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e658d0 msgr2=0x55c844e6a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e658d0 0x55c844e6a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 -- 172.21.15.50:0/2543474220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c844c5ebd0 con 0x55c844e661f0 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4b2800640 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6ae20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0542c0 tx=0x7ff4ac083050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63343582e47aed39 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4a2000640 1 -- 172.21.15.50:0/2543474220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac05c380 con 0x55c844e661f0 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4a2000640 1 -- 172.21.15.50:0/2543474220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac06be90 con 0x55c844e661f0 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4a2000640 1 -- 172.21.15.50:0/2543474220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac053cf0 con 0x55c844e661f0 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2543474220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 msgr2=0x55c844e6ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6ae20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0542c0 tx=0x7ff4ac083050 comp rx=0 tx=0).stop 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2543474220 shutdown_connections 2024-01-30T08:09:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e658d0 0x55c844e6a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e661f0 0x55c844e6ae20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2543474220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e64fb0 0x55c844ebf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2543474220 >> 172.21.15.50:0/2543474220 conn(0x55c844ea3270 msgr2=0x55c844eb5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2543474220 shutdown_connections 2024-01-30T08:09:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.263+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2543474220 wait complete. 2024-01-30T08:09:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 -- start start 2024-01-30T08:09:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 Processor -- start 2024-01-30T08:09:18.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844ebf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844ebb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844ebb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844cbb6f0 con 0x55c844e658d0 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c844c6ab40 con 0x55c844e64fb0 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c844cb5f90 con 0x55c844e661f0 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 10 client.0 _ll_register_callbacks cb 0x55c844e4d470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844ebb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844ebb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49968/0 (socket says 172.21.15.50:49968) 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 -- 172.21.15.50:0/2643648706 learned_addr learned my addr 172.21.15.50:0/2643648706 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844ebf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b2800640 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844ebb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 -- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 msgr2=0x55c844ebb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844ebb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 -- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 msgr2=0x55c844ebf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844ebf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 -- 172.21.15.50:0/2643648706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c844c78b80 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1400640 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844ebb3e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff49c008010 tx=0x7ff49c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e96c5813ea82607 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff49b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff49b400640 1 -- 172.21.15.50:0/2643648706 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0ab970 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff49b400640 1 -- 172.21.15.50:0/2643648706 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff49c0044d0 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c844c6c640 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff49b400640 1 -- 172.21.15.50:0/2643648706 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff49c006a30 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 10 client.4812 fetch_fsmap learned FSMap version 9 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55c8449afcc0 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff49b400640 1 -- 172.21.15.50:0/2643648706 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c844c6c640 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff49b400640 1 -- 172.21.15.50:0/2643648706 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ff49c0abad0 con 0x55c844e658d0 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 10 client.4812 fetch_fsmap finished waiting for FSMap version 9 2024-01-30T08:09:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 10 client.4812 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 20 client.4812 populate_metadata read hostname 'smithi050' 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ebbe60 0x55c844ebc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 4 client.4812 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 --> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c844cb1a20 con 0x55c844ebbe60 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.267+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ebbe60 0x55c844ebc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b1e00640 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ebbe60 0x55c844ebc240 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b226db51624540 server_cookie=b116d886e16a6edd in_seq=0 out_seq=0 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff49b400640 10 client.4812 ms_handle_connect on v2:172.21.15.125:6835/987731246 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff49b400640 1 -- 172.21.15.50:0/2643648706 <== mds.0 v2:172.21.15.125:6835/987731246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c844cb1a20 con 0x55c844ebbe60 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff49b400640 10 client.4812 handle_command_reply: tid=0 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 client.4812 shutdown 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 msgr2=0x55c844ebb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844ebb3e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff49c008010 tx=0x7ff49c01acc0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 shutdown_connections 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c844e661f0 0x55c844ebb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844e658d0 0x55c844ebb3e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:6835/987731246,v1:172.21.15.125:6837/987731246] conn(0x55c844ebbe60 0x55c844ebc240 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 --2- 172.21.15.50:0/2643648706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c844e64fb0 0x55c844ebf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff49b400640 0 client.4812 ms_handle_reset on v2:172.21.15.125:6835/987731246 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 >> 172.21.15.50:0/2643648706 conn(0x55c844ea3270 msgr2=0x55c844eac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 shutdown_connections 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 1 -- 172.21.15.50:0/2643648706 wait complete. 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4bc5be000 20 client.4812 trim_cache size 0 max 16384 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:09:18.280 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "d5419c7a-21ba-491f-86e9-4d6001549d1c", 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4267, 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 36.003950386, 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 9, 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 25, 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 43.080957797000003 2024-01-30T08:09:18.281 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff48c066530 msgr2=0x7ff48c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff48c066530 0x7ff48c0689f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4007fd0 tx=0x7ff4a4009040 comp rx=0 tx=0).stop 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 msgr2=0x7ff4b4150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b4150e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c7a0 tx=0x7ff4ac00cc60 comp rx=0 tx=0).stop 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 shutdown_connections 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b4151e50 0x7ff4b4154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff48c066530 0x7ff48c0689f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4b4158630 0x7ff4b4150e00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 --2- 172.21.15.50:0/3847988095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b40c19d0 0x7ff4b41ed210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 >> 172.21.15.50:0/3847988095 conn(0x7ff4b4072870 msgr2=0x7ff4b40c2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 shutdown_connections 2024-01-30T08:09:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.271+0000 7ff4b9200640 1 -- 172.21.15.50:0/3847988095 wait complete. 2024-01-30T08:09:18.295 INFO:teuthology.run_tasks:Running task kclient... 2024-01-30T08:09:18.309 INFO:tasks.kclient:Mounting kernel clients... 2024-01-30T08:09:18.310 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-01-30T08:09:18.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:18.310 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-01-30T08:09:18.320 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-30T08:09:18.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:18.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-30T08:09:18.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:18.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-01-30T08:09:18.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:18.599 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-01-30T08:09:18.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:18.609 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2024-01-30T08:09:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:Cannot find device "ceph-brx" 2024-01-30T08:09:18.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:09:18.676 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-01-30T08:09:18.676 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-30T08:09:18.676 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-30T08:09:18.677 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-30T08:09:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff4400640 1 Processor -- start 2024-01-30T08:09:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff4400640 1 -- start start 2024-01-30T08:09:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff4400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fafec06c390 0x7fafec14f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff4400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafec06f450 con 0x7fafec072210 2024-01-30T08:09:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff4400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafec153340 con 0x7fafec152e40 2024-01-30T08:09:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff4400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec06afb0 con 0x7fafec06c390 2024-01-30T08:09:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff2e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fafec072210 0x7fafec15cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37894/0 (socket says 172.21.15.50:37894) 2024-01-30T08:09:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff2e00640 1 -- 172.21.15.50:0/981491445 learned_addr learned my addr 172.21.15.50:0/981491445 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.815+0000 7faff1a00640 1 --2- 172.21.15.50:0/981491445 >> v2:172.21.15.125:3300/0 conn(0x7fafec06c390 0x7fafec14f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402549581 0 0) 0x7fafec06f450 con 0x7fafec072210 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafcc003530 con 0x7fafec072210 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167744467 0 0) 0x7fafec153340 con 0x7fafec152e40 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafec06f450 con 0x7fafec152e40 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 29923103 0 0) 0x7fafcc003530 con 0x7fafec072210 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 >> v2:172.21.15.125:3300/0 conn(0x7fafec06c390 msgr2=0x7fafec14f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 --2- 172.21.15.50:0/981491445 >> v2:172.21.15.125:3300/0 conn(0x7fafec06c390 0x7fafec14f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 >> v1:172.21.15.125:6789/0 conn(0x7fafec152e40 legacy=0x7fafec071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec06eb20 con 0x7fafec072210 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fafe4001a00 con 0x7fafec072210 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 >> v1:172.21.15.50:6789/0 conn(0x7fafec072210 legacy=0x7fafec15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc003b60 0x7fafcc003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafcc0047d0 0x7fafcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0051e0 0x7fafcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc00c0e0 con 0x7fafcc0047d0 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc00c250 con 0x7fafcc003b60 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc00c410 con 0x7fafcc0051e0 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff1000640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafcc0047d0 0x7fafcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff1a00640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc003b60 0x7fafcc003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff2e00640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0051e0 0x7fafcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff1000640 1 -- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0051e0 msgr2=0x7fafcc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff1000640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0051e0 0x7fafcc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff1000640 1 -- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc003b60 msgr2=0x7fafcc003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff1000640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafcc003b60 0x7fafcc003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff1000640 1 -- 172.21.15.50:0/981491445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc003530 con 0x7fafcc0047d0 2024-01-30T08:09:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.819+0000 7faff2e00640 1 -- 172.21.15.50:0/981491445 reap_dead start 2024-01-30T08:09:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff1000640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafcc0047d0 0x7fafcc004c50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fafd40018d0 tx=0x7fafd401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cd828d9736cf7a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40a7070 con 0x7fafcc0047d0 2024-01-30T08:09:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd40050d0 con 0x7fafcc0047d0 2024-01-30T08:09:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7fafebe00640 1 -- 172.21.15.50:0/981491445 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40054a0 con 0x7fafcc0047d0 2024-01-30T08:09:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 -- 172.21.15.50:0/981491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafcc0047d0 msgr2=0x7fafcc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafcc0047d0 0x7fafcc004c50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fafd40018d0 tx=0x7fafd401c4f0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 -- 172.21.15.50:0/981491445 shutdown_connections 2024-01-30T08:09:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 --2- 172.21.15.50:0/981491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafcc0047d0 0x7fafcc004c50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 -- 172.21.15.50:0/981491445 >> 172.21.15.50:0/981491445 conn(0x7fafec0c74a0 msgr2=0x7fafec0c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 -- 172.21.15.50:0/981491445 shutdown_connections 2024-01-30T08:09:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 -- 172.21.15.50:0/981491445 wait complete. 2024-01-30T08:09:18.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 Processor -- start 2024-01-30T08:09:18.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.823+0000 7faff4400640 1 -- start start 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0047d0 0x7fafec0bc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafec1eeab0 0x7fafec1eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafec155630 0x7fafec155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0bcc50 con 0x7fafec155630 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec1551a0 con 0x7fafec1eeab0 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec155ff0 con 0x7fafcc0047d0 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafec155630 0x7fafec155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafec155630 0x7fafec155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49978/0 (socket says 172.21.15.50:49978) 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 -- 172.21.15.50:0/2141603411 learned_addr learned my addr 172.21.15.50:0/2141603411 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff1a00640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0047d0 0x7fafec0bc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff1000640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafec1eeab0 0x7fafec1eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 -- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0047d0 msgr2=0x7fafec0bc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0047d0 0x7fafec0bc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 -- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafec1eeab0 msgr2=0x7fafec1eef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafec1eeab0 0x7fafec1eef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 -- 172.21.15.50:0/2141603411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec1ef540 con 0x7fafec155630 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff1000640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafec1eeab0 0x7fafec1eef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff2e00640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafec155630 0x7fafec155ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fafec0c1710 tx=0x7fafe4007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7fafe9600640 1 -- 172.21.15.50:0/2141603411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400aa60 con 0x7fafec155630 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7fafe9600640 1 -- 172.21.15.50:0/2141603411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe400abe0 con 0x7fafec155630 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7fafe9600640 1 -- 172.21.15.50:0/2141603411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40133f0 con 0x7fafec155630 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec0a7730 con 0x7fafec155630 2024-01-30T08:09:18.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec0a7cf0 con 0x7fafec155630 2024-01-30T08:09:18.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec152490 con 0x7fafec155630 2024-01-30T08:09:18.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.827+0000 7fafe9600640 1 -- 172.21.15.50:0/2141603411 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fafe4013550 con 0x7fafec155630 2024-01-30T08:09:18.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.831+0000 7fafe9600640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fafc4066500 0x7fafc40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:18.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.831+0000 7fafe9600640 1 -- 172.21.15.50:0/2141603411 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafe4084650 con 0x7fafec155630 2024-01-30T08:09:18.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.831+0000 7faff1a00640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fafc4066500 0x7fafc40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:18.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.831+0000 7faff1a00640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fafc4066500 0x7fafc40689c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafec069730 tx=0x7fafdc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:18.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:18.835+0000 7fafe9600640 1 -- 172.21.15.50:0/2141603411 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fafe40515f0 con 0x7fafec155630 2024-01-30T08:09:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.031+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fafec074ba0 con 0x7fafec155630 2024-01-30T08:09:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.031+0000 7fafe9600640 1 -- 172.21.15.50:0/2141603411 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fafe4054c10 con 0x7fafec155630 2024-01-30T08:09:19.035 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fafc4066500 msgr2=0x7fafc40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fafc4066500 0x7fafc40689c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafec069730 tx=0x7fafdc009190 comp rx=0 tx=0).stop 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafec155630 msgr2=0x7fafec155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafec155630 0x7fafec155ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fafec0c1710 tx=0x7fafe4007b10 comp rx=0 tx=0).stop 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 shutdown_connections 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafec1eeab0 0x7fafec1eef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fafc4066500 0x7fafc40689c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafec155630 0x7fafec155ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 --2- 172.21.15.50:0/2141603411 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fafcc0047d0 0x7fafec0bc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 >> 172.21.15.50:0/2141603411 conn(0x7fafec0c74a0 msgr2=0x7fafec0c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 shutdown_connections 2024-01-30T08:09:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:19.035+0000 7faff4400640 1 -- 172.21.15.50:0/2141603411 wait complete. 2024-01-30T08:09:19.056 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-30T08:09:19.056 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-30T08:09:19.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-01-30T08:09:19.057 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-30T08:09:19.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-30T08:09:19.057 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-30T08:09:19.057 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-30T08:09:19.057 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-30T08:09:19.057 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:09:19.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.057 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-01-30T08:09:19.066 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-30T08:09:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-30T08:09:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-30T08:09:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42451sec preferred_lft 42451sec 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:71:66:23:2b brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-30T08:09:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:19.069 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-30T08:09:19.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.069 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:09:19.070 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:09:19.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-01-30T08:09:19.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-01-30T08:09:19.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-01-30T08:09:19.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-30T08:09:19.070 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:09:19.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.179 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-30T08:09:19.198 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-01-30T08:09:19.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.201 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-01-30T08:09:19.254 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-01-30T08:09:19.254 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-30T08:09:19.254 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-30T08:09:19.254 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-30T08:09:19.254 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-30T08:09:19.254 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-30T08:09:19.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.254 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:09:19.255 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:09:19.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-30T08:09:19.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-30T08:09:19.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-30T08:09:19.255 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:09:19.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.345 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-01-30T08:09:19.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.356 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-01-30T08:09:19.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.404 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:09:19.405 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:09:19.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-30T08:09:19.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-30T08:09:19.405 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:09:19.490 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-30T08:09:19.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.490 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:09:19.490 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:09:19.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-30T08:09:19.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-30T08:09:19.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-30T08:09:19.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-30T08:09:19.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-30T08:09:19.491 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:09:19.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.632 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:09:19.632 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:09:19.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-01-30T08:09:19.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-01-30T08:09:19.632 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:09:19.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:09:19.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:09:19.673 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-30T08:09:19.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:09:19.730 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:09:19.730 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:09:19.730 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-30T08:09:19.819 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-30T08:09:19.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:19.819 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:09:19.909 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:09:19.909 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-30T08:09:19.910 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:09:20.427 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:09:20.427 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-30T08:09:20.428 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:09:20.428 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:09:20.428 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790" 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790:/ 2024-01-30T08:09:20.439 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d5419c7a-21ba-491f-86e9-4d6001549d1c" will pass to kernel 2024-01-30T08:09:20.443 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-30T08:09:20.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:20.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-30T08:09:20.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:20.463 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:09:20.515 INFO:teuthology.orchestra.run.smithi050.stdout:client4821 2024-01-30T08:09:20.516 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:09:20.516 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:20.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:20.568 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:09:20.623 INFO:teuthology.orchestra.run.smithi050.stdout:client4821 2024-01-30T08:09:20.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:20.624 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:09:20.675 INFO:teuthology.orchestra.run.smithi050.stdout:client4821 2024-01-30T08:09:20.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:20.675 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d5419c7a-21ba-491f-86e9-4d6001549d1c.client4821/status') 2024-01-30T08:09:20.735 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.4821 (3)192.168.0.1:0/339117268 2024-01-30T08:09:20.735 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2024-01-30T08:09:20.736 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2024-01-30T08:09:20.736 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2024-01-30T08:09:20.736 INFO:teuthology.orchestra.run.smithi050.stderr:68 bytes copied, 5.5312e-05 s, 1.2 MB/s 2024-01-30T08:09:20.740 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-01-30T08:09:20.740 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-30T08:09:20.740 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-30T08:09:20.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-30T08:09:20.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.919+0000 7fa330000640 1 Processor -- start 2024-01-30T08:09:20.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.919+0000 7fa330000640 1 -- start start 2024-01-30T08:09:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa330000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3280a7120 0x7fa3281584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa330000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa32815f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa330000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280c7b40 con 0x7fa32806de40 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa330000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280a7770 con 0x7fa3280a7120 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa330000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa328155310 con 0x7fa32806e220 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32cc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3280a7120 0x7fa3281584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32d600640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa32806de40 0x7fa328157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60838/0 (socket says 172.21.15.50:60838) 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32d600640 1 -- 172.21.15.50:0/2703646132 learned_addr learned my addr 172.21.15.50:0/2703646132 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32e000640 1 --2- 172.21.15.50:0/2703646132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa32815f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32cc00640 1 -- 172.21.15.50:0/2703646132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 msgr2=0x7fa32815f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32cc00640 1 --2- 172.21.15.50:0/2703646132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa32815f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32cc00640 1 -- 172.21.15.50:0/2703646132 >> v1:172.21.15.50:6789/0 conn(0x7fa32806de40 legacy=0x7fa328157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa327e00640 1 -- 172.21.15.50:0/2703646132 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80350144 0 0) 0x7fa318001120 con 0x7fa32806de40 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32cc00640 1 -- 172.21.15.50:0/2703646132 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328155730 con 0x7fa3280a7120 2024-01-30T08:09:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.923+0000 7fa32e000640 1 --2- 172.21.15.50:0/2703646132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa32815f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:20.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa32cc00640 1 --2- 172.21.15.50:0/2703646132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa3281584a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3100097c0 tx=0x7fa31001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c006c764fa6007 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa327e00640 1 -- 172.21.15.50:0/2703646132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100ab600 con 0x7fa3280a7120 2024-01-30T08:09:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa327e00640 1 -- 172.21.15.50:0/2703646132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3100a7050 con 0x7fa3280a7120 2024-01-30T08:09:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa327e00640 1 -- 172.21.15.50:0/2703646132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100ab980 con 0x7fa3280a7120 2024-01-30T08:09:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 -- 172.21.15.50:0/2703646132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 msgr2=0x7fa3281584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 --2- 172.21.15.50:0/2703646132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa3281584a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3100097c0 tx=0x7fa31001c480 comp rx=0 tx=0).stop 2024-01-30T08:09:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 -- 172.21.15.50:0/2703646132 shutdown_connections 2024-01-30T08:09:20.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 --2- 172.21.15.50:0/2703646132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa32815f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:20.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 --2- 172.21.15.50:0/2703646132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa3281584a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:20.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 -- 172.21.15.50:0/2703646132 >> 172.21.15.50:0/2703646132 conn(0x7fa3280c4830 msgr2=0x7fa3280c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:20.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 -- 172.21.15.50:0/2703646132 shutdown_connections 2024-01-30T08:09:20.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 -- 172.21.15.50:0/2703646132 wait complete. 2024-01-30T08:09:20.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 Processor -- start 2024-01-30T08:09:20.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.927+0000 7fa330000640 1 -- start start 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa32806de40 0x7fa3281edab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa3280a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa328156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281ed620 con 0x7fa3280a7120 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280a8430 con 0x7fa32806de40 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281ed010 con 0x7fa32806e220 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa328156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa328156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35558/0 (socket says 172.21.15.50:35558) 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 -- 172.21.15.50:0/1772312654 learned_addr learned my addr 172.21.15.50:0/1772312654 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32cc00640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa3280a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32d600640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa32806de40 0x7fa3281edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 -- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 msgr2=0x7fa3280a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa3280a8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 -- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa32806de40 msgr2=0x7fa3281edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa32806de40 0x7fa3281edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 -- 172.21.15.50:0/1772312654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310009420 con 0x7fa3280a7120 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa32e000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa328156c10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa32000cf20 tx=0x7fa32000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa325600640 1 -- 172.21.15.50:0/1772312654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000d840 con 0x7fa3280a7120 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa325600640 1 -- 172.21.15.50:0/1772312654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000d9a0 con 0x7fa3280a7120 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3280a86a0 con 0x7fa3280a7120 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa325600640 1 -- 172.21.15.50:0/1772312654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000dd50 con 0x7fa3280a7120 2024-01-30T08:09:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3281ed2b0 con 0x7fa3280a7120 2024-01-30T08:09:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa328074a20 con 0x7fa3280a7120 2024-01-30T08:09:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.931+0000 7fa325600640 1 -- 172.21.15.50:0/1772312654 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa32001e3b0 con 0x7fa3280a7120 2024-01-30T08:09:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.935+0000 7fa325600640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa300066500 0x7fa3000689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.935+0000 7fa325600640 1 -- 172.21.15.50:0/1772312654 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa320084c60 con 0x7fa3280a7120 2024-01-30T08:09:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.935+0000 7fa32d600640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa300066500 0x7fa3000689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.935+0000 7fa32d600640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa300066500 0x7fa3000689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa318007fd0 tx=0x7fa3180079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:20.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:20.939+0000 7fa325600640 1 -- 172.21.15.50:0/1772312654 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa320051c00 con 0x7fa3280a7120 2024-01-30T08:09:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa32806ee10 con 0x7fa3280a7120 2024-01-30T08:09:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa325600640 1 -- 172.21.15.50:0/1772312654 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa32001a020 con 0x7fa3280a7120 2024-01-30T08:09:21.137 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa300066500 msgr2=0x7fa3000689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa300066500 0x7fa3000689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa318007fd0 tx=0x7fa3180079c0 comp rx=0 tx=0).stop 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 msgr2=0x7fa328156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa328156c10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa32000cf20 tx=0x7fa32000a7d0 comp rx=0 tx=0).stop 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 shutdown_connections 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa300066500 0x7fa3000689c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280a7120 0x7fa328156c10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:21.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa32806e220 0x7fa3280a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:21.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 --2- 172.21.15.50:0/1772312654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa32806de40 0x7fa3281edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:21.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 >> 172.21.15.50:0/1772312654 conn(0x7fa3280c4830 msgr2=0x7fa328157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:21.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 shutdown_connections 2024-01-30T08:09:21.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:21.135+0000 7fa330000640 1 -- 172.21.15.50:0/1772312654 wait complete. 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-30T08:09:21.159 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:09:21.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.160 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:21.170 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42455sec preferred_lft 42455sec 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:a8:fd:47:70 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-30T08:09:21.171 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:09:21.171 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-30T08:09:21.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.172 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-01-30T08:09:21.172 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-01-30T08:09:21.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2024-01-30T08:09:21.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2024-01-30T08:09:21.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2024-01-30T08:09:21.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-30T08:09:21.172 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-01-30T08:09:21.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.286 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-30T08:09:21.305 INFO:teuthology.orchestra.run.smithi125.stdout:1 2024-01-30T08:09:21.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.307 DEBUG:teuthology.orchestra.run.smithi125:> route 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:09:21.380 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-30T08:09:21.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.381 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-01-30T08:09:21.381 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-01-30T08:09:21.381 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-30T08:09:21.381 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-30T08:09:21.381 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-30T08:09:21.381 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-01-30T08:09:21.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.472 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-01-30T08:09:21.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.481 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2024-01-30T08:09:21.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.530 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-01-30T08:09:21.530 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-01-30T08:09:21.530 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-30T08:09:21.530 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-30T08:09:21.530 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-01-30T08:09:21.613 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-30T08:09:21.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.613 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-01-30T08:09:21.613 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-01-30T08:09:21.613 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-30T08:09:21.613 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-30T08:09:21.614 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-30T08:09:21.614 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-30T08:09:21.614 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-30T08:09:21.614 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-01-30T08:09:21.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.783 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-01-30T08:09:21.783 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-01-30T08:09:21.783 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2024-01-30T08:09:21.783 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2024-01-30T08:09:21.783 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-01-30T08:09:21.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:09:21.822 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-30T08:09:21.873 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:09:21.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:09:21.874 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-30T08:09:21.925 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-30T08:09:21.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:21.925 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:09:22.026 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:09:22.027 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-30T08:09:22.027 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:09:22.561 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:09:22.561 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-30T08:09:22.561 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:09:22.561 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:09:22.561 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:09:22.573 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:09:22.574 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-30T08:09:22.574 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:09:22.574 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:09:22.574 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:09:22.574 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790" 2024-01-30T08:09:22.574 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790:/ 2024-01-30T08:09:22.574 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=d5419c7a-21ba-491f-86e9-4d6001549d1c" will pass to kernel 2024-01-30T08:09:22.578 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-30T08:09:22.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:22.578 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-30T08:09:22.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:22.598 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:09:22.660 INFO:teuthology.orchestra.run.smithi125.stdout:client4833 2024-01-30T08:09:22.660 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:09:22.660 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:22.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:22.709 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:09:22.766 INFO:teuthology.orchestra.run.smithi125.stdout:client4833 2024-01-30T08:09:22.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:22.766 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:09:22.820 INFO:teuthology.orchestra.run.smithi125.stdout:client4833 2024-01-30T08:09:22.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:22.821 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d5419c7a-21ba-491f-86e9-4d6001549d1c.client4833/status') 2024-01-30T08:09:22.880 INFO:teuthology.orchestra.run.smithi125.stdout:instance: client.4833 (3)172.21.15.125:0/3662444818 2024-01-30T08:09:22.881 INFO:teuthology.orchestra.run.smithi125.stdout:blocklisted: false 2024-01-30T08:09:22.881 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records in 2024-01-30T08:09:22.881 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records out 2024-01-30T08:09:22.881 INFO:teuthology.orchestra.run.smithi125.stderr:71 bytes copied, 4.8842e-05 s, 1.5 MB/s 2024-01-30T08:09:22.883 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-30T08:09:22.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.047+0000 7fc71dc00640 1 Processor -- start 2024-01-30T08:09:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.047+0000 7fc71dc00640 1 -- start start 2024-01-30T08:09:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc71dc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7180c3a30 0x7fc71806a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc71dc00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc718158a30 con 0x7fc718156030 2024-01-30T08:09:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc71dc00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc718156410 con 0x7fc71806ac80 2024-01-30T08:09:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc71dc00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7180c22e0 con 0x7fc7180c3a30 2024-01-30T08:09:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc716000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7180c3a30 0x7fc71806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc716a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc718156030 0x7fc7180aa9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60854/0 (socket says 172.21.15.50:60854) 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc716000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7180c3a30 0x7fc71806a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35560/0 (socket says 172.21.15.50:35560) 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc716a00640 1 -- 172.21.15.50:0/1580943201 learned_addr learned my addr 172.21.15.50:0/1580943201 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc717400640 1 --1- 172.21.15.50:0/1580943201 >> v1:172.21.15.125:6789/0 conn(0x7fc71806ac80 0x7fc7180c04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:46704/0 (socket says 172.21.15.50:46704) 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc716000640 1 -- 172.21.15.50:0/1580943201 >> v1:172.21.15.125:6789/0 conn(0x7fc71806ac80 legacy=0x7fc7180c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc715600640 1 -- 172.21.15.50:0/1580943201 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128324908 0 0) 0x7fc718156410 con 0x7fc71806ac80 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc716000640 1 -- 172.21.15.50:0/1580943201 >> v1:172.21.15.50:6789/0 conn(0x7fc718156030 legacy=0x7fc7180aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.051+0000 7fc716000640 1 -- 172.21.15.50:0/1580943201 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718158cf0 con 0x7fc7180c3a30 2024-01-30T08:09:23.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc716000640 1 --2- 172.21.15.50:0/1580943201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71806a740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc7000097c0 tx=0x7fc70001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17534d915ec63a23 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc715600640 1 -- 172.21.15.50:0/1580943201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000ab600 con 0x7fc7180c3a30 2024-01-30T08:09:23.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc715600640 1 -- 172.21.15.50:0/1580943201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000a7050 con 0x7fc7180c3a30 2024-01-30T08:09:23.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc715600640 1 -- 172.21.15.50:0/1580943201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000ab980 con 0x7fc7180c3a30 2024-01-30T08:09:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 -- 172.21.15.50:0/1580943201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 msgr2=0x7fc71806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 --2- 172.21.15.50:0/1580943201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71806a740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc7000097c0 tx=0x7fc70001c310 comp rx=0 tx=0).stop 2024-01-30T08:09:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 -- 172.21.15.50:0/1580943201 shutdown_connections 2024-01-30T08:09:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 --2- 172.21.15.50:0/1580943201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71806a740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 -- 172.21.15.50:0/1580943201 >> 172.21.15.50:0/1580943201 conn(0x7fc7180c5b50 msgr2=0x7fc7180c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 -- 172.21.15.50:0/1580943201 shutdown_connections 2024-01-30T08:09:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 -- 172.21.15.50:0/1580943201 wait complete. 2024-01-30T08:09:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 Processor -- start 2024-01-30T08:09:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.055+0000 7fc71dc00640 1 -- start start 2024-01-30T08:09:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc71806ac80 0x7fc7181f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc718156030 0x7fc7181f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181f4c30 con 0x7fc7180c3a30 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71814bc00 con 0x7fc718156030 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc718150b00 con 0x7fc71806ac80 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71814c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35564/0 (socket says 172.21.15.50:35564) 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 -- 172.21.15.50:0/2641448373 learned_addr learned my addr 172.21.15.50:0/2641448373 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc717400640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc718156030 0x7fc7181f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716a00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc71806ac80 0x7fc7181f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 -- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc71806ac80 msgr2=0x7fc7181f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc71806ac80 0x7fc7181f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 -- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc718156030 msgr2=0x7fc7181f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc718156030 0x7fc7181f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 -- 172.21.15.50:0/2641448373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700009420 con 0x7fc7180c3a30 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc717400640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc718156030 0x7fc7181f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc716000640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71814c2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc7000ae040 tx=0x7fc70001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc70ea00640 1 -- 172.21.15.50:0/2641448373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000b7650 con 0x7fc7180c3a30 2024-01-30T08:09:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc70ea00640 1 -- 172.21.15.50:0/2641448373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000abe90 con 0x7fc7180c3a30 2024-01-30T08:09:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc70ea00640 1 -- 172.21.15.50:0/2641448373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000b7a10 con 0x7fc7180c3a30 2024-01-30T08:09:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7181f16f0 con 0x7fc7180c3a30 2024-01-30T08:09:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc718150820 con 0x7fc7180c3a30 2024-01-30T08:09:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.059+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7181f4d70 con 0x7fc7180c3a30 2024-01-30T08:09:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.063+0000 7fc70ea00640 1 -- 172.21.15.50:0/2641448373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc7000b7b70 con 0x7fc7180c3a30 2024-01-30T08:09:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.063+0000 7fc70ea00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc6f0066500 0x7fc6f00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.063+0000 7fc70ea00640 1 -- 172.21.15.50:0/2641448373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc70011e9e0 con 0x7fc7180c3a30 2024-01-30T08:09:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.063+0000 7fc716a00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc6f0066500 0x7fc6f00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.063+0000 7fc716a00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc6f0066500 0x7fc6f00689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc708005eb0 tx=0x7fc708007cd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.067+0000 7fc70ea00640 1 -- 172.21.15.50:0/2641448373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc7181f4d70 con 0x7fc7180c3a30 2024-01-30T08:09:23.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7181f4d70 con 0x7fc7180c3a30 2024-01-30T08:09:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc70ea00640 1 -- 172.21.15.50:0/2641448373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7fc7181f4d70 con 0x7fc7180c3a30 2024-01-30T08:09:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:23.242 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc6f0066500 msgr2=0x7fc6f00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc6f0066500 0x7fc6f00689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc708005eb0 tx=0x7fc708007cd0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 msgr2=0x7fc71814c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71814c2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc7000ae040 tx=0x7fc70001ab50 comp rx=0 tx=0).stop 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 shutdown_connections 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc718156030 0x7fc7181f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc6f0066500 0x7fc6f00689c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7180c3a30 0x7fc71814c2a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 --2- 172.21.15.50:0/2641448373 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc71806ac80 0x7fc7181f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 >> 172.21.15.50:0/2641448373 conn(0x7fc7180c5b50 msgr2=0x7fc7180c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:23.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 shutdown_connections 2024-01-30T08:09:23.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.239+0000 7fc71dc00640 1 -- 172.21.15.50:0/2641448373 wait complete. 2024-01-30T08:09:23.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:23.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:23.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8579c00640 1 Processor -- start 2024-01-30T08:09:23.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8579c00640 1 -- start start 2024-01-30T08:09:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8579c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8574155500 0x7f85740c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8579c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8574158b70 con 0x7f857406f6d0 2024-01-30T08:09:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8579c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8574157f60 con 0x7f857406f240 2024-01-30T08:09:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8579c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857406fae0 con 0x7f8574155500 2024-01-30T08:09:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8572a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8574155500 0x7f85740c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8573400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f857406f6d0 0x7f85740c1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60868/0 (socket says 172.21.15.50:60868) 2024-01-30T08:09:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8573400640 1 -- 172.21.15.50:0/3047632196 learned_addr learned my addr 172.21.15.50:0/3047632196 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8572a00640 1 -- 172.21.15.50:0/3047632196 >> v1:172.21.15.125:6789/0 conn(0x7f857406f240 legacy=0x7f85740c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8572a00640 1 -- 172.21.15.50:0/3047632196 >> v1:172.21.15.50:6789/0 conn(0x7f857406f6d0 legacy=0x7f85740c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8572a00640 1 -- 172.21.15.50:0/3047632196 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574158240 con 0x7f8574155500 2024-01-30T08:09:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.407+0000 7f8571600640 1 -- 172.21.15.50:0/3047632196 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566713453 0 0) 0x7f8574158b70 con 0x7f857406f6d0 2024-01-30T08:09:23.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8572a00640 1 --2- 172.21.15.50:0/3047632196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8574155500 0x7f85740c85e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f857406fc20 tx=0x7f856401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78a712e65f352fe server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8571600640 1 -- 172.21.15.50:0/3047632196 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640ab600 con 0x7f8574155500 2024-01-30T08:09:23.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8571600640 1 -- 172.21.15.50:0/3047632196 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85640a7050 con 0x7f8574155500 2024-01-30T08:09:23.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8571600640 1 -- 172.21.15.50:0/3047632196 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640ab980 con 0x7f8574155500 2024-01-30T08:09:23.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8579c00640 1 -- 172.21.15.50:0/3047632196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8574155500 msgr2=0x7f85740c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8579c00640 1 --2- 172.21.15.50:0/3047632196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8574155500 0x7f85740c85e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f857406fc20 tx=0x7f856401c330 comp rx=0 tx=0).stop 2024-01-30T08:09:23.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8579c00640 1 -- 172.21.15.50:0/3047632196 shutdown_connections 2024-01-30T08:09:23.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8579c00640 1 --2- 172.21.15.50:0/3047632196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8574155500 0x7f85740c85e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8579c00640 1 -- 172.21.15.50:0/3047632196 >> 172.21.15.50:0/3047632196 conn(0x7f85740727c0 msgr2=0x7f857406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:23.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8579c00640 1 -- 172.21.15.50:0/3047632196 shutdown_connections 2024-01-30T08:09:23.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.411+0000 7f8579c00640 1 -- 172.21.15.50:0/3047632196 wait complete. 2024-01-30T08:09:23.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 Processor -- start 2024-01-30T08:09:23.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 -- start start 2024-01-30T08:09:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857406f240 0x7f85740abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857406f6d0 0x7f85740ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8574155500 0x7f85740a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740a86a0 con 0x7f857406f240 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740ac820 con 0x7f857406f6d0 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85740c3000 con 0x7f8574155500 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857406f240 0x7f85740abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857406f240 0x7f85740abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35572/0 (socket says 172.21.15.50:35572) 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 -- 172.21.15.50:0/217538809 learned_addr learned my addr 172.21.15.50:0/217538809 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8573400640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8574155500 0x7f85740a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572000640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857406f6d0 0x7f85740ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 -- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8574155500 msgr2=0x7f85740a8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8574155500 0x7f85740a8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 -- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857406f6d0 msgr2=0x7f85740ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857406f6d0 0x7f85740ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 -- 172.21.15.50:0/217538809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009420 con 0x7f857406f240 2024-01-30T08:09:23.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8573400640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8574155500 0x7f85740a8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:23.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8572a00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857406f240 0x7f85740abda0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85640ae040 tx=0x7f856401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f856aa00640 1 -- 172.21.15.50:0/217538809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640b7650 con 0x7f857406f240 2024-01-30T08:09:23.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f856aa00640 1 -- 172.21.15.50:0/217538809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85640b77b0 con 0x7f857406f240 2024-01-30T08:09:23.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f856aa00640 1 -- 172.21.15.50:0/217538809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640b7b60 con 0x7f857406f240 2024-01-30T08:09:23.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85740c3500 con 0x7f857406f240 2024-01-30T08:09:23.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85741ed620 con 0x7f857406f240 2024-01-30T08:09:23.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.415+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85741ed480 con 0x7f857406f240 2024-01-30T08:09:23.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.419+0000 7f856aa00640 1 -- 172.21.15.50:0/217538809 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f85640b7cc0 con 0x7f857406f240 2024-01-30T08:09:23.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.419+0000 7f856aa00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f854c066500 0x7f854c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.419+0000 7f856aa00640 1 -- 172.21.15.50:0/217538809 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f856411eba0 con 0x7f857406f240 2024-01-30T08:09:23.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.419+0000 7f8572000640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f854c066500 0x7f854c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.419+0000 7f8572000640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f854c066500 0x7f854c0689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f857414eb90 tx=0x7f855c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.423+0000 7f856aa00640 1 -- 172.21.15.50:0/217538809 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f85741ed480 con 0x7f857406f240 2024-01-30T08:09:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.583+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85741ed480 con 0x7f857406f240 2024-01-30T08:09:23.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.583+0000 7f856aa00640 1 -- 172.21.15.50:0/217538809 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85741ed480 con 0x7f857406f240 2024-01-30T08:09:23.587 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f854c066500 msgr2=0x7f854c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f854c066500 0x7f854c0689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f857414eb90 tx=0x7f855c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857406f240 msgr2=0x7f85740abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857406f240 0x7f85740abda0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85640ae040 tx=0x7f856401ab70 comp rx=0 tx=0).stop 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 shutdown_connections 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f857406f6d0 0x7f85740ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f854c066500 0x7f854c0689c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8574155500 0x7f85740a8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 --2- 172.21.15.50:0/217538809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857406f240 0x7f85740abda0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 >> 172.21.15.50:0/217538809 conn(0x7f85740727c0 msgr2=0x7f85740c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:23.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 shutdown_connections 2024-01-30T08:09:23.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.587+0000 7f8579c00640 1 -- 172.21.15.50:0/217538809 wait complete. 2024-01-30T08:09:23.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:23.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f9200640 1 Processor -- start 2024-01-30T08:09:23.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f9200640 1 -- start start 2024-01-30T08:09:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f9200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a4da0 0x7ff3f4153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f9200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3f40c04b0 0x7ff3f406ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f9200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f40c54e0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f9200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f4152bf0 con 0x7ff3f40a4da0 2024-01-30T08:09:23.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f9200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f4072d90 con 0x7ff3f40c04b0 2024-01-30T08:09:23.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f1400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a4da0 0x7ff3f4153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f1400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f40a4da0 0x7ff3f4153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35584/0 (socket says 172.21.15.50:35584) 2024-01-30T08:09:23.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f1400640 1 -- 172.21.15.50:0/2473080402 learned_addr learned my addr 172.21.15.50:0/2473080402 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:23.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f1400640 1 -- 172.21.15.50:0/2473080402 >> v2:172.21.15.125:3300/0 conn(0x7ff3f40c04b0 msgr2=0x7ff3f406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:23.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f1400640 1 --2- 172.21.15.50:0/2473080402 >> v2:172.21.15.125:3300/0 conn(0x7ff3f40c04b0 0x7ff3f406ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f1400640 1 -- 172.21.15.50:0/2473080402 >> v1:172.21.15.125:6789/0 conn(0x7ff3f414fbf0 legacy=0x7ff3f40c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.751+0000 7ff3f1400640 1 -- 172.21.15.50:0/2473080402 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f41525e0 con 0x7ff3f40a4da0 2024-01-30T08:09:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f1400640 1 --2- 172.21.15.50:0/2473080402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40a4da0 0x7ff3f4153080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40a8830 tx=0x7ff3dc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f42a90785ca2b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f0a00640 1 -- 172.21.15.50:0/2473080402 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0ab600 con 0x7ff3f40a4da0 2024-01-30T08:09:23.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f0a00640 1 -- 172.21.15.50:0/2473080402 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0a7050 con 0x7ff3f40a4da0 2024-01-30T08:09:23.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f0a00640 1 -- 172.21.15.50:0/2473080402 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0ab980 con 0x7ff3f40a4da0 2024-01-30T08:09:23.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 -- 172.21.15.50:0/2473080402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40a4da0 msgr2=0x7ff3f4153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 --2- 172.21.15.50:0/2473080402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40a4da0 0x7ff3f4153080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40a8830 tx=0x7ff3dc01c430 comp rx=0 tx=0).stop 2024-01-30T08:09:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 -- 172.21.15.50:0/2473080402 shutdown_connections 2024-01-30T08:09:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 --2- 172.21.15.50:0/2473080402 >> v2:172.21.15.125:3300/0 conn(0x7ff3f40c04b0 0x7ff3f406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 --2- 172.21.15.50:0/2473080402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40a4da0 0x7ff3f4153080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 -- 172.21.15.50:0/2473080402 >> 172.21.15.50:0/2473080402 conn(0x7ff3f40c5b30 msgr2=0x7ff3f40c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:23.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 -- 172.21.15.50:0/2473080402 shutdown_connections 2024-01-30T08:09:23.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.755+0000 7ff3f9200640 1 -- 172.21.15.50:0/2473080402 wait complete. 2024-01-30T08:09:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 Processor -- start 2024-01-30T08:09:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 -- start start 2024-01-30T08:09:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f40a4da0 0x7ff3f41ee770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f40c04b0 0x7ff3f415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f414fbf0 0x7ff3f40a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f4153d60 con 0x7ff3f414fbf0 2024-01-30T08:09:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40ab670 con 0x7ff3f40c04b0 2024-01-30T08:09:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40ab950 con 0x7ff3f40a4da0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f414fbf0 0x7ff3f40a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f414fbf0 0x7ff3f40a88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35596/0 (socket says 172.21.15.50:35596) 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 -- 172.21.15.50:0/3603896417 learned_addr learned my addr 172.21.15.50:0/3603896417 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f1400640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f40c04b0 0x7ff3f415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f1e00640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f40a4da0 0x7ff3f41ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 -- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f40a4da0 msgr2=0x7ff3f41ee770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f40a4da0 0x7ff3f41ee770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 -- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f40c04b0 msgr2=0x7ff3f415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f40c04b0 0x7ff3f415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 -- 172.21.15.50:0/3603896417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc0094d0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f2800640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f414fbf0 0x7ff3f40a88b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00b9d0 tx=0x7ff3ec00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3ea000640 1 -- 172.21.15.50:0/3603896417 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00cbd0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3ea000640 1 -- 172.21.15.50:0/3603896417 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec00cd50 con 0x7ff3f414fbf0 2024-01-30T08:09:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3ea000640 1 -- 172.21.15.50:0/3603896417 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec014680 con 0x7ff3f414fbf0 2024-01-30T08:09:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f4153690 con 0x7ff3f414fbf0 2024-01-30T08:09:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.759+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f4153fb0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.763+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f4074a20 con 0x7ff3f414fbf0 2024-01-30T08:09:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.763+0000 7ff3ea000640 1 -- 172.21.15.50:0/3603896417 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff3ec01d3b0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.763+0000 7ff3ea000640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff3cc066500 0x7ff3cc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.763+0000 7ff3ea000640 1 -- 172.21.15.50:0/3603896417 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3ec0840e0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.763+0000 7ff3f1e00640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff3cc066500 0x7ff3cc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.763+0000 7ff3f1e00640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff3cc066500 0x7ff3cc0689c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40098e0 tx=0x7ff3e4009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.767+0000 7ff3ea000640 1 -- 172.21.15.50:0/3603896417 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff3ec0510a0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.927+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3f40aba90 con 0x7ff3f414fbf0 2024-01-30T08:09:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.927+0000 7ff3ea000640 1 -- 172.21.15.50:0/3603896417 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3ec0546c0 con 0x7ff3f414fbf0 2024-01-30T08:09:23.932 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff3cc066500 msgr2=0x7ff3cc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff3cc066500 0x7ff3cc0689c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40098e0 tx=0x7ff3e4009060 comp rx=0 tx=0).stop 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f414fbf0 msgr2=0x7ff3f40a88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f414fbf0 0x7ff3f40a88b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00b9d0 tx=0x7ff3ec00be90 comp rx=0 tx=0).stop 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 shutdown_connections 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f40c04b0 0x7ff3f415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff3cc066500 0x7ff3cc0689c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f414fbf0 0x7ff3f40a88b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 --2- 172.21.15.50:0/3603896417 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3f40a4da0 0x7ff3f41ee770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 >> 172.21.15.50:0/3603896417 conn(0x7ff3f40c5b30 msgr2=0x7ff3f4150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 shutdown_connections 2024-01-30T08:09:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:23.931+0000 7ff3f9200640 1 -- 172.21.15.50:0/3603896417 wait complete. 2024-01-30T08:09:23.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.095+0000 7f5ba1c00640 1 Processor -- start 2024-01-30T08:09:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.095+0000 7f5ba1c00640 1 -- start start 2024-01-30T08:09:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5ba1c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b9c14fbf0 0x7f5b9c153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5ba1c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b9c0a4da0 0x7f5b9c0c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5ba1c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c0c16c0 0x7f5b9c06ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5ba1c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c0c54e0 con 0x7f5b9c0a4da0 2024-01-30T08:09:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5ba1c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c152bf0 con 0x7f5b9c14fbf0 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5ba1c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c072d90 con 0x7f5b9c0c16c0 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b9c0a4da0 0x7f5b9c0c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b9c0a4da0 0x7f5b9c0c1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35612/0 (socket says 172.21.15.50:35612) 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 -- 172.21.15.50:0/1233601746 learned_addr learned my addr 172.21.15.50:0/1233601746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9b400640 1 --2- 172.21.15.50:0/1233601746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c0c16c0 0x7f5b9c06ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9aa00640 1 --2- 172.21.15.50:0/1233601746 >> v2:172.21.15.125:3300/0 conn(0x7f5b9c14fbf0 0x7f5b9c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 -- 172.21.15.50:0/1233601746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c0c16c0 msgr2=0x7f5b9c06ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 --2- 172.21.15.50:0/1233601746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c0c16c0 0x7f5b9c06ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 -- 172.21.15.50:0/1233601746 >> v2:172.21.15.125:3300/0 conn(0x7f5b9c14fbf0 msgr2=0x7f5b9c153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 --2- 172.21.15.50:0/1233601746 >> v2:172.21.15.125:3300/0 conn(0x7f5b9c14fbf0 0x7f5b9c153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 -- 172.21.15.50:0/1233601746 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c1525e0 con 0x7f5b9c0a4da0 2024-01-30T08:09:24.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.099+0000 7f5b9a000640 1 --2- 172.21.15.50:0/1233601746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c0a4da0 0x7f5b9c0c1180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c06b610 tx=0x7f5b8401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1541aacfbf642795 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5b99600640 1 -- 172.21.15.50:0/1233601746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b840ab600 con 0x7f5b9c0a4da0 2024-01-30T08:09:24.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5b99600640 1 -- 172.21.15.50:0/1233601746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b840a7050 con 0x7f5b9c0a4da0 2024-01-30T08:09:24.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5b99600640 1 -- 172.21.15.50:0/1233601746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b840ab980 con 0x7f5b9c0a4da0 2024-01-30T08:09:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 -- 172.21.15.50:0/1233601746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c0a4da0 msgr2=0x7f5b9c0c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/1233601746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c0a4da0 0x7f5b9c0c1180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c06b610 tx=0x7f5b8401c470 comp rx=0 tx=0).stop 2024-01-30T08:09:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 -- 172.21.15.50:0/1233601746 shutdown_connections 2024-01-30T08:09:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/1233601746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c0a4da0 0x7f5b9c0c1180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/1233601746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c0c16c0 0x7f5b9c06ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/1233601746 >> v2:172.21.15.125:3300/0 conn(0x7f5b9c14fbf0 0x7f5b9c153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 -- 172.21.15.50:0/1233601746 >> 172.21.15.50:0/1233601746 conn(0x7f5b9c0c5b30 msgr2=0x7f5b9c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 -- 172.21.15.50:0/1233601746 shutdown_connections 2024-01-30T08:09:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 -- 172.21.15.50:0/1233601746 wait complete. 2024-01-30T08:09:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 Processor -- start 2024-01-30T08:09:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.103+0000 7f5ba1c00640 1 -- start start 2024-01-30T08:09:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b9c0a4da0 0x7f5b9c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c14fbf0 0x7f5b9c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c1572c0 0x7f5b9c1eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c14af80 con 0x7f5b9c1572c0 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0a88b0 con 0x7f5b9c0a4da0 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0a8b90 con 0x7f5b9c14fbf0 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c1572c0 0x7f5b9c1eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c1572c0 0x7f5b9c1eea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35622/0 (socket says 172.21.15.50:35622) 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 -- 172.21.15.50:0/3033547674 learned_addr learned my addr 172.21.15.50:0/3033547674 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9aa00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b9c0a4da0 0x7f5b9c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9a000640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c14fbf0 0x7f5b9c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 -- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c14fbf0 msgr2=0x7f5b9c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c14fbf0 0x7f5b9c1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 -- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b9c0a4da0 msgr2=0x7f5b9c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b9c0a4da0 0x7f5b9c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 -- 172.21.15.50:0/3033547674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b840094d0 con 0x7f5b9c1572c0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b9b400640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c1572c0 0x7f5b9c1eea20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007de0 tx=0x7f5b9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b92a00640 1 -- 172.21.15.50:0/3033547674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94014620 con 0x7f5b9c1572c0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b92a00640 1 -- 172.21.15.50:0/3033547674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9400ee90 con 0x7f5b9c1572c0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c0a8e70 con 0x7f5b9c1572c0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b92a00640 1 -- 172.21.15.50:0/3033547674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940149e0 con 0x7f5b9c1572c0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c151040 con 0x7f5b9c1572c0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c067cc0 con 0x7f5b9c1572c0 2024-01-30T08:09:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.107+0000 7f5b92a00640 1 -- 172.21.15.50:0/3033547674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5b94014b40 con 0x7f5b9c1572c0 2024-01-30T08:09:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.111+0000 7f5b92a00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5b74066500 0x7f5b740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.111+0000 7f5b92a00640 1 -- 172.21.15.50:0/3033547674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b94084ab0 con 0x7f5b9c1572c0 2024-01-30T08:09:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.111+0000 7f5b9aa00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5b74066500 0x7f5b740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.111+0000 7f5b9aa00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5b74066500 0x7f5b740689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c007940 tx=0x7f5b8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.115+0000 7f5b92a00640 1 -- 172.21.15.50:0/3033547674 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5b94051b00 con 0x7f5b9c1572c0 2024-01-30T08:09:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b9c0c2320 con 0x7f5b9c1572c0 2024-01-30T08:09:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5b92a00640 1 -- 172.21.15.50:0/3033547674 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b94055120 con 0x7f5b9c1572c0 2024-01-30T08:09:24.277 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5b74066500 msgr2=0x7f5b740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5b74066500 0x7f5b740689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c007940 tx=0x7f5b8c008040 comp rx=0 tx=0).stop 2024-01-30T08:09:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c1572c0 msgr2=0x7f5b9c1eea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c1572c0 0x7f5b9c1eea20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007de0 tx=0x7f5b9400e4b0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 shutdown_connections 2024-01-30T08:09:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5b74066500 0x7f5b740689c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9c1572c0 0x7f5b9c1eea20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b9c14fbf0 0x7f5b9c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 --2- 172.21.15.50:0/3033547674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b9c0a4da0 0x7f5b9c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 >> 172.21.15.50:0/3033547674 conn(0x7f5b9c0c5b30 msgr2=0x7f5b9c14f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 shutdown_connections 2024-01-30T08:09:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.275+0000 7f5ba1c00640 1 -- 172.21.15.50:0/3033547674 wait complete. 2024-01-30T08:09:24.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:24.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85b2400640 1 Processor -- start 2024-01-30T08:09:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85b2400640 1 -- start start 2024-01-30T08:09:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85b2400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85ac14fbf0 0x7f85ac153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85b2400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0c54e0 con 0x7f85ac0c04b0 2024-01-30T08:09:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85b2400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac152bf0 con 0x7f85ac0a4da0 2024-01-30T08:09:24.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85b2400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac072d90 con 0x7f85ac14fbf0 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85ac0c04b0 0x7f85ac06ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60882/0 (socket says 172.21.15.50:60882) 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 -- 172.21.15.50:0/1941938805 learned_addr learned my addr 172.21.15.50:0/1941938805 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85ab400640 1 --2- 172.21.15.50:0/1941938805 >> v2:172.21.15.125:3300/0 conn(0x7f85ac14fbf0 0x7f85ac153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275301068 0 0) 0x7f85ac0c54e0 con 0x7f85ac0c04b0 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f858c003530 con 0x7f85ac0c04b0 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401808740 0 0) 0x7f85ac152bf0 con 0x7f85ac0a4da0 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85ac0c54e0 con 0x7f85ac0a4da0 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1242381898 0 0) 0x7f858c003530 con 0x7f85ac0c04b0 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 >> v2:172.21.15.125:3300/0 conn(0x7f85ac14fbf0 msgr2=0x7f85ac153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 --2- 172.21.15.50:0/1941938805 >> v2:172.21.15.125:3300/0 conn(0x7f85ac14fbf0 0x7f85ac153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 >> v1:172.21.15.125:6789/0 conn(0x7f85ac0a4da0 legacy=0x7f85ac0c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac1525e0 con 0x7f85ac0c04b0 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f85a4001a20 con 0x7f85ac0c04b0 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85ab400640 1 --2- 172.21.15.50:0/1941938805 >> v2:172.21.15.125:3300/0 conn(0x7f85ac14fbf0 0x7f85ac153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 >> v1:172.21.15.50:6789/0 conn(0x7f85ac0c04b0 legacy=0x7f85ac06ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f858c003b60 0x7f858c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0047d0 0x7f858c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac072d90 con 0x7f858c0051e0 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00c110 con 0x7f858c0047d0 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00c2d0 con 0x7f858c003b60 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85ab400640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f858c003b60 0x7f858c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aaa00640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0047d0 0x7f858c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 -- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f858c003b60 msgr2=0x7f858c003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f858c003b60 0x7f858c003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 -- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0047d0 msgr2=0x7f858c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0047d0 0x7f858c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85abe00640 1 -- 172.21.15.50:0/1941938805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c003530 con 0x7f858c0051e0 2024-01-30T08:09:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.443+0000 7f85aaa00640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0047d0 0x7f858c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85abe00640 1 -- 172.21.15.50:0/1941938805 reap_dead start 2024-01-30T08:09:24.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85abe00640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f85a400a6e0 tx=0x7f85a401d180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77fb00a6202128b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40ac620 con 0x7f858c0051e0 2024-01-30T08:09:24.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40a8070 con 0x7f858c0051e0 2024-01-30T08:09:24.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85aa000640 1 -- 172.21.15.50:0/1941938805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40ac9e0 con 0x7f858c0051e0 2024-01-30T08:09:24.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85b2400640 1 -- 172.21.15.50:0/1941938805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c0051e0 msgr2=0x7f858c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85b2400640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f85a400a6e0 tx=0x7f85a401d180 comp rx=0 tx=0).stop 2024-01-30T08:09:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85b2400640 1 -- 172.21.15.50:0/1941938805 shutdown_connections 2024-01-30T08:09:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85b2400640 1 --2- 172.21.15.50:0/1941938805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c0051e0 0x7f858c00b990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85b2400640 1 -- 172.21.15.50:0/1941938805 >> 172.21.15.50:0/1941938805 conn(0x7f85ac0c5b30 msgr2=0x7f85ac0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85b2400640 1 -- 172.21.15.50:0/1941938805 shutdown_connections 2024-01-30T08:09:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.447+0000 7f85b2400640 1 -- 172.21.15.50:0/1941938805 wait complete. 2024-01-30T08:09:24.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 Processor -- start 2024-01-30T08:09:24.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 -- start start 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0051e0 0x7f85ac1ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85ac147550 0x7f85ac0bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ac146060 0x7f85ac1ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac06db10 con 0x7f85ac146060 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1e9a50 con 0x7f858c0051e0 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac155c00 con 0x7f85ac147550 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ac146060 0x7f85ac1ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ac146060 0x7f85ac1ea180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35638/0 (socket says 172.21.15.50:35638) 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 -- 172.21.15.50:0/4083291713 learned_addr learned my addr 172.21.15.50:0/4083291713 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85aaa00640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85ac147550 0x7f85ac0bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85ab400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0051e0 0x7f85ac1ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 -- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85ac147550 msgr2=0x7f85ac0bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85ac147550 0x7f85ac0bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 -- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0051e0 msgr2=0x7f85ac1ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0051e0 0x7f85ac1ed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 -- 172.21.15.50:0/4083291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac06d300 con 0x7f85ac146060 2024-01-30T08:09:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85abe00640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ac146060 0x7f85ac1ea180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f85a401cbf0 tx=0x7f858c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85a3400640 1 -- 172.21.15.50:0/4083291713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4001a20 con 0x7f85ac146060 2024-01-30T08:09:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85a3400640 1 -- 172.21.15.50:0/4083291713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a4001e90 con 0x7f85ac146060 2024-01-30T08:09:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac06d550 con 0x7f85ac146060 2024-01-30T08:09:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85a3400640 1 -- 172.21.15.50:0/4083291713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40072e0 con 0x7f85ac146060 2024-01-30T08:09:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.451+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac1e9c60 con 0x7f85ac146060 2024-01-30T08:09:24.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.455+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac068250 con 0x7f85ac146060 2024-01-30T08:09:24.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.455+0000 7f85a3400640 1 -- 172.21.15.50:0/4083291713 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f85a40aa070 con 0x7f85ac146060 2024-01-30T08:09:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.455+0000 7f85a3400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8584066530 0x7f85840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.455+0000 7f85a3400640 1 -- 172.21.15.50:0/4083291713 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f85a40b3070 con 0x7f85ac146060 2024-01-30T08:09:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.455+0000 7f85ab400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8584066530 0x7f85840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.455+0000 7f85ab400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8584066530 0x7f85840689f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f859c0093f0 tx=0x7f859c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.459+0000 7f85a3400640 1 -- 172.21.15.50:0/4083291713 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f85a40ea9b0 con 0x7f85ac146060 2024-01-30T08:09:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.615+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f85ac074a20 con 0x7f85ac146060 2024-01-30T08:09:24.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85a3400640 1 -- 172.21.15.50:0/4083291713 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f85a40edfd0 con 0x7f85ac146060 2024-01-30T08:09:24.621 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8584066530 msgr2=0x7f85840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8584066530 0x7f85840689f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f859c0093f0 tx=0x7f859c009190 comp rx=0 tx=0).stop 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ac146060 msgr2=0x7f85ac1ea180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ac146060 0x7f85ac1ea180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f85a401cbf0 tx=0x7f858c005800 comp rx=0 tx=0).stop 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 shutdown_connections 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8584066530 0x7f85840689f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ac146060 0x7f85ac1ea180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f85ac147550 0x7f85ac0bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 --2- 172.21.15.50:0/4083291713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f858c0051e0 0x7f85ac1ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 >> 172.21.15.50:0/4083291713 conn(0x7f85ac0c5b30 msgr2=0x7f85ac0c3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 shutdown_connections 2024-01-30T08:09:24.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.619+0000 7f85b2400640 1 -- 172.21.15.50:0/4083291713 wait complete. 2024-01-30T08:09:24.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:24.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.779+0000 7faada200640 1 Processor -- start 2024-01-30T08:09:24.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.779+0000 7faada200640 1 -- start start 2024-01-30T08:09:24.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faada200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faad406de40 0x7faad40a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faada200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 0x7faad4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faada200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faad41582d0 0x7faad406f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faada200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad40a7770 con 0x7faad41582d0 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faada200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad4155310 con 0x7faad406de40 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faada200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad41547a0 con 0x7faad406e220 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faad41582d0 0x7faad406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faad41582d0 0x7faad406f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35640/0 (socket says 172.21.15.50:35640) 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 -- 172.21.15.50:0/1280414089 learned_addr learned my addr 172.21.15.50:0/1280414089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3400640 1 --2- 172.21.15.50:0/1280414089 >> v2:172.21.15.125:3300/0 conn(0x7faad406de40 0x7faad40a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 -- 172.21.15.50:0/1280414089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 msgr2=0x7faad4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 --2- 172.21.15.50:0/1280414089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 0x7faad4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 -- 172.21.15.50:0/1280414089 >> v2:172.21.15.125:3300/0 conn(0x7faad406de40 msgr2=0x7faad40a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:24.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 --2- 172.21.15.50:0/1280414089 >> v2:172.21.15.125:3300/0 conn(0x7faad406de40 0x7faad40a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3e00640 1 -- 172.21.15.50:0/1280414089 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40c7b40 con 0x7faad41582d0 2024-01-30T08:09:24.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.783+0000 7faad3400640 1 --2- 172.21.15.50:0/1280414089 >> v2:172.21.15.125:3300/0 conn(0x7faad406de40 0x7faad40a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:24.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faad3e00640 1 --2- 172.21.15.50:0/1280414089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad406f290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faad4073f80 tx=0x7faacc01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8401a87901b2f0ed server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faad2000640 1 -- 172.21.15.50:0/1280414089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0a8400 con 0x7faad41582d0 2024-01-30T08:09:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faad2000640 1 -- 172.21.15.50:0/1280414089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc0a8560 con 0x7faad41582d0 2024-01-30T08:09:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faad2000640 1 -- 172.21.15.50:0/1280414089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0a88f0 con 0x7faad41582d0 2024-01-30T08:09:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 -- 172.21.15.50:0/1280414089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 msgr2=0x7faad406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 --2- 172.21.15.50:0/1280414089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad406f290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faad4073f80 tx=0x7faacc01c710 comp rx=0 tx=0).stop 2024-01-30T08:09:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 -- 172.21.15.50:0/1280414089 shutdown_connections 2024-01-30T08:09:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 --2- 172.21.15.50:0/1280414089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad406f290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 --2- 172.21.15.50:0/1280414089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 0x7faad4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 --2- 172.21.15.50:0/1280414089 >> v2:172.21.15.125:3300/0 conn(0x7faad406de40 0x7faad40a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 -- 172.21.15.50:0/1280414089 >> 172.21.15.50:0/1280414089 conn(0x7faad40c4830 msgr2=0x7faad40c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 -- 172.21.15.50:0/1280414089 shutdown_connections 2024-01-30T08:09:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 -- 172.21.15.50:0/1280414089 wait complete. 2024-01-30T08:09:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 Processor -- start 2024-01-30T08:09:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.787+0000 7faada200640 1 -- start start 2024-01-30T08:09:24.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad406de40 0x7faad40a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 0x7faad4150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad4150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad415aa90 con 0x7faad41582d0 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad41f12b0 con 0x7faad406de40 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40abc80 con 0x7faad406e220 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad4150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad4150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35648/0 (socket says 172.21.15.50:35648) 2024-01-30T08:09:24.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 -- 172.21.15.50:0/3759587407 learned_addr learned my addr 172.21.15.50:0/3759587407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 -- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 msgr2=0x7faad4150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 0x7faad4150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 -- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad406de40 msgr2=0x7faad40a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad406de40 0x7faad40a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 -- 172.21.15.50:0/3759587407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc009b30 con 0x7faad41582d0 2024-01-30T08:09:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faad3e00640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad4150560 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faacc01adc0 tx=0x7faacc0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faacb400640 1 -- 172.21.15.50:0/3759587407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0a8d20 con 0x7faad41582d0 2024-01-30T08:09:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faacb400640 1 -- 172.21.15.50:0/3759587407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc0a8e80 con 0x7faad41582d0 2024-01-30T08:09:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faacb400640 1 -- 172.21.15.50:0/3759587407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0bd670 con 0x7faad41582d0 2024-01-30T08:09:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad4150aa0 con 0x7faad41582d0 2024-01-30T08:09:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad41f0910 con 0x7faad41582d0 2024-01-30T08:09:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad406e640 con 0x7faad41582d0 2024-01-30T08:09:24.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.791+0000 7faacb400640 1 -- 172.21.15.50:0/3759587407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7faacc0b1450 con 0x7faad41582d0 2024-01-30T08:09:24.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.795+0000 7faacb400640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faaac066500 0x7faaac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:24.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.795+0000 7faacb400640 1 -- 172.21.15.50:0/3759587407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faacc11e7d0 con 0x7faad41582d0 2024-01-30T08:09:24.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.795+0000 7faad3400640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faaac066500 0x7faaac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.795+0000 7faad3400640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faaac066500 0x7faaac0689c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faac400a8d0 tx=0x7faac4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.799+0000 7faacb400640 1 -- 172.21.15.50:0/3759587407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7faad406e640 con 0x7faad41582d0 2024-01-30T08:09:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.959+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faad41f13f0 con 0x7faad41582d0 2024-01-30T08:09:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.959+0000 7faacb400640 1 -- 172.21.15.50:0/3759587407 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7faad41f13f0 con 0x7faad41582d0 2024-01-30T08:09:24.963 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:24.963 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faaac066500 msgr2=0x7faaac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faaac066500 0x7faaac0689c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faac400a8d0 tx=0x7faac4008040 comp rx=0 tx=0).stop 2024-01-30T08:09:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 msgr2=0x7faad4150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad4150560 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faacc01adc0 tx=0x7faacc0194b0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 shutdown_connections 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faaac066500 0x7faaac0689c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad41582d0 0x7faad4150560 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faad406e220 0x7faad4150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 --2- 172.21.15.50:0/3759587407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faad406de40 0x7faad40a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 >> 172.21.15.50:0/3759587407 conn(0x7faad40c4830 msgr2=0x7faad40c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 shutdown_connections 2024-01-30T08:09:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:24.963+0000 7faada200640 1 -- 172.21.15.50:0/3759587407 wait complete. 2024-01-30T08:09:24.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:24.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:25.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 Processor -- start 2024-01-30T08:09:25.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 -- start start 2024-01-30T08:09:25.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c50d0 0x7fd844156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8440c7ae0 0x7fd8441566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8440c5c90 0x7fd8440c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440c7070 con 0x7fd8440c7ae0 2024-01-30T08:09:25.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440c8d30 con 0x7fd8440c5c90 2024-01-30T08:09:25.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd848e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c8a50 con 0x7fd8440c50d0 2024-01-30T08:09:25.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd841400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8440c7ae0 0x7fd8441566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd841400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8440c7ae0 0x7fd8441566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35652/0 (socket says 172.21.15.50:35652) 2024-01-30T08:09:25.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd841400640 1 -- 172.21.15.50:0/3904165291 learned_addr learned my addr 172.21.15.50:0/3904165291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd841400640 1 -- 172.21.15.50:0/3904165291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c50d0 msgr2=0x7fd844156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd841e00640 1 --2- 172.21.15.50:0/3904165291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c50d0 0x7fd844156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.127+0000 7fd842800640 1 --2- 172.21.15.50:0/3904165291 >> v2:172.21.15.125:3300/0 conn(0x7fd8440c5c90 0x7fd8440c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd841400640 1 --2- 172.21.15.50:0/3904165291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c50d0 0x7fd844156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd841400640 1 -- 172.21.15.50:0/3904165291 >> v2:172.21.15.125:3300/0 conn(0x7fd8440c5c90 msgr2=0x7fd8440c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd841400640 1 --2- 172.21.15.50:0/3904165291 >> v2:172.21.15.125:3300/0 conn(0x7fd8440c5c90 0x7fd8440c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd841400640 1 -- 172.21.15.50:0/3904165291 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440c66d0 con 0x7fd8440c7ae0 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd842800640 1 --2- 172.21.15.50:0/3904165291 >> v2:172.21.15.125:3300/0 conn(0x7fd8440c5c90 0x7fd8440c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:25.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd841e00640 1 --2- 172.21.15.50:0/3904165291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c50d0 0x7fd844156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:25.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd841400640 1 --2- 172.21.15.50:0/3904165291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c7ae0 0x7fd8441566d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd8440c5910 tx=0x7fd82c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227a877faac21005 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd840a00640 1 -- 172.21.15.50:0/3904165291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440c3e00 con 0x7fd8440c7ae0 2024-01-30T08:09:25.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd840a00640 1 -- 172.21.15.50:0/3904165291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0ab600 con 0x7fd8440c7ae0 2024-01-30T08:09:25.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd840a00640 1 -- 172.21.15.50:0/3904165291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0ab990 con 0x7fd8440c7ae0 2024-01-30T08:09:25.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd848e00640 1 -- 172.21.15.50:0/3904165291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c7ae0 msgr2=0x7fd8441566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.131+0000 7fd848e00640 1 --2- 172.21.15.50:0/3904165291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c7ae0 0x7fd8441566d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd8440c5910 tx=0x7fd82c01c440 comp rx=0 tx=0).stop 2024-01-30T08:09:25.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- 172.21.15.50:0/3904165291 shutdown_connections 2024-01-30T08:09:25.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 --2- 172.21.15.50:0/3904165291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c7ae0 0x7fd8441566d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 --2- 172.21.15.50:0/3904165291 >> v2:172.21.15.125:3300/0 conn(0x7fd8440c5c90 0x7fd8440c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 --2- 172.21.15.50:0/3904165291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c50d0 0x7fd844156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- 172.21.15.50:0/3904165291 >> 172.21.15.50:0/3904165291 conn(0x7fd8440727c0 msgr2=0x7fd84406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:25.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- 172.21.15.50:0/3904165291 shutdown_connections 2024-01-30T08:09:25.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- 172.21.15.50:0/3904165291 wait complete. 2024-01-30T08:09:25.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 Processor -- start 2024-01-30T08:09:25.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- start start 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c50d0 0x7fd8440aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8440c5c90 0x7fd8440a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c7ae0 0x7fd84414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440a9650 con 0x7fd8440c50d0 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440aaf20 con 0x7fd8440c5c90 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd848e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8441ec940 con 0x7fd8440c7ae0 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c50d0 0x7fd8440aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c50d0 0x7fd8440aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35658/0 (socket says 172.21.15.50:35658) 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 -- 172.21.15.50:0/3262103917 learned_addr learned my addr 172.21.15.50:0/3262103917 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd842800640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c7ae0 0x7fd84414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841400640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8440c5c90 0x7fd8440a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 -- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c7ae0 msgr2=0x7fd84414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c7ae0 0x7fd84414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 -- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8440c5c90 msgr2=0x7fd8440a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8440c5c90 0x7fd8440a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.135+0000 7fd841e00640 1 -- 172.21.15.50:0/3262103917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0094d0 con 0x7fd8440c50d0 2024-01-30T08:09:25.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd841e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c50d0 0x7fd8440aa450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c7c0 tx=0x7fd83400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd83a000640 1 -- 172.21.15.50:0/3262103917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834007a30 con 0x7fd8440c50d0 2024-01-30T08:09:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd83a000640 1 -- 172.21.15.50:0/3262103917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834007b90 con 0x7fd8440c50d0 2024-01-30T08:09:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440ac0c0 con 0x7fd8440c50d0 2024-01-30T08:09:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd83a000640 1 -- 172.21.15.50:0/3262103917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400ce70 con 0x7fd8440c50d0 2024-01-30T08:09:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440a7bd0 con 0x7fd8440c50d0 2024-01-30T08:09:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd844067cc0 con 0x7fd8440c50d0 2024-01-30T08:09:25.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd83a000640 1 -- 172.21.15.50:0/3262103917 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd8340113f0 con 0x7fd8440c50d0 2024-01-30T08:09:25.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd83a000640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd81c066500 0x7fd81c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd83a000640 1 -- 172.21.15.50:0/3262103917 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd834084640 con 0x7fd8440c50d0 2024-01-30T08:09:25.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.139+0000 7fd841400640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd81c066500 0x7fd81c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.143+0000 7fd841400640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd81c066500 0x7fd81c0689c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0af000 tx=0x7fd82c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.143+0000 7fd83a000640 1 -- 172.21.15.50:0/3262103917 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd8340515e0 con 0x7fd8440c50d0 2024-01-30T08:09:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.303+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd844074a20 con 0x7fd8440c50d0 2024-01-30T08:09:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd83a000640 1 -- 172.21.15.50:0/3262103917 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd834054c00 con 0x7fd8440c50d0 2024-01-30T08:09:25.308 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd81c066500 msgr2=0x7fd81c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd81c066500 0x7fd81c0689c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0af000 tx=0x7fd82c0a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c50d0 msgr2=0x7fd8440aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c50d0 0x7fd8440aa450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c7c0 tx=0x7fd83400cc80 comp rx=0 tx=0).stop 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 shutdown_connections 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8440c5c90 0x7fd8440a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd81c066500 0x7fd81c0689c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8440c7ae0 0x7fd84414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 --2- 172.21.15.50:0/3262103917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8440c50d0 0x7fd8440aa450 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 >> 172.21.15.50:0/3262103917 conn(0x7fd8440727c0 msgr2=0x7fd8441546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 shutdown_connections 2024-01-30T08:09:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.307+0000 7fd848e00640 1 -- 172.21.15.50:0/3262103917 wait complete. 2024-01-30T08:09:25.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:25.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff496400640 1 Processor -- start 2024-01-30T08:09:25.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff496400640 1 -- start start 2024-01-30T08:09:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff496400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff49014fbf0 0x7ff490153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff496400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4900a4da0 0x7ff4900c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff496400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4900c54e0 con 0x7ff4900c16c0 2024-01-30T08:09:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff496400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff490152bf0 con 0x7ff49014fbf0 2024-01-30T08:09:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff496400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff490072d90 con 0x7ff4900a4da0 2024-01-30T08:09:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff48ea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4900a4da0 0x7ff4900c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff48fe00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff4900c16c0 0x7ff49006ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:46754/0 (socket says 172.21.15.50:46754) 2024-01-30T08:09:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff48fe00640 1 -- 172.21.15.50:0/4074398001 learned_addr learned my addr 172.21.15.50:0/4074398001 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.471+0000 7ff48f400640 1 --2- 172.21.15.50:0/4074398001 >> v2:172.21.15.125:3300/0 conn(0x7ff49014fbf0 0x7ff490153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48ea00640 1 -- 172.21.15.50:0/4074398001 >> v2:172.21.15.125:3300/0 conn(0x7ff49014fbf0 msgr2=0x7ff490153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:25.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48ea00640 1 --2- 172.21.15.50:0/4074398001 >> v2:172.21.15.125:3300/0 conn(0x7ff49014fbf0 0x7ff490153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48ea00640 1 -- 172.21.15.50:0/4074398001 >> v1:172.21.15.125:6789/0 conn(0x7ff4900c16c0 legacy=0x7ff49006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48ea00640 1 -- 172.21.15.50:0/4074398001 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4901525e0 con 0x7ff4900a4da0 2024-01-30T08:09:25.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48e000640 1 -- 172.21.15.50:0/4074398001 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135043445 0 0) 0x7ff4900c54e0 con 0x7ff4900c16c0 2024-01-30T08:09:25.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48ea00640 1 --2- 172.21.15.50:0/4074398001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4900a4da0 0x7ff4900c1180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4780097c0 tx=0x7ff47801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f833add7b0e9992b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48e000640 1 -- 172.21.15.50:0/4074398001 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780ab600 con 0x7ff4900a4da0 2024-01-30T08:09:25.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48e000640 1 -- 172.21.15.50:0/4074398001 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4780a7050 con 0x7ff4900a4da0 2024-01-30T08:09:25.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.475+0000 7ff48e000640 1 -- 172.21.15.50:0/4074398001 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780ab980 con 0x7ff4900a4da0 2024-01-30T08:09:25.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- 172.21.15.50:0/4074398001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4900a4da0 msgr2=0x7ff4900c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 --2- 172.21.15.50:0/4074398001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4900a4da0 0x7ff4900c1180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4780097c0 tx=0x7ff47801c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- 172.21.15.50:0/4074398001 shutdown_connections 2024-01-30T08:09:25.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 --2- 172.21.15.50:0/4074398001 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4900a4da0 0x7ff4900c1180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 --2- 172.21.15.50:0/4074398001 >> v2:172.21.15.125:3300/0 conn(0x7ff49014fbf0 0x7ff490153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- 172.21.15.50:0/4074398001 >> 172.21.15.50:0/4074398001 conn(0x7ff4900c5b30 msgr2=0x7ff4900c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:25.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- 172.21.15.50:0/4074398001 shutdown_connections 2024-01-30T08:09:25.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- 172.21.15.50:0/4074398001 wait complete. 2024-01-30T08:09:25.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 Processor -- start 2024-01-30T08:09:25.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- start start 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4900a4da0 0x7ff4901ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff49014fbf0 0x7ff49015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4901f1430 0x7ff4901edce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4901f19f0 con 0x7ff4900a4da0 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4901ed500 con 0x7ff4901f1430 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff496400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49006d600 con 0x7ff49014fbf0 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff48f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4900a4da0 0x7ff4901ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff48f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4900a4da0 0x7ff4901ee970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35670/0 (socket says 172.21.15.50:35670) 2024-01-30T08:09:25.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.479+0000 7ff48f400640 1 -- 172.21.15.50:0/2114725441 learned_addr learned my addr 172.21.15.50:0/2114725441 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48fe00640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4901f1430 0x7ff4901edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48ea00640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff49014fbf0 0x7ff49015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48f400640 1 -- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff49014fbf0 msgr2=0x7ff49015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48f400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff49014fbf0 0x7ff49015b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48f400640 1 -- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4901f1430 msgr2=0x7ff4901edce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48f400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4901f1430 0x7ff4901edce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48f400640 1 -- 172.21.15.50:0/2114725441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478009420 con 0x7ff4900a4da0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48fe00640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4901f1430 0x7ff4901edce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff48f400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4900a4da0 0x7ff4901ee970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff48000e870 tx=0x7ff48000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff487400640 1 -- 172.21.15.50:0/2114725441 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480009510 con 0x7ff4900a4da0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff487400640 1 -- 172.21.15.50:0/2114725441 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000eec0 con 0x7ff4900a4da0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49006d8e0 con 0x7ff4900a4da0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff487400640 1 -- 172.21.15.50:0/2114725441 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000cb40 con 0x7ff4900a4da0 2024-01-30T08:09:25.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff490156780 con 0x7ff4900a4da0 2024-01-30T08:09:25.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff490067cc0 con 0x7ff4900a4da0 2024-01-30T08:09:25.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.483+0000 7ff487400640 1 -- 172.21.15.50:0/2114725441 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff48000cca0 con 0x7ff4900a4da0 2024-01-30T08:09:25.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.487+0000 7ff487400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff468066500 0x7ff4680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.487+0000 7ff487400640 1 -- 172.21.15.50:0/2114725441 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff480084210 con 0x7ff4900a4da0 2024-01-30T08:09:25.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.487+0000 7ff48ea00640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff468066500 0x7ff4680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.487+0000 7ff48ea00640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff468066500 0x7ff4680689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4780ad000 tx=0x7ff4780a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.491+0000 7ff487400640 1 -- 172.21.15.50:0/2114725441 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff480051260 con 0x7ff4900a4da0 2024-01-30T08:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff490074a20 con 0x7ff4900a4da0 2024-01-30T08:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff487400640 1 -- 172.21.15.50:0/2114725441 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff480054880 con 0x7ff4900a4da0 2024-01-30T08:09:25.653 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff468066500 msgr2=0x7ff4680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff468066500 0x7ff4680689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4780ad000 tx=0x7ff4780a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4900a4da0 msgr2=0x7ff4901ee970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4900a4da0 0x7ff4901ee970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff48000e870 tx=0x7ff48000ec70 comp rx=0 tx=0).stop 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 shutdown_connections 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4901f1430 0x7ff4901edce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff468066500 0x7ff4680689c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff49014fbf0 0x7ff49015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 --2- 172.21.15.50:0/2114725441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4900a4da0 0x7ff4901ee970 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 >> 172.21.15.50:0/2114725441 conn(0x7ff4900c5b30 msgr2=0x7ff4900c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:25.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 shutdown_connections 2024-01-30T08:09:25.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.651+0000 7ff496400640 1 -- 172.21.15.50:0/2114725441 wait complete. 2024-01-30T08:09:25.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.815+0000 7f0fd0000640 1 Processor -- start 2024-01-30T08:09:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.815+0000 7f0fd0000640 1 -- start start 2024-01-30T08:09:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fd0000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fc8155500 0x7f0fc80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fd0000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc8158b70 con 0x7f0fc806f240 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fd0000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc8157f60 con 0x7f0fc806f6d0 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fd0000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc806fae0 con 0x7f0fc8155500 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fcd600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fc8155500 0x7f0fc80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fccc00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0fc806f240 0x7f0fc80c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60886/0 (socket says 172.21.15.50:60886) 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fccc00640 1 -- 172.21.15.50:0/383545921 learned_addr learned my addr 172.21.15.50:0/383545921 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fcd600640 1 -- 172.21.15.50:0/383545921 >> v1:172.21.15.125:6789/0 conn(0x7f0fc806f6d0 legacy=0x7f0fc80c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fcd600640 1 -- 172.21.15.50:0/383545921 >> v1:172.21.15.50:6789/0 conn(0x7f0fc806f240 legacy=0x7f0fc80c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fcd600640 1 -- 172.21.15.50:0/383545921 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8158240 con 0x7f0fc8155500 2024-01-30T08:09:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.819+0000 7f0fcd600640 1 --2- 172.21.15.50:0/383545921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc80c85e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806fc20 tx=0x7f0fb801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe6f487a7e71959 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fc7e00640 1 -- 172.21.15.50:0/383545921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80ab600 con 0x7f0fc8155500 2024-01-30T08:09:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fc7e00640 1 -- 172.21.15.50:0/383545921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb80a7050 con 0x7f0fc8155500 2024-01-30T08:09:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fc7e00640 1 -- 172.21.15.50:0/383545921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80ab980 con 0x7f0fc8155500 2024-01-30T08:09:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- 172.21.15.50:0/383545921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 msgr2=0x7f0fc80c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 --2- 172.21.15.50:0/383545921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc80c85e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806fc20 tx=0x7f0fb801c2f0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- 172.21.15.50:0/383545921 shutdown_connections 2024-01-30T08:09:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 --2- 172.21.15.50:0/383545921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc80c85e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- 172.21.15.50:0/383545921 >> 172.21.15.50:0/383545921 conn(0x7f0fc80727c0 msgr2=0x7f0fc806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- 172.21.15.50:0/383545921 shutdown_connections 2024-01-30T08:09:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- 172.21.15.50:0/383545921 wait complete. 2024-01-30T08:09:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 Processor -- start 2024-01-30T08:09:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- start start 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fc806f240 0x7f0fc81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fc806f6d0 0x7f0fc81f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc8155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81f1300 con 0x7f0fc8155500 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80ac380 con 0x7f0fc806f240 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.823+0000 7f0fd0000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80abdc0 con 0x7f0fc806f6d0 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc8155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc8155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35686/0 (socket says 172.21.15.50:35686) 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 -- 172.21.15.50:0/1473907419 learned_addr learned my addr 172.21.15.50:0/1473907419 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fccc00640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fc806f6d0 0x7f0fc81f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fcd600640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fc806f240 0x7f0fc81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 -- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fc806f6d0 msgr2=0x7f0fc81f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fc806f6d0 0x7f0fc81f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 -- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fc806f240 msgr2=0x7f0fc81524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fc806f240 0x7f0fc81524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 -- 172.21.15.50:0/1473907419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb8009420 con 0x7f0fc8155500 2024-01-30T08:09:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fccc00640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fc806f6d0 0x7f0fc81f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fce000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc8155e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000b970 tx=0x7f0fc000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fc5600640 1 -- 172.21.15.50:0/1473907419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000cb40 con 0x7f0fc8155500 2024-01-30T08:09:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fc5600640 1 -- 172.21.15.50:0/1473907419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000cca0 con 0x7f0fc8155500 2024-01-30T08:09:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fc5600640 1 -- 172.21.15.50:0/1473907419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0014680 con 0x7f0fc8155500 2024-01-30T08:09:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc80ac0a0 con 0x7f0fc8155500 2024-01-30T08:09:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc81ed230 con 0x7f0fc8155500 2024-01-30T08:09:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8074a20 con 0x7f0fc8155500 2024-01-30T08:09:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.827+0000 7f0fc5600640 1 -- 172.21.15.50:0/1473907419 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0fc001d3b0 con 0x7f0fc8155500 2024-01-30T08:09:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.831+0000 7f0fc5600640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0fa0066500 0x7f0fa00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.831+0000 7f0fc5600640 1 -- 172.21.15.50:0/1473907419 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fc0083f80 con 0x7f0fc8155500 2024-01-30T08:09:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.831+0000 7f0fcd600640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0fa0066500 0x7f0fa00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.831+0000 7f0fcd600640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0fa0066500 0x7f0fa00689c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ad000 tx=0x7f0fb80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.831+0000 7f0fc5600640 1 -- 172.21.15.50:0/1473907419 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0fc00b5590 con 0x7f0fc8155500 2024-01-30T08:09:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.995+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fc80c83c0 con 0x7f0fc8155500 2024-01-30T08:09:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.995+0000 7f0fc5600640 1 -- 172.21.15.50:0/1473907419 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fc0019020 con 0x7f0fc8155500 2024-01-30T08:09:25.998 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.995+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0fa0066500 msgr2=0x7f0fa00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.995+0000 7f0fd0000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0fa0066500 0x7f0fa00689c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ad000 tx=0x7f0fb80a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 msgr2=0x7f0fc8155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc8155e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000b970 tx=0x7f0fc000be30 comp rx=0 tx=0).stop 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 shutdown_connections 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0fa0066500 0x7f0fa00689c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc8155500 0x7f0fc8155e90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0fc806f6d0 0x7f0fc81f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 --2- 172.21.15.50:0/1473907419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0fc806f240 0x7f0fc81524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 >> 172.21.15.50:0/1473907419 conn(0x7f0fc80727c0 msgr2=0x7f0fc806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 shutdown_connections 2024-01-30T08:09:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:25.999+0000 7f0fd0000640 1 -- 172.21.15.50:0/1473907419 wait complete. 2024-01-30T08:09:26.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f66800640 1 Processor -- start 2024-01-30T08:09:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f66800640 1 -- start start 2024-01-30T08:09:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f66800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f6006bfe0 0x7f1f600c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f66800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f600c3c50 0x7f1f600c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f66800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6006c4c0 con 0x7f1f60072b60 2024-01-30T08:09:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f66800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f600c0550 con 0x7f1f6006bfe0 2024-01-30T08:09:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f66800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600c07c0 con 0x7f1f600c3c50 2024-01-30T08:09:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f5ea00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f6006bfe0 0x7f1f600c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f5f400640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1f60072b60 0x7f1f600a4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:46766/0 (socket says 172.21.15.50:46766) 2024-01-30T08:09:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f5f400640 1 -- 172.21.15.50:0/3853909035 learned_addr learned my addr 172.21.15.50:0/3853909035 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.163+0000 7f1f5fe00640 1 --2- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f600c3c50 0x7f1f600c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.167+0000 7f1f5ea00640 1 -- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f600c3c50 msgr2=0x7f1f600c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.167+0000 7f1f5ea00640 1 --2- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f600c3c50 0x7f1f600c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.167+0000 7f1f5ea00640 1 -- 172.21.15.50:0/3853909035 >> v1:172.21.15.125:6789/0 conn(0x7f1f60072b60 legacy=0x7f1f600a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.167+0000 7f1f5ea00640 1 -- 172.21.15.50:0/3853909035 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600c0aa0 con 0x7f1f6006bfe0 2024-01-30T08:09:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.167+0000 7f1f5fe00640 1 --2- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f600c3c50 0x7f1f600c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.167+0000 7f1f5ea00640 1 --2- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6006bfe0 0x7f1f600c12a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097c0 tx=0x7f1f4801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771b5e42ef274ac9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f5e000640 1 -- 172.21.15.50:0/3853909035 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480ad660 con 0x7f1f6006bfe0 2024-01-30T08:09:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f5e000640 1 -- 172.21.15.50:0/3853909035 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f480ad7c0 con 0x7f1f6006bfe0 2024-01-30T08:09:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f5e000640 1 -- 172.21.15.50:0/3853909035 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480adb50 con 0x7f1f6006bfe0 2024-01-30T08:09:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6006bfe0 msgr2=0x7f1f600c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 --2- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6006bfe0 0x7f1f600c12a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097c0 tx=0x7f1f4801c3c0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- 172.21.15.50:0/3853909035 shutdown_connections 2024-01-30T08:09:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 --2- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f600c3c50 0x7f1f600c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 --2- 172.21.15.50:0/3853909035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f6006bfe0 0x7f1f600c12a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- 172.21.15.50:0/3853909035 >> 172.21.15.50:0/3853909035 conn(0x7f1f600c5b30 msgr2=0x7f1f600c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- 172.21.15.50:0/3853909035 shutdown_connections 2024-01-30T08:09:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- 172.21.15.50:0/3853909035 wait complete. 2024-01-30T08:09:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 Processor -- start 2024-01-30T08:09:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- start start 2024-01-30T08:09:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6006bfe0 0x7f1f6014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60072b60 0x7f1f6015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f600c3c50 0x7f1f6014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60150450 con 0x7f1f60072b60 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f601505f0 con 0x7f1f600c3c50 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f66800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f601501e0 con 0x7f1f6006bfe0 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.171+0000 7f1f5ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60072b60 0x7f1f6015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60072b60 0x7f1f6015a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35690/0 (socket says 172.21.15.50:35690) 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 -- 172.21.15.50:0/1744373767 learned_addr learned my addr 172.21.15.50:0/1744373767 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5f400640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6006bfe0 0x7f1f6014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5fe00640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f600c3c50 0x7f1f6014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 -- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6006bfe0 msgr2=0x7f1f6014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6006bfe0 0x7f1f6014fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 -- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f600c3c50 msgr2=0x7f1f6014cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f600c3c50 0x7f1f6014cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 -- 172.21.15.50:0/1744373767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58009a70 con 0x7f1f60072b60 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5f400640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6006bfe0 0x7f1f6014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f5ea00640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60072b60 0x7f1f6015a320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f48019ff0 tx=0x7f1f48019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f57400640 1 -- 172.21.15.50:0/1744373767 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480b6610 con 0x7f1f60072b60 2024-01-30T08:09:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f57400640 1 -- 172.21.15.50:0/1744373767 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f480b6770 con 0x7f1f60072b60 2024-01-30T08:09:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f48009420 con 0x7f1f60072b60 2024-01-30T08:09:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f57400640 1 -- 172.21.15.50:0/1744373767 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480b6b20 con 0x7f1f60072b60 2024-01-30T08:09:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f60150ae0 con 0x7f1f60072b60 2024-01-30T08:09:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f60074a20 con 0x7f1f60072b60 2024-01-30T08:09:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.175+0000 7f1f57400640 1 -- 172.21.15.50:0/1744373767 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1f480b4040 con 0x7f1f60072b60 2024-01-30T08:09:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.179+0000 7f1f57400640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f38066530 0x7f1f380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.179+0000 7f1f57400640 1 -- 172.21.15.50:0/1744373767 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f4811e3c0 con 0x7f1f60072b60 2024-01-30T08:09:26.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.179+0000 7f1f5f400640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f38066530 0x7f1f380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.179+0000 7f1f5f400640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f38066530 0x7f1f380689f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f50000f70 tx=0x7f1f50007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.179+0000 7f1f57400640 1 -- 172.21.15.50:0/1744373767 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1f480eb390 con 0x7f1f60072b60 2024-01-30T08:09:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.339+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1f600c3a30 con 0x7f1f60072b60 2024-01-30T08:09:26.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.339+0000 7f1f57400640 1 -- 172.21.15.50:0/1744373767 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1f480ee9b0 con 0x7f1f60072b60 2024-01-30T08:09:26.344 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:26.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f38066530 msgr2=0x7f1f380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f38066530 0x7f1f380689f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f50000f70 tx=0x7f1f50007e90 comp rx=0 tx=0).stop 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60072b60 msgr2=0x7f1f6015a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60072b60 0x7f1f6015a320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f48019ff0 tx=0x7f1f48019160 comp rx=0 tx=0).stop 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 shutdown_connections 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f600c3c50 0x7f1f6014cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f38066530 0x7f1f380689f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60072b60 0x7f1f6015a320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 --2- 172.21.15.50:0/1744373767 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f6006bfe0 0x7f1f6014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 >> 172.21.15.50:0/1744373767 conn(0x7f1f600c5b30 msgr2=0x7f1f601514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 shutdown_connections 2024-01-30T08:09:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.343+0000 7f1f66800640 1 -- 172.21.15.50:0/1744373767 wait complete. 2024-01-30T08:09:26.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:26.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.503+0000 7fa1cca00640 1 Processor -- start 2024-01-30T08:09:26.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.503+0000 7fa1cca00640 1 -- start start 2024-01-30T08:09:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1cca00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1c40a4e50 0x7fa1c40729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1cca00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c40c3e40 con 0x7fa1c40c4e00 2024-01-30T08:09:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1cca00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c40a8c20 con 0x7fa1c4158a00 2024-01-30T08:09:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1cca00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c40c42d0 con 0x7fa1c40a4e50 2024-01-30T08:09:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1ca000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa1c40c4e00 0x7fa1c40a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60902/0 (socket says 172.21.15.50:60902) 2024-01-30T08:09:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1ca000640 1 -- 172.21.15.50:0/786287732 learned_addr learned my addr 172.21.15.50:0/786287732 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224542467 0 0) 0x7fa1c40c3e40 con 0x7fa1c40c4e00 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a4003450 con 0x7fa1c40c4e00 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c9600640 1 --2- 172.21.15.50:0/786287732 >> v2:172.21.15.125:3300/0 conn(0x7fa1c40a4e50 0x7fa1c40729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 233324999 0 0) 0x7fa1a4003450 con 0x7fa1c40c4e00 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 >> v2:172.21.15.125:3300/0 conn(0x7fa1c40a4e50 msgr2=0x7fa1c40729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 --2- 172.21.15.50:0/786287732 >> v2:172.21.15.125:3300/0 conn(0x7fa1c40a4e50 0x7fa1c40729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 >> v1:172.21.15.125:6789/0 conn(0x7fa1c4158a00 legacy=0x7fa1c415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c40c3b10 con 0x7fa1c40c4e00 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fa1b4001680 con 0x7fa1c40c4e00 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 >> v1:172.21.15.50:6789/0 conn(0x7fa1c40c4e00 legacy=0x7fa1c40a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1a4003a70 0x7fa1a4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1a4008860 0x7fa1a400ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1a400d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40c42d0 con 0x7fa1a400b490 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a400e230 con 0x7fa1a4003a70 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a400e3f0 con 0x7fa1a4008860 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1caa00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1a400d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1ca000640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1a4003a70 0x7fa1a4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1c9600640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1a4008860 0x7fa1a400ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1caa00640 1 -- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1a4008860 msgr2=0x7fa1a400ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1caa00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1a4008860 0x7fa1a400ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1caa00640 1 -- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1a4003a70 msgr2=0x7fa1a4003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1caa00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1a4003a70 0x7fa1a4003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1caa00640 1 -- 172.21.15.50:0/786287732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4003450 con 0x7fa1a400b490 2024-01-30T08:09:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.507+0000 7fa1ca000640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1a4003a70 0x7fa1a4003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1caa00640 1 -- 172.21.15.50:0/786287732 reap_dead start 2024-01-30T08:09:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1caa00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1a400d950 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc001e70 tx=0x7fa1bc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a0e874ab7a7e7e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc003b80 con 0x7fa1a400b490 2024-01-30T08:09:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc003d00 con 0x7fa1a400b490 2024-01-30T08:09:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1c8c00640 1 -- 172.21.15.50:0/786287732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc005260 con 0x7fa1a400b490 2024-01-30T08:09:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1cca00640 1 -- 172.21.15.50:0/786287732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 msgr2=0x7fa1a400d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1cca00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1a400d950 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc001e70 tx=0x7fa1bc01c760 comp rx=0 tx=0).stop 2024-01-30T08:09:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1cca00640 1 -- 172.21.15.50:0/786287732 shutdown_connections 2024-01-30T08:09:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1cca00640 1 --2- 172.21.15.50:0/786287732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1a400d950 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1cca00640 1 -- 172.21.15.50:0/786287732 >> 172.21.15.50:0/786287732 conn(0x7fa1c40c5b50 msgr2=0x7fa1c40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1cca00640 1 -- 172.21.15.50:0/786287732 shutdown_connections 2024-01-30T08:09:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.511+0000 7fa1cca00640 1 -- 172.21.15.50:0/786287732 wait complete. 2024-01-30T08:09:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 Processor -- start 2024-01-30T08:09:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 -- start start 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1c406bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1c41ea580 0x7fa1c414d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1c41ed860 0x7fa1c41559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c414da10 con 0x7fa1a400b490 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c41eaa00 con 0x7fa1c41ea580 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c41ed0f0 con 0x7fa1c41ed860 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1c406bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1c406bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35706/0 (socket says 172.21.15.50:35706) 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 -- 172.21.15.50:0/543297807 learned_addr learned my addr 172.21.15.50:0/543297807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1c9600640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1c41ea580 0x7fa1c414d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1caa00640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1c41ed860 0x7fa1c41559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 -- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1c41ed860 msgr2=0x7fa1c41559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1c41ed860 0x7fa1c41559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 -- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1c41ea580 msgr2=0x7fa1c414d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1c41ea580 0x7fa1c414d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 -- 172.21.15.50:0/543297807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4151af0 con 0x7fa1a400b490 2024-01-30T08:09:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1ca000640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1c406bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4007fd0 tx=0x7fa1b40077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1c2000640 1 -- 172.21.15.50:0/543297807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400f9b0 con 0x7fa1a400b490 2024-01-30T08:09:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1c2000640 1 -- 172.21.15.50:0/543297807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b400fb10 con 0x7fa1a400b490 2024-01-30T08:09:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1c2000640 1 -- 172.21.15.50:0/543297807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400fe80 con 0x7fa1a400b490 2024-01-30T08:09:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c414ee60 con 0x7fa1a400b490 2024-01-30T08:09:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c414f420 con 0x7fa1a400b490 2024-01-30T08:09:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.515+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c4074a20 con 0x7fa1a400b490 2024-01-30T08:09:26.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.519+0000 7fa1c2000640 1 -- 172.21.15.50:0/543297807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa1b401d460 con 0x7fa1a400b490 2024-01-30T08:09:26.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.519+0000 7fa1c2000640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa19c066530 0x7fa19c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.519+0000 7fa1c2000640 1 -- 172.21.15.50:0/543297807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1b4084420 con 0x7fa1a400b490 2024-01-30T08:09:26.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.519+0000 7fa1c9600640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa19c066530 0x7fa19c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.519+0000 7fa1c9600640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa19c066530 0x7fa19c0689f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa1c414f7b0 tx=0x7fa1ac009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.523+0000 7fa1c2000640 1 -- 172.21.15.50:0/543297807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa1b40513c0 con 0x7fa1a400b490 2024-01-30T08:09:26.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.683+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1c4073d20 con 0x7fa1a400b490 2024-01-30T08:09:26.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1c2000640 1 -- 172.21.15.50:0/543297807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7fa1b40549e0 con 0x7fa1a400b490 2024-01-30T08:09:26.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:26.689 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa19c066530 msgr2=0x7fa19c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa19c066530 0x7fa19c0689f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa1c414f7b0 tx=0x7fa1ac009190 comp rx=0 tx=0).stop 2024-01-30T08:09:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 msgr2=0x7fa1c406bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1c406bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4007fd0 tx=0x7fa1b40077a0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 shutdown_connections 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1c41ea580 0x7fa1c414d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa19c066530 0x7fa19c0689f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1c41ed860 0x7fa1c41559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 --2- 172.21.15.50:0/543297807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1a400b490 0x7fa1c406bf30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 >> 172.21.15.50:0/543297807 conn(0x7fa1c40c5b50 msgr2=0x7fa1c40bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 shutdown_connections 2024-01-30T08:09:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.687+0000 7fa1cca00640 1 -- 172.21.15.50:0/543297807 wait complete. 2024-01-30T08:09:26.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:26.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:26.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.851+0000 7fe3a1c00640 1 Processor -- start 2024-01-30T08:09:26.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.851+0000 7fe3a1c00640 1 -- start start 2024-01-30T08:09:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.851+0000 7fe3a1c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c0a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.851+0000 7fe3a1c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c06c4c0 con 0x7fe39c0a51e0 2024-01-30T08:09:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.851+0000 7fe3a1c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c0c0550 con 0x7fe39c06bfe0 2024-01-30T08:09:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.851+0000 7fe3a1c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0c07c0 con 0x7fe39c072b60 2024-01-30T08:09:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe39b400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe39c0a51e0 0x7fe39c15bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60906/0 (socket says 172.21.15.50:60906) 2024-01-30T08:09:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe39b400640 1 -- 172.21.15.50:0/2577243710 learned_addr learned my addr 172.21.15.50:0/2577243710 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe39aa00640 1 --2- 172.21.15.50:0/2577243710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c0a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe399600640 1 -- 172.21.15.50:0/2577243710 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161647896 0 0) 0x7fe39c06c4c0 con 0x7fe39c0a51e0 2024-01-30T08:09:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe399600640 1 -- 172.21.15.50:0/2577243710 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe37c005740 con 0x7fe39c0a51e0 2024-01-30T08:09:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe399600640 1 -- 172.21.15.50:0/2577243710 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033536709 0 0) 0x7fe39c0c0550 con 0x7fe39c06bfe0 2024-01-30T08:09:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe399600640 1 -- 172.21.15.50:0/2577243710 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe39c06c4c0 con 0x7fe39c06bfe0 2024-01-30T08:09:26.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe39aa00640 1 -- 172.21.15.50:0/2577243710 >> v1:172.21.15.125:6789/0 conn(0x7fe39c06bfe0 legacy=0x7fe39c0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe39aa00640 1 -- 172.21.15.50:0/2577243710 >> v1:172.21.15.50:6789/0 conn(0x7fe39c0a51e0 legacy=0x7fe39c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe39aa00640 1 -- 172.21.15.50:0/2577243710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0c0aa0 con 0x7fe39c072b60 2024-01-30T08:09:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe39aa00640 1 --2- 172.21.15.50:0/2577243710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c0a4ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0097f0 tx=0x7fe38c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=706187c764ae11b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.855+0000 7fe399600640 1 -- 172.21.15.50:0/2577243710 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0ab600 con 0x7fe39c072b60 2024-01-30T08:09:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe399600640 1 -- 172.21.15.50:0/2577243710 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0a7050 con 0x7fe39c072b60 2024-01-30T08:09:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe399600640 1 -- 172.21.15.50:0/2577243710 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0ab960 con 0x7fe39c072b60 2024-01-30T08:09:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2577243710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 msgr2=0x7fe39c0a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2577243710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c0a4ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0097f0 tx=0x7fe38c01c400 comp rx=0 tx=0).stop 2024-01-30T08:09:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2577243710 shutdown_connections 2024-01-30T08:09:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2577243710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c0a4ca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2577243710 >> 172.21.15.50:0/2577243710 conn(0x7fe39c0c5b30 msgr2=0x7fe39c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2577243710 shutdown_connections 2024-01-30T08:09:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2577243710 wait complete. 2024-01-30T08:09:26.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 Processor -- start 2024-01-30T08:09:26.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- start start 2024-01-30T08:09:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe39c06bfe0 0x7fe39c150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe39c0a51e0 0x7fe39c144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1f0cf0 con 0x7fe39c0a51e0 2024-01-30T08:09:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1f0fd0 con 0x7fe39c06bfe0 2024-01-30T08:09:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.859+0000 7fe3a1c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1f12b0 con 0x7fe39c072b60 2024-01-30T08:09:26.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe39c0a51e0 0x7fe39c144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe39c0a51e0 0x7fe39c144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35718/0 (socket says 172.21.15.50:35718) 2024-01-30T08:09:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 -- 172.21.15.50:0/2917275224 learned_addr learned my addr 172.21.15.50:0/2917275224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39a000640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39aa00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe39c06bfe0 0x7fe39c150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 -- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 msgr2=0x7fe39c143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 -- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe39c06bfe0 msgr2=0x7fe39c150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe39c06bfe0 0x7fe39c150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 -- 172.21.15.50:0/2917275224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c009420 con 0x7fe39c0a51e0 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe39b400640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe39c0a51e0 0x7fe39c144160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe39400caa0 tx=0x7fe39400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe392a00640 1 -- 172.21.15.50:0/2917275224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400ac00 con 0x7fe39c0a51e0 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe392a00640 1 -- 172.21.15.50:0/2917275224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400ad80 con 0x7fe39c0a51e0 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c1f1590 con 0x7fe39c0a51e0 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe392a00640 1 -- 172.21.15.50:0/2917275224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394012640 con 0x7fe39c0a51e0 2024-01-30T08:09:26.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c1513e0 con 0x7fe39c0a51e0 2024-01-30T08:09:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c074a20 con 0x7fe39c0a51e0 2024-01-30T08:09:26.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.863+0000 7fe392a00640 1 -- 172.21.15.50:0/2917275224 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe394007070 con 0x7fe39c0a51e0 2024-01-30T08:09:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.867+0000 7fe392a00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe374066530 0x7fe3740689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.867+0000 7fe392a00640 1 -- 172.21.15.50:0/2917275224 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe394083fe0 con 0x7fe39c0a51e0 2024-01-30T08:09:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.867+0000 7fe39aa00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe374066530 0x7fe3740689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.867+0000 7fe39aa00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe374066530 0x7fe3740689f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ad000 tx=0x7fe38c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:26.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:26.867+0000 7fe392a00640 1 -- 172.21.15.50:0/2917275224 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe394051090 con 0x7fe39c0a51e0 2024-01-30T08:09:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.031+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe39c0c6a40 con 0x7fe39c0a51e0 2024-01-30T08:09:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.031+0000 7fe392a00640 1 -- 172.21.15.50:0/2917275224 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe39c0c6a40 con 0x7fe39c0a51e0 2024-01-30T08:09:27.035 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe374066530 msgr2=0x7fe3740689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe374066530 0x7fe3740689f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ad000 tx=0x7fe38c0a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe39c0a51e0 msgr2=0x7fe39c144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe39c0a51e0 0x7fe39c144160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe39400caa0 tx=0x7fe39400cf60 comp rx=0 tx=0).stop 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 shutdown_connections 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe374066530 0x7fe3740689f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe39c0a51e0 0x7fe39c144160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe39c072b60 0x7fe39c143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 --2- 172.21.15.50:0/2917275224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe39c06bfe0 0x7fe39c150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 >> 172.21.15.50:0/2917275224 conn(0x7fe39c0c5b30 msgr2=0x7fe39c0bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 shutdown_connections 2024-01-30T08:09:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.035+0000 7fe3a1c00640 1 -- 172.21.15.50:0/2917275224 wait complete. 2024-01-30T08:09:27.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.199+0000 7fcafd600640 1 Processor -- start 2024-01-30T08:09:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.199+0000 7fcafd600640 1 -- start start 2024-01-30T08:09:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.199+0000 7fcafd600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf8072b60 0x7fcaf80a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.199+0000 7fcafd600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcaf80a51e0 0x7fcaf80c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcafd600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf806c4c0 con 0x7fcaf806bfe0 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcafd600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf80c0550 con 0x7fcaf80a51e0 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcafd600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80c07c0 con 0x7fcaf8072b60 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf8072b60 0x7fcaf80a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf8072b60 0x7fcaf80a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:52940/0 (socket says 172.21.15.50:52940) 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6a00640 1 -- 172.21.15.50:0/1417797117 learned_addr learned my addr 172.21.15.50:0/1417797117 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6000640 1 --1- 172.21.15.50:0/1417797117 >> v1:172.21.15.125:6789/0 conn(0x7fcaf806bfe0 0x7fcaf80c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:46802/0 (socket says 172.21.15.50:46802) 2024-01-30T08:09:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf7400640 1 --2- 172.21.15.50:0/1417797117 >> v2:172.21.15.125:3300/0 conn(0x7fcaf80a51e0 0x7fcaf80c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6a00640 1 -- 172.21.15.50:0/1417797117 >> v2:172.21.15.125:3300/0 conn(0x7fcaf80a51e0 msgr2=0x7fcaf80c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6a00640 1 --2- 172.21.15.50:0/1417797117 >> v2:172.21.15.125:3300/0 conn(0x7fcaf80a51e0 0x7fcaf80c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6a00640 1 -- 172.21.15.50:0/1417797117 >> v1:172.21.15.125:6789/0 conn(0x7fcaf806bfe0 legacy=0x7fcaf80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf5600640 1 -- 172.21.15.50:0/1417797117 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153422906 0 0) 0x7fcaf806c4c0 con 0x7fcaf806bfe0 2024-01-30T08:09:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.203+0000 7fcaf6a00640 1 -- 172.21.15.50:0/1417797117 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf80c0aa0 con 0x7fcaf8072b60 2024-01-30T08:09:27.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcaf6a00640 1 --2- 172.21.15.50:0/1417797117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf8072b60 0x7fcaf80a4ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009870 tx=0x7fcae801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbeb8fac9ca08115 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcaf5600640 1 -- 172.21.15.50:0/1417797117 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80a6040 con 0x7fcaf8072b60 2024-01-30T08:09:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcaf5600640 1 -- 172.21.15.50:0/1417797117 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae80aa600 con 0x7fcaf8072b60 2024-01-30T08:09:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcaf5600640 1 -- 172.21.15.50:0/1417797117 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80aa990 con 0x7fcaf8072b60 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 -- 172.21.15.50:0/1417797117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf8072b60 msgr2=0x7fcaf80a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 --2- 172.21.15.50:0/1417797117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf8072b60 0x7fcaf80a4ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009870 tx=0x7fcae801c480 comp rx=0 tx=0).stop 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 -- 172.21.15.50:0/1417797117 shutdown_connections 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 --2- 172.21.15.50:0/1417797117 >> v2:172.21.15.125:3300/0 conn(0x7fcaf80a51e0 0x7fcaf80c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 --2- 172.21.15.50:0/1417797117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf8072b60 0x7fcaf80a4ca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 -- 172.21.15.50:0/1417797117 >> 172.21.15.50:0/1417797117 conn(0x7fcaf80c5b30 msgr2=0x7fcaf80c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 -- 172.21.15.50:0/1417797117 shutdown_connections 2024-01-30T08:09:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 -- 172.21.15.50:0/1417797117 wait complete. 2024-01-30T08:09:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 Processor -- start 2024-01-30T08:09:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.207+0000 7fcafd600640 1 -- start start 2024-01-30T08:09:27.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf806bfe0 0x7fcaf81f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8072b60 0x7fcaf81edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf80a51e0 0x7fcaf814af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf81ee080 con 0x7fcaf8072b60 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf81f0d20 con 0x7fcaf80a51e0 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf81513a0 con 0x7fcaf806bfe0 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8072b60 0x7fcaf81edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8072b60 0x7fcaf81edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35724/0 (socket says 172.21.15.50:35724) 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 -- 172.21.15.50:0/3955495229 learned_addr learned my addr 172.21.15.50:0/3955495229 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6a00640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf806bfe0 0x7fcaf81f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf7400640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf80a51e0 0x7fcaf814af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 -- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf806bfe0 msgr2=0x7fcaf81f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf806bfe0 0x7fcaf81f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 -- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf80a51e0 msgr2=0x7fcaf814af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf80a51e0 0x7fcaf814af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 -- 172.21.15.50:0/3955495229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80094d0 con 0x7fcaf8072b60 2024-01-30T08:09:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaf6000640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8072b60 0x7fcaf81edb40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c410 tx=0x7fcae000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaeea00640 1 -- 172.21.15.50:0/3955495229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00074e0 con 0x7fcaf8072b60 2024-01-30T08:09:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaeea00640 1 -- 172.21.15.50:0/3955495229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae0007640 con 0x7fcaf8072b60 2024-01-30T08:09:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcaeea00640 1 -- 172.21.15.50:0/3955495229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0004a30 con 0x7fcaf8072b60 2024-01-30T08:09:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf81510c0 con 0x7fcaf8072b60 2024-01-30T08:09:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf81f09b0 con 0x7fcaf8072b60 2024-01-30T08:09:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.211+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf81f0eb0 con 0x7fcaf8072b60 2024-01-30T08:09:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.215+0000 7fcaeea00640 1 -- 172.21.15.50:0/3955495229 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcae0004b90 con 0x7fcaf8072b60 2024-01-30T08:09:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.215+0000 7fcaeea00640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcad0066530 0x7fcad00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.215+0000 7fcaeea00640 1 -- 172.21.15.50:0/3955495229 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcae0083e70 con 0x7fcaf8072b60 2024-01-30T08:09:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.215+0000 7fcaf6a00640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcad0066530 0x7fcad00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.215+0000 7fcaf6a00640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcad0066530 0x7fcad00689f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcae80ae000 tx=0x7fcae80b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.219+0000 7fcaeea00640 1 -- 172.21.15.50:0/3955495229 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcae0050e30 con 0x7fcaf8072b60 2024-01-30T08:09:27.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.383+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcaf80c5580 con 0x7fcaf8072b60 2024-01-30T08:09:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.383+0000 7fcaeea00640 1 -- 172.21.15.50:0/3955495229 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcae0054450 con 0x7fcaf8072b60 2024-01-30T08:09:27.388 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcad0066530 msgr2=0x7fcad00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcad0066530 0x7fcad00689f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcae80ae000 tx=0x7fcae80b5040 comp rx=0 tx=0).stop 2024-01-30T08:09:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8072b60 msgr2=0x7fcaf81edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8072b60 0x7fcaf81edb40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c410 tx=0x7fcae000c8d0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 shutdown_connections 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf80a51e0 0x7fcaf814af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcad0066530 0x7fcad00689f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf8072b60 0x7fcaf81edb40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 --2- 172.21.15.50:0/3955495229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcaf806bfe0 0x7fcaf81f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 >> 172.21.15.50:0/3955495229 conn(0x7fcaf80c5b30 msgr2=0x7fcaf80c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 shutdown_connections 2024-01-30T08:09:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.387+0000 7fcafd600640 1 -- 172.21.15.50:0/3955495229 wait complete. 2024-01-30T08:09:27.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:27.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e64800640 1 Processor -- start 2024-01-30T08:09:27.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e64800640 1 -- start start 2024-01-30T08:09:27.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e64800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0a4da0 0x7f2e5c153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e64800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0c54e0 con 0x7f2e5c0c04b0 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e64800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c152bf0 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e64800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c072d90 con 0x7f2e5c0a4da0 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e62800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e5c0c04b0 0x7f2e5c06ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60908/0 (socket says 172.21.15.50:60908) 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e62800640 1 -- 172.21.15.50:0/1030672395 learned_addr learned my addr 172.21.15.50:0/1030672395 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e61400640 1 --2- 172.21.15.50:0/1030672395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0a4da0 0x7f2e5c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e60a00640 1 -- 172.21.15.50:0/1030672395 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769939644 0 0) 0x7f2e5c0c54e0 con 0x7f2e5c0c04b0 2024-01-30T08:09:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e60a00640 1 -- 172.21.15.50:0/1030672395 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c003530 con 0x7f2e5c0c04b0 2024-01-30T08:09:27.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e61400640 1 -- 172.21.15.50:0/1030672395 >> v1:172.21.15.125:6789/0 conn(0x7f2e5c14fbf0 legacy=0x7f2e5c0c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e61400640 1 -- 172.21.15.50:0/1030672395 >> v1:172.21.15.50:6789/0 conn(0x7f2e5c0c04b0 legacy=0x7f2e5c06ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.551+0000 7f2e61400640 1 -- 172.21.15.50:0/1030672395 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c1525e0 con 0x7f2e5c0a4da0 2024-01-30T08:09:27.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e61400640 1 --2- 172.21.15.50:0/1030672395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0a4da0 0x7f2e5c153080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e440097f0 tx=0x7f2e4401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a6f08d235d0d0a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e60a00640 1 -- 172.21.15.50:0/1030672395 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440ab600 con 0x7f2e5c0a4da0 2024-01-30T08:09:27.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e60a00640 1 -- 172.21.15.50:0/1030672395 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e440a7050 con 0x7f2e5c0a4da0 2024-01-30T08:09:27.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e60a00640 1 -- 172.21.15.50:0/1030672395 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440ab980 con 0x7f2e5c0a4da0 2024-01-30T08:09:27.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e64800640 1 -- 172.21.15.50:0/1030672395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0a4da0 msgr2=0x7f2e5c153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e64800640 1 --2- 172.21.15.50:0/1030672395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0a4da0 0x7f2e5c153080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e440097f0 tx=0x7f2e4401c430 comp rx=0 tx=0).stop 2024-01-30T08:09:27.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e64800640 1 -- 172.21.15.50:0/1030672395 shutdown_connections 2024-01-30T08:09:27.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e64800640 1 --2- 172.21.15.50:0/1030672395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0a4da0 0x7f2e5c153080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e64800640 1 -- 172.21.15.50:0/1030672395 >> 172.21.15.50:0/1030672395 conn(0x7f2e5c0c5b30 msgr2=0x7f2e5c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:27.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e64800640 1 -- 172.21.15.50:0/1030672395 shutdown_connections 2024-01-30T08:09:27.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.555+0000 7f2e64800640 1 -- 172.21.15.50:0/1030672395 wait complete. 2024-01-30T08:09:27.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 Processor -- start 2024-01-30T08:09:27.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 -- start start 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5c0a4da0 0x7f2e5c0a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0c04b0 0x7f2e5c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e5c14fbf0 0x7f2e5c0a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c14cf70 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0abb90 con 0x7f2e5c0a4da0 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0ab8b0 con 0x7f2e5c0c04b0 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e5c14fbf0 0x7f2e5c0a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e5c14fbf0 0x7f2e5c0a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35734/0 (socket says 172.21.15.50:35734) 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 -- 172.21.15.50:0/1696174952 learned_addr learned my addr 172.21.15.50:0/1696174952 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e61400640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0c04b0 0x7f2e5c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e61e00640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5c0a4da0 0x7f2e5c0a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 -- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0c04b0 msgr2=0x7f2e5c151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0c04b0 0x7f2e5c151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 -- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5c0a4da0 msgr2=0x7f2e5c0a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5c0a4da0 0x7f2e5c0a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 -- 172.21.15.50:0/1696174952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44009420 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e61400640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0c04b0 0x7f2e5c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e62800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e5c14fbf0 0x7f2e5c0a99a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400cb40 tx=0x7f2e5400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e5a000640 1 -- 172.21.15.50:0/1696174952 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400aca0 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e5a000640 1 -- 172.21.15.50:0/1696174952 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400ae00 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e5a000640 1 -- 172.21.15.50:0/1696174952 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54012620 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.559+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c15c990 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.563+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c1540d0 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.563+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c068250 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.563+0000 7f2e5a000640 1 -- 172.21.15.50:0/1696174952 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2e54007070 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.563+0000 7f2e5a000640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2e34066530 0x7f2e340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.563+0000 7f2e5a000640 1 -- 172.21.15.50:0/1696174952 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e540841f0 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.563+0000 7f2e61e00640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2e34066530 0x7f2e340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.563+0000 7f2e61e00640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2e34066530 0x7f2e340689f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0a9940 tx=0x7f2e4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.567+0000 7f2e5a000640 1 -- 172.21.15.50:0/1696174952 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2e54051190 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e5c074a20 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e5a000640 1 -- 172.21.15.50:0/1696174952 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e540547b0 con 0x7f2e5c14fbf0 2024-01-30T08:09:27.730 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2e34066530 msgr2=0x7f2e340689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2e34066530 0x7f2e340689f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0a9940 tx=0x7f2e4c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e5c14fbf0 msgr2=0x7f2e5c0a99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e5c14fbf0 0x7f2e5c0a99a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400cb40 tx=0x7f2e5400a060 comp rx=0 tx=0).stop 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 shutdown_connections 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2e34066530 0x7f2e340689f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e5c14fbf0 0x7f2e5c0a99a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e5c0c04b0 0x7f2e5c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.727+0000 7f2e64800640 1 --2- 172.21.15.50:0/1696174952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5c0a4da0 0x7f2e5c0a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.731+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 >> 172.21.15.50:0/1696174952 conn(0x7f2e5c0c5b30 msgr2=0x7f2e5c0a5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.731+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 shutdown_connections 2024-01-30T08:09:27.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.731+0000 7f2e64800640 1 -- 172.21.15.50:0/1696174952 wait complete. 2024-01-30T08:09:27.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:27.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.891+0000 7f34aa000640 1 Processor -- start 2024-01-30T08:09:27.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.891+0000 7f34aa000640 1 -- start start 2024-01-30T08:09:27.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34aa000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f34a4155500 0x7f34a40c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34aa000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34a406f6d0 0x7f34a40c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34aa000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a4158b70 con 0x7f34a406f240 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34aa000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a406fae0 con 0x7f34a406f6d0 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34aa000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a4157f60 con 0x7f34a4155500 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34a406f6d0 0x7f34a40c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34a406f6d0 0x7f34a40c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35748/0 (socket says 172.21.15.50:35748) 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3e00640 1 -- 172.21.15.50:0/3876730778 learned_addr learned my addr 172.21.15.50:0/3876730778 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3400640 1 --2- 172.21.15.50:0/3876730778 >> v2:172.21.15.125:3300/0 conn(0x7f34a4155500 0x7f34a40c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3e00640 1 -- 172.21.15.50:0/3876730778 >> v2:172.21.15.125:3300/0 conn(0x7f34a4155500 msgr2=0x7f34a40c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3e00640 1 --2- 172.21.15.50:0/3876730778 >> v2:172.21.15.125:3300/0 conn(0x7f34a4155500 0x7f34a40c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3e00640 1 -- 172.21.15.50:0/3876730778 >> v1:172.21.15.125:6789/0 conn(0x7f34a406f240 legacy=0x7f34a40c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3e00640 1 -- 172.21.15.50:0/3876730778 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4158240 con 0x7f34a406f6d0 2024-01-30T08:09:27.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.895+0000 7f34a3400640 1 --2- 172.21.15.50:0/3876730778 >> v2:172.21.15.125:3300/0 conn(0x7f34a4155500 0x7f34a40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:27.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34a3e00640 1 --2- 172.21.15.50:0/3876730778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f6d0 0x7f34a40c1910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34a40aaaf0 tx=0x7f349c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5827d517df2a90 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34a2000640 1 -- 172.21.15.50:0/3876730778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0a5740 con 0x7f34a406f6d0 2024-01-30T08:09:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34a2000640 1 -- 172.21.15.50:0/3876730778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0a58a0 con 0x7f34a406f6d0 2024-01-30T08:09:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34a2000640 1 -- 172.21.15.50:0/3876730778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0a5c30 con 0x7f34a406f6d0 2024-01-30T08:09:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- 172.21.15.50:0/3876730778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f6d0 msgr2=0x7f34a40c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 --2- 172.21.15.50:0/3876730778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f6d0 0x7f34a40c1910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34a40aaaf0 tx=0x7f349c01c880 comp rx=0 tx=0).stop 2024-01-30T08:09:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- 172.21.15.50:0/3876730778 shutdown_connections 2024-01-30T08:09:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 --2- 172.21.15.50:0/3876730778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f6d0 0x7f34a40c1910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 --2- 172.21.15.50:0/3876730778 >> v2:172.21.15.125:3300/0 conn(0x7f34a4155500 0x7f34a40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- 172.21.15.50:0/3876730778 >> 172.21.15.50:0/3876730778 conn(0x7f34a40727c0 msgr2=0x7f34a406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- 172.21.15.50:0/3876730778 shutdown_connections 2024-01-30T08:09:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- 172.21.15.50:0/3876730778 wait complete. 2024-01-30T08:09:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 Processor -- start 2024-01-30T08:09:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- start start 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f240 0x7f34a414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a406f6d0 0x7f34a4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a4155500 0x7f34a4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a414ec50 con 0x7f34a406f240 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40c3230 con 0x7f34a4155500 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.899+0000 7f34aa000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40aa120 con 0x7f34a406f6d0 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f240 0x7f34a414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f240 0x7f34a414f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35756/0 (socket says 172.21.15.50:35756) 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 -- 172.21.15.50:0/3235888423 learned_addr learned my addr 172.21.15.50:0/3235888423 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3e00640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a4155500 0x7f34a4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a2a00640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a406f6d0 0x7f34a4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 -- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a406f6d0 msgr2=0x7f34a4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a406f6d0 0x7f34a4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 -- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a4155500 msgr2=0x7f34a4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a4155500 0x7f34a4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 -- 172.21.15.50:0/3235888423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c009b30 con 0x7f34a406f240 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a2a00640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a406f6d0 0x7f34a4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34a3400640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f240 0x7f34a414f340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f349400d830 tx=0x7f349400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f349b400640 1 -- 172.21.15.50:0/3235888423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494009660 con 0x7f34a406f240 2024-01-30T08:09:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f349b400640 1 -- 172.21.15.50:0/3235888423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34940097c0 con 0x7f34a406f240 2024-01-30T08:09:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f349b400640 1 -- 172.21.15.50:0/3235888423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494009b70 con 0x7f34a406f240 2024-01-30T08:09:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a40c3480 con 0x7f34a406f240 2024-01-30T08:09:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a40c3a40 con 0x7f34a406f240 2024-01-30T08:09:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4074a20 con 0x7f34a406f240 2024-01-30T08:09:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.903+0000 7f349b400640 1 -- 172.21.15.50:0/3235888423 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3494014410 con 0x7f34a406f240 2024-01-30T08:09:27.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.907+0000 7f349b400640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f347c066500 0x7f347c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:27.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.907+0000 7f349b400640 1 -- 172.21.15.50:0/3235888423 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3494084b50 con 0x7f34a406f240 2024-01-30T08:09:27.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.907+0000 7f34a2a00640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f347c066500 0x7f347c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:27.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.907+0000 7f34a2a00640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f347c066500 0x7f347c0689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f34a406cf50 tx=0x7f348c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:27.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:27.911+0000 7f349b400640 1 -- 172.21.15.50:0/3235888423 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3494051af0 con 0x7f34a406f240 2024-01-30T08:09:28.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f34a40c83c0 con 0x7f34a406f240 2024-01-30T08:09:28.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f349b400640 1 -- 172.21.15.50:0/3235888423 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3494055110 con 0x7f34a406f240 2024-01-30T08:09:28.073 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f347c066500 msgr2=0x7f347c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f347c066500 0x7f347c0689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f34a406cf50 tx=0x7f348c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f240 msgr2=0x7f34a414f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f240 0x7f34a414f340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f349400d830 tx=0x7f349400dcf0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 shutdown_connections 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34a4155500 0x7f34a4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f347c066500 0x7f347c0689c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34a406f6d0 0x7f34a4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 --2- 172.21.15.50:0/3235888423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a406f240 0x7f34a414f340 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 >> 172.21.15.50:0/3235888423 conn(0x7f34a40727c0 msgr2=0x7f34a40c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 shutdown_connections 2024-01-30T08:09:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.071+0000 7f34aa000640 1 -- 172.21.15.50:0/3235888423 wait complete. 2024-01-30T08:09:28.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d7600640 1 Processor -- start 2024-01-30T08:09:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d7600640 1 -- start start 2024-01-30T08:09:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d7600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d0153390 0x7f58d006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d7600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d0152f00 con 0x7f58d006de40 2024-01-30T08:09:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d7600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d01525f0 con 0x7f58d00c4310 2024-01-30T08:09:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d7600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00a7680 con 0x7f58d0153390 2024-01-30T08:09:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d4c00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f58d006de40 0x7f58d00a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60918/0 (socket says 172.21.15.50:60918) 2024-01-30T08:09:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58d4c00640 1 -- 172.21.15.50:0/4139514269 learned_addr learned my addr 172.21.15.50:0/4139514269 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cfe00640 1 --2- 172.21.15.50:0/4139514269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d0153390 0x7f58d006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875220290 0 0) 0x7f58d0152f00 con 0x7f58d006de40 2024-01-30T08:09:28.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b0003530 con 0x7f58d006de40 2024-01-30T08:09:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032453151 0 0) 0x7f58d01525f0 con 0x7f58d00c4310 2024-01-30T08:09:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d0152f00 con 0x7f58d00c4310 2024-01-30T08:09:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cfe00640 1 -- 172.21.15.50:0/4139514269 >> v1:172.21.15.125:6789/0 conn(0x7f58d00c4310 legacy=0x7f58d0155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cfe00640 1 -- 172.21.15.50:0/4139514269 >> v1:172.21.15.50:6789/0 conn(0x7f58d006de40 legacy=0x7f58d00a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431254000 0 0) 0x7f58b0003530 con 0x7f58d006de40 2024-01-30T08:09:28.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.235+0000 7f58cfe00640 1 -- 172.21.15.50:0/4139514269 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d01528b0 con 0x7f58d0153390 2024-01-30T08:09:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58cfe00640 1 --2- 172.21.15.50:0/4139514269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d0153390 0x7f58d006e220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097f0 tx=0x7f58b801c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39ac8b21f74e577 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0001680 con 0x7f58d0153390 2024-01-30T08:09:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80a7050 con 0x7f58d0153390 2024-01-30T08:09:28.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58cf400640 1 -- 172.21.15.50:0/4139514269 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80ab620 con 0x7f58d0153390 2024-01-30T08:09:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58d7600640 1 -- 172.21.15.50:0/4139514269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d0153390 msgr2=0x7f58d006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58d7600640 1 --2- 172.21.15.50:0/4139514269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d0153390 0x7f58d006e220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097f0 tx=0x7f58b801c290 comp rx=0 tx=0).stop 2024-01-30T08:09:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58d7600640 1 -- 172.21.15.50:0/4139514269 shutdown_connections 2024-01-30T08:09:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58d7600640 1 --2- 172.21.15.50:0/4139514269 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d0153390 0x7f58d006e220 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.239+0000 7f58d7600640 1 -- 172.21.15.50:0/4139514269 >> 172.21.15.50:0/4139514269 conn(0x7f58d00c4830 msgr2=0x7f58d00c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 -- 172.21.15.50:0/4139514269 shutdown_connections 2024-01-30T08:09:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 -- 172.21.15.50:0/4139514269 wait complete. 2024-01-30T08:09:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 Processor -- start 2024-01-30T08:09:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 -- start start 2024-01-30T08:09:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58d006de40 0x7f58d00be170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d00c4310 0x7f58d014bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d0153390 0x7f58d014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01f1420 con 0x7f58d006de40 2024-01-30T08:09:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01f0f90 con 0x7f58d0153390 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d7600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00bed90 con 0x7f58d00c4310 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58d006de40 0x7f58d00be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58d006de40 0x7f58d00be170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35758/0 (socket says 172.21.15.50:35758) 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 -- 172.21.15.50:0/4061790471 learned_addr learned my addr 172.21.15.50:0/4061790471 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58cfe00640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d00c4310 0x7f58d014bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d5600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d0153390 0x7f58d014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 -- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d00c4310 msgr2=0x7f58d014bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d00c4310 0x7f58d014bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 -- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d0153390 msgr2=0x7f58d014c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d0153390 0x7f58d014c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 -- 172.21.15.50:0/4061790471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009420 con 0x7f58d006de40 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d5600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d0153390 0x7f58d014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.243+0000 7f58d4c00640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58d006de40 0x7f58d00be170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c780 tx=0x7f58c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58ccc00640 1 -- 172.21.15.50:0/4061790471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0005cf0 con 0x7f58d006de40 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58ccc00640 1 -- 172.21.15.50:0/4061790471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0005e50 con 0x7f58d006de40 2024-01-30T08:09:28.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58ccc00640 1 -- 172.21.15.50:0/4061790471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0007270 con 0x7f58d006de40 2024-01-30T08:09:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d01f0660 con 0x7f58d006de40 2024-01-30T08:09:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d01f0c20 con 0x7f58d006de40 2024-01-30T08:09:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d0074a20 con 0x7f58d006de40 2024-01-30T08:09:28.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58ccc00640 1 -- 172.21.15.50:0/4061790471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f58c00073d0 con 0x7f58d006de40 2024-01-30T08:09:28.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58ccc00640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f58a8066500 0x7f58a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58ccc00640 1 -- 172.21.15.50:0/4061790471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58c0083880 con 0x7f58d006de40 2024-01-30T08:09:28.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.247+0000 7f58cfe00640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f58a8066500 0x7f58a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.251+0000 7f58cfe00640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f58a8066500 0x7f58a80689c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f58b80ad000 tx=0x7f58b80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.251+0000 7f58ccc00640 1 -- 172.21.15.50:0/4061790471 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f58c0050850 con 0x7f58d006de40 2024-01-30T08:09:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.415+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58d00a6b40 con 0x7f58d006de40 2024-01-30T08:09:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58ccc00640 1 -- 172.21.15.50:0/4061790471 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f58c0053e70 con 0x7f58d006de40 2024-01-30T08:09:28.421 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:28.421 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:08:46.697605+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f58a8066500 msgr2=0x7f58a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f58a8066500 0x7f58a80689c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f58b80ad000 tx=0x7f58b80a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58d006de40 msgr2=0x7f58d00be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58d006de40 0x7f58d00be170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c780 tx=0x7f58c000cc40 comp rx=0 tx=0).stop 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 shutdown_connections 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58d0153390 0x7f58d014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f58a8066500 0x7f58a80689c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58d00c4310 0x7f58d014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 --2- 172.21.15.50:0/4061790471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58d006de40 0x7f58d00be170 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 >> 172.21.15.50:0/4061790471 conn(0x7f58d00c4830 msgr2=0x7f58d00c5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 shutdown_connections 2024-01-30T08:09:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.419+0000 7f58d7600640 1 -- 172.21.15.50:0/4061790471 wait complete. 2024-01-30T08:09:28.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:28.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.587+0000 7f96e7600640 1 Processor -- start 2024-01-30T08:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e7600640 1 -- start start 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e7600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96e00a6480 0x7f96e0072870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e7600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00c0a20 con 0x7f96e006f060 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e7600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00716f0 con 0x7f96e0071b80 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e7600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00c0c70 con 0x7f96e00a6480 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e4c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96e00a6480 0x7f96e0072870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e4c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96e00a6480 0x7f96e0072870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35762/0 (socket says 172.21.15.50:35762) 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e4c00640 1 -- 172.21.15.50:0/2764056904 learned_addr learned my addr 172.21.15.50:0/2764056904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96dfe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f96e006f060 0x7f96e006a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60920/0 (socket says 172.21.15.50:60920) 2024-01-30T08:09:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e4c00640 1 -- 172.21.15.50:0/2764056904 >> v1:172.21.15.125:6789/0 conn(0x7f96e0071b80 legacy=0x7f96e0071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e4c00640 1 -- 172.21.15.50:0/2764056904 >> v1:172.21.15.50:6789/0 conn(0x7f96e006f060 legacy=0x7f96e006a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96e4c00640 1 -- 172.21.15.50:0/2764056904 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00c0f50 con 0x7f96e00a6480 2024-01-30T08:09:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.591+0000 7f96df400640 1 -- 172.21.15.50:0/2764056904 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19314751 0 0) 0x7f96e00c0a20 con 0x7f96e006f060 2024-01-30T08:09:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e4c00640 1 --2- 172.21.15.50:0/2764056904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e00a6480 0x7f96e0072870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009870 tx=0x7f96d001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d683323524a10ed8 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96df400640 1 -- 172.21.15.50:0/2764056904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00aa650 con 0x7f96e00a6480 2024-01-30T08:09:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96df400640 1 -- 172.21.15.50:0/2764056904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00aa7b0 con 0x7f96e00a6480 2024-01-30T08:09:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96df400640 1 -- 172.21.15.50:0/2764056904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00aab40 con 0x7f96e00a6480 2024-01-30T08:09:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 -- 172.21.15.50:0/2764056904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e00a6480 msgr2=0x7f96e0072870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 --2- 172.21.15.50:0/2764056904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e00a6480 0x7f96e0072870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009870 tx=0x7f96d001c510 comp rx=0 tx=0).stop 2024-01-30T08:09:28.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 -- 172.21.15.50:0/2764056904 shutdown_connections 2024-01-30T08:09:28.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 --2- 172.21.15.50:0/2764056904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e00a6480 0x7f96e0072870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 -- 172.21.15.50:0/2764056904 >> 172.21.15.50:0/2764056904 conn(0x7f96e00c6c60 msgr2=0x7f96e00c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:28.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 -- 172.21.15.50:0/2764056904 shutdown_connections 2024-01-30T08:09:28.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 -- 172.21.15.50:0/2764056904 wait complete. 2024-01-30T08:09:28.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.595+0000 7f96e7600640 1 Processor -- start 2024-01-30T08:09:28.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 -- start start 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e006f060 0x7f96e0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e0071b80 0x7f96e014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e00a6480 0x7f96e014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0158d30 con 0x7f96e006f060 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01588a0 con 0x7f96e00a6480 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e014b1b0 con 0x7f96e0071b80 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e006f060 0x7f96e0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e006f060 0x7f96e0150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35770/0 (socket says 172.21.15.50:35770) 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 -- 172.21.15.50:0/2578413797 learned_addr learned my addr 172.21.15.50:0/2578413797 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96dfe00640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e0071b80 0x7f96e014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e5600640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e00a6480 0x7f96e014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 -- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e0071b80 msgr2=0x7f96e014f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e0071b80 0x7f96e014f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 -- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e00a6480 msgr2=0x7f96e014fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e00a6480 0x7f96e014fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 -- 172.21.15.50:0/2578413797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00094d0 con 0x7f96e006f060 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e4c00640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e006f060 0x7f96e0150f40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f96d00ac040 tx=0x7f96d001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96dcc00640 1 -- 172.21.15.50:0/2578413797 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00b3800 con 0x7f96e006f060 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96dcc00640 1 -- 172.21.15.50:0/2578413797 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00b3980 con 0x7f96e006f060 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 -- 172.21.15.50:0/2578413797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e0157f70 con 0x7f96e006f060 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96dcc00640 1 -- 172.21.15.50:0/2578413797 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00b3d30 con 0x7f96e006f060 2024-01-30T08:09:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96e7600640 1 -- 172.21.15.50:0/2578413797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0158530 con 0x7f96e006f060 2024-01-30T08:09:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.599+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0074a20 con 0x7f96e006f060 2024-01-30T08:09:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.603+0000 7f96dcc00640 1 -- 172.21.15.50:0/2578413797 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f96d00c6390 con 0x7f96e006f060 2024-01-30T08:09:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.603+0000 7f96dcc00640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96b8066500 0x7f96b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.603+0000 7f96dcc00640 1 -- 172.21.15.50:0/2578413797 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96d011eda0 con 0x7f96e006f060 2024-01-30T08:09:28.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.603+0000 7f96dfe00640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96b8066500 0x7f96b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.603+0000 7f96dfe00640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96b8066500 0x7f96b80689c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96e01f1a40 tx=0x7f96c8007240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.607+0000 7f96dcc00640 1 -- 172.21.15.50:0/2578413797 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f96d00ebdf0 con 0x7f96e006f060 2024-01-30T08:09:28.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96e00710c0 con 0x7f96e006f060 2024-01-30T08:09:28.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96dcc00640 1 -- 172.21.15.50:0/2578413797 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96d00ef410 con 0x7f96e006f060 2024-01-30T08:09:28.766 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96b8066500 msgr2=0x7f96b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96b8066500 0x7f96b80689c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96e01f1a40 tx=0x7f96c8007240 comp rx=0 tx=0).stop 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e006f060 msgr2=0x7f96e0150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e006f060 0x7f96e0150f40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f96d00ac040 tx=0x7f96d001ad50 comp rx=0 tx=0).stop 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 shutdown_connections 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e00a6480 0x7f96e014fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96b8066500 0x7f96b80689c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e0071b80 0x7f96e014f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 --2- 172.21.15.50:0/2578413797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e006f060 0x7f96e0150f40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 >> 172.21.15.50:0/2578413797 conn(0x7f96e00c6c60 msgr2=0x7f96e00c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 shutdown_connections 2024-01-30T08:09:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.766+0000 7f96d6000640 1 -- 172.21.15.50:0/2578413797 wait complete. 2024-01-30T08:09:28.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:28.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.930+0000 7f5565c00640 1 Processor -- start 2024-01-30T08:09:28.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.930+0000 7f5565c00640 1 -- start start 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f5565c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f556014fbf0 0x7f5560153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f5565c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55600a4da0 0x7f55600c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f5565c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55600c54e0 con 0x7f55600c16c0 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f5565c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5560152bf0 con 0x7f556014fbf0 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f5565c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5560072d90 con 0x7f55600a4da0 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f556014fbf0 0x7f5560153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f556014fbf0 0x7f5560153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35772/0 (socket says 172.21.15.50:35772) 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555ea00640 1 -- 172.21.15.50:0/3048770184 learned_addr learned my addr 172.21.15.50:0/3048770184 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555e000640 1 --2- 172.21.15.50:0/3048770184 >> v2:172.21.15.125:3300/0 conn(0x7f55600a4da0 0x7f55600c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555ea00640 1 -- 172.21.15.50:0/3048770184 >> v2:172.21.15.125:3300/0 conn(0x7f55600a4da0 msgr2=0x7f55600c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555ea00640 1 --2- 172.21.15.50:0/3048770184 >> v2:172.21.15.125:3300/0 conn(0x7f55600a4da0 0x7f55600c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555ea00640 1 -- 172.21.15.50:0/3048770184 >> v1:172.21.15.125:6789/0 conn(0x7f55600c16c0 legacy=0x7f556006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.934+0000 7f555ea00640 1 -- 172.21.15.50:0/3048770184 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55601525e0 con 0x7f556014fbf0 2024-01-30T08:09:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f555ea00640 1 --2- 172.21.15.50:0/3048770184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556014fbf0 0x7f5560153080 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f55600a8830 tx=0x7f555001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19219b30762108f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f555d600640 1 -- 172.21.15.50:0/3048770184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55500ad660 con 0x7f556014fbf0 2024-01-30T08:09:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f555d600640 1 -- 172.21.15.50:0/3048770184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55500ad7c0 con 0x7f556014fbf0 2024-01-30T08:09:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f555d600640 1 -- 172.21.15.50:0/3048770184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55500adb50 con 0x7f556014fbf0 2024-01-30T08:09:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 -- 172.21.15.50:0/3048770184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556014fbf0 msgr2=0x7f5560153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 --2- 172.21.15.50:0/3048770184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556014fbf0 0x7f5560153080 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f55600a8830 tx=0x7f555001c470 comp rx=0 tx=0).stop 2024-01-30T08:09:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 -- 172.21.15.50:0/3048770184 shutdown_connections 2024-01-30T08:09:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 --2- 172.21.15.50:0/3048770184 >> v2:172.21.15.125:3300/0 conn(0x7f55600a4da0 0x7f55600c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 --2- 172.21.15.50:0/3048770184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556014fbf0 0x7f5560153080 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 -- 172.21.15.50:0/3048770184 >> 172.21.15.50:0/3048770184 conn(0x7f55600c5b30 msgr2=0x7f55600c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 -- 172.21.15.50:0/3048770184 shutdown_connections 2024-01-30T08:09:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 -- 172.21.15.50:0/3048770184 wait complete. 2024-01-30T08:09:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 Processor -- start 2024-01-30T08:09:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.938+0000 7f5565c00640 1 -- start start 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55600a4da0 0x7f556014d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f556014fbf0 0x7f5560149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556015b9c0 0x7f556014a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600a8a50 con 0x7f556015b9c0 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600a8d30 con 0x7f556014fbf0 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600ab640 con 0x7f55600a4da0 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556015b9c0 0x7f556014a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55600a4da0 0x7f556014d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555e000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f556014fbf0 0x7f5560149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55600a4da0 0x7f556014d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:53010/0 (socket says 172.21.15.50:53010) 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 -- 172.21.15.50:0/3439101069 learned_addr learned my addr 172.21.15.50:0/3439101069 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556015b9c0 0x7f556014a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35784/0 (socket says 172.21.15.50:35784) 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 -- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f556014fbf0 msgr2=0x7f5560149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f556014fbf0 0x7f5560149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 -- 172.21.15.50:0/3439101069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556015b9c0 msgr2=0x7f556014a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556015b9c0 0x7f556014a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 -- 172.21.15.50:0/3439101069 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500094d0 con 0x7f55600a4da0 2024-01-30T08:09:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555e000640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f556014fbf0 0x7f5560149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f555ea00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55600a4da0 0x7f556014d010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55500b0040 tx=0x7f5550019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5556a00640 1 -- 172.21.15.50:0/3439101069 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55500b6640 con 0x7f55600a4da0 2024-01-30T08:09:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5556a00640 1 -- 172.21.15.50:0/3439101069 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55500b67c0 con 0x7f55600a4da0 2024-01-30T08:09:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5556a00640 1 -- 172.21.15.50:0/3439101069 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55500b6b70 con 0x7f55600a4da0 2024-01-30T08:09:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600ab920 con 0x7f55600a4da0 2024-01-30T08:09:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55600a9fc0 con 0x7f55600a4da0 2024-01-30T08:09:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.942+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5560067cc0 con 0x7f55600a4da0 2024-01-30T08:09:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.946+0000 7f5556a00640 1 -- 172.21.15.50:0/3439101069 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f55500b4070 con 0x7f55600a4da0 2024-01-30T08:09:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.946+0000 7f5556a00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5538066500 0x7f55380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.946+0000 7f5556a00640 1 -- 172.21.15.50:0/3439101069 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f555011e370 con 0x7f55600a4da0 2024-01-30T08:09:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.946+0000 7f555e000640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5538066500 0x7f55380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.946+0000 7f555e000640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5538066500 0x7f55380689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55600bfca0 tx=0x7f5548009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:28.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:28.950+0000 7f5556a00640 1 -- 172.21.15.50:0/3439101069 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f55500eb3c0 con 0x7f55600a4da0 2024-01-30T08:09:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.110+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55600ab780 con 0x7f55600a4da0 2024-01-30T08:09:29.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.110+0000 7f5556a00640 1 -- 172.21.15.50:0/3439101069 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55600ab780 con 0x7f55600a4da0 2024-01-30T08:09:29.112 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:29.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5538066500 msgr2=0x7f55380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5538066500 0x7f55380689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55600bfca0 tx=0x7f5548009190 comp rx=0 tx=0).stop 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55600a4da0 msgr2=0x7f556014d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55600a4da0 0x7f556014d010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55500b0040 tx=0x7f5550019210 comp rx=0 tx=0).stop 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 shutdown_connections 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f556014fbf0 0x7f5560149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5538066500 0x7f55380689c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556015b9c0 0x7f556014a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 --2- 172.21.15.50:0/3439101069 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f55600a4da0 0x7f556014d010 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 >> 172.21.15.50:0/3439101069 conn(0x7f55600c5b30 msgr2=0x7f556015bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 shutdown_connections 2024-01-30T08:09:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.114+0000 7f5565c00640 1 -- 172.21.15.50:0/3439101069 wait complete. 2024-01-30T08:09:29.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.278+0000 7fc4d4c00640 1 Processor -- start 2024-01-30T08:09:29.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.278+0000 7fc4d4c00640 1 -- start start 2024-01-30T08:09:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4d4c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc4d006f550 0x7fc4d006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4d4c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4d014e0c0 0x7fc4d014e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4d4c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00a9470 con 0x7fc4d00ac590 2024-01-30T08:09:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4d4c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d00c2780 con 0x7fc4d014e0c0 2024-01-30T08:09:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4d4c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d00a8b80 con 0x7fc4d006f550 2024-01-30T08:09:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cf200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4d014e0c0 0x7fc4d014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cf200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4d014e0c0 0x7fc4d014e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55052/0 (socket says 172.21.15.50:55052) 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cf200640 1 -- 172.21.15.50:0/3055971961 learned_addr learned my addr 172.21.15.50:0/3055971961 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cd400640 1 --2- 172.21.15.50:0/3055971961 >> v2:172.21.15.125:3300/0 conn(0x7fc4d006f550 0x7fc4d006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cf200640 1 -- 172.21.15.50:0/3055971961 >> v2:172.21.15.125:3300/0 conn(0x7fc4d006f550 msgr2=0x7fc4d006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cf200640 1 --2- 172.21.15.50:0/3055971961 >> v2:172.21.15.125:3300/0 conn(0x7fc4d006f550 0x7fc4d006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cf200640 1 -- 172.21.15.50:0/3055971961 >> v1:172.21.15.50:6789/0 conn(0x7fc4d00ac590 legacy=0x7fc4d00c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cca00640 1 -- 172.21.15.50:0/3055971961 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576499254 0 0) 0x7fc4d00a9470 con 0x7fc4d00ac590 2024-01-30T08:09:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.282+0000 7fc4cf200640 1 -- 172.21.15.50:0/3055971961 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00a9900 con 0x7fc4d014e0c0 2024-01-30T08:09:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4cf200640 1 --2- 172.21.15.50:0/3055971961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d014e550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00c1c90 tx=0x7fc4c801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212f8f5cee1c6b93 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4cca00640 1 -- 172.21.15.50:0/3055971961 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80a5770 con 0x7fc4d014e0c0 2024-01-30T08:09:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4cca00640 1 -- 172.21.15.50:0/3055971961 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80a58d0 con 0x7fc4d014e0c0 2024-01-30T08:09:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4cca00640 1 -- 172.21.15.50:0/3055971961 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80a5c60 con 0x7fc4d014e0c0 2024-01-30T08:09:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3055971961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 msgr2=0x7fc4d014e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3055971961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d014e550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00c1c90 tx=0x7fc4c801c8b0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3055971961 shutdown_connections 2024-01-30T08:09:29.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3055971961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d014e550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3055971961 >> v2:172.21.15.125:3300/0 conn(0x7fc4d006f550 0x7fc4d006ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3055971961 >> 172.21.15.50:0/3055971961 conn(0x7fc4d006e380 msgr2=0x7fc4d00c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:29.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3055971961 shutdown_connections 2024-01-30T08:09:29.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3055971961 wait complete. 2024-01-30T08:09:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 Processor -- start 2024-01-30T08:09:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.286+0000 7fc4d4c00640 1 -- start start 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4d006f550 0x7fc4d01ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4d00ac590 0x7fc4d0144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d01f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d006c7b0 con 0x7fc4d014e0c0 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f0100 con 0x7fc4d006f550 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01ecbc0 con 0x7fc4d00ac590 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d01f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cd400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4d00ac590 0x7fc4d0144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d01f0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55060/0 (socket says 172.21.15.50:55060) 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 -- 172.21.15.50:0/3600815942 learned_addr learned my addr 172.21.15.50:0/3600815942 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cd400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4d00ac590 0x7fc4d0144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:49798/0 (socket says 172.21.15.50:49798) 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cde00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4d006f550 0x7fc4d01ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 -- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4d00ac590 msgr2=0x7fc4d0144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4d00ac590 0x7fc4d0144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 -- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4d006f550 msgr2=0x7fc4d01ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4d006f550 0x7fc4d01ec680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 -- 172.21.15.50:0/3600815942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8009b30 con 0x7fc4d014e0c0 2024-01-30T08:09:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4cf200640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d01f0520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80194c0 tx=0x7fc4c8019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4c6000640 1 -- 172.21.15.50:0/3600815942 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80b8670 con 0x7fc4d014e0c0 2024-01-30T08:09:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4c6000640 1 -- 172.21.15.50:0/3600815942 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80b87d0 con 0x7fc4d014e0c0 2024-01-30T08:09:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d006c1f0 con 0x7fc4d014e0c0 2024-01-30T08:09:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4c6000640 1 -- 172.21.15.50:0/3600815942 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80b8b60 con 0x7fc4d014e0c0 2024-01-30T08:09:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d01efd20 con 0x7fc4d014e0c0 2024-01-30T08:09:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.290+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d01f0240 con 0x7fc4d014e0c0 2024-01-30T08:09:29.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.294+0000 7fc4c6000640 1 -- 172.21.15.50:0/3600815942 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc4c80b8cc0 con 0x7fc4d014e0c0 2024-01-30T08:09:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.294+0000 7fc4c6000640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc4a8066500 0x7fc4a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.294+0000 7fc4c6000640 1 -- 172.21.15.50:0/3600815942 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4c811f500 con 0x7fc4d014e0c0 2024-01-30T08:09:29.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.294+0000 7fc4cde00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc4a8066500 0x7fc4a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.294+0000 7fc4cde00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc4a8066500 0x7fc4a80689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0000f70 tx=0x7fc4c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.298+0000 7fc4c6000640 1 -- 172.21.15.50:0/3600815942 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc4d01f0240 con 0x7fc4d014e0c0 2024-01-30T08:09:29.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.454+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4d01f0240 con 0x7fc4d014e0c0 2024-01-30T08:09:29.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4c6000640 1 -- 172.21.15.50:0/3600815942 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4c80bc020 con 0x7fc4d014e0c0 2024-01-30T08:09:29.457 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc4a8066500 msgr2=0x7fc4a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc4a8066500 0x7fc4a80689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0000f70 tx=0x7fc4c0009040 comp rx=0 tx=0).stop 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 msgr2=0x7fc4d01f0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d01f0520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80194c0 tx=0x7fc4c8019650 comp rx=0 tx=0).stop 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 shutdown_connections 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc4a8066500 0x7fc4a80689c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d014e0c0 0x7fc4d01f0520 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4d00ac590 0x7fc4d0144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 --2- 172.21.15.50:0/3600815942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4d006f550 0x7fc4d01ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 >> 172.21.15.50:0/3600815942 conn(0x7fc4d006e380 msgr2=0x7fc4d00c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:29.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 shutdown_connections 2024-01-30T08:09:29.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.458+0000 7fc4d4c00640 1 -- 172.21.15.50:0/3600815942 wait complete. 2024-01-30T08:09:29.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:29.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f23a4c00640 1 Processor -- start 2024-01-30T08:09:29.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f23a4c00640 1 -- start start 2024-01-30T08:09:29.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f23a4c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23a0155500 0x7f23a00c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a006f240 0x7f23a006f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f23a4c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a0158b70 con 0x7f23a00c1200 2024-01-30T08:09:29.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f23a4c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a0157f60 con 0x7f23a0155500 2024-01-30T08:09:29.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f23a4c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0158240 con 0x7f23a006f240 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f239de00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23a0155500 0x7f23a00c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f239d400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a006f240 0x7f23a006f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f239e800640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f23a00c1200 0x7f23a00c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:33100/0 (socket says 172.21.15.50:33100) 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.622+0000 7f239e800640 1 -- 172.21.15.50:0/1786652105 learned_addr learned my addr 172.21.15.50:0/1786652105 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239de00640 1 -- 172.21.15.50:0/1786652105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a006f240 msgr2=0x7f23a006f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239de00640 1 --2- 172.21.15.50:0/1786652105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a006f240 0x7f23a006f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239de00640 1 -- 172.21.15.50:0/1786652105 >> v1:172.21.15.125:6789/0 conn(0x7f23a00c1200 legacy=0x7f23a00c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239de00640 1 -- 172.21.15.50:0/1786652105 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0158520 con 0x7f23a0155500 2024-01-30T08:09:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239de00640 1 --2- 172.21.15.50:0/1786652105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a0155500 0x7f23a00c85e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f23900097c0 tx=0x7f239001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13b53c38f034e958 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239ca00640 1 -- 172.21.15.50:0/1786652105 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390004230 con 0x7f23a0155500 2024-01-30T08:09:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239ca00640 1 -- 172.21.15.50:0/1786652105 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23900a7050 con 0x7f23a0155500 2024-01-30T08:09:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.626+0000 7f239ca00640 1 -- 172.21.15.50:0/1786652105 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390003620 con 0x7f23a0155500 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- 172.21.15.50:0/1786652105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a0155500 msgr2=0x7f23a00c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 --2- 172.21.15.50:0/1786652105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a0155500 0x7f23a00c85e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f23900097c0 tx=0x7f239001c330 comp rx=0 tx=0).stop 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- 172.21.15.50:0/1786652105 shutdown_connections 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 --2- 172.21.15.50:0/1786652105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a006f240 0x7f23a006f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 --2- 172.21.15.50:0/1786652105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a0155500 0x7f23a00c85e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- 172.21.15.50:0/1786652105 >> 172.21.15.50:0/1786652105 conn(0x7f23a00727c0 msgr2=0x7f23a006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- 172.21.15.50:0/1786652105 shutdown_connections 2024-01-30T08:09:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- 172.21.15.50:0/1786652105 wait complete. 2024-01-30T08:09:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 Processor -- start 2024-01-30T08:09:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- start start 2024-01-30T08:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23a006f240 0x7f23a01544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a00c1200 0x7f23a01483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a0155500 0x7f23a0148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a01ecfb0 con 0x7f23a006f240 2024-01-30T08:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a014c860 con 0x7f23a00c1200 2024-01-30T08:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f23a4c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a014e7f0 con 0x7f23a0155500 2024-01-30T08:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f239de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23a006f240 0x7f23a01544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f239de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23a006f240 0x7f23a01544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55072/0 (socket says 172.21.15.50:55072) 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f239de00640 1 -- 172.21.15.50:0/391149910 learned_addr learned my addr 172.21.15.50:0/391149910 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f239d400640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a00c1200 0x7f23a01483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.630+0000 7f239e800640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a0155500 0x7f23a0148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f239de00640 1 -- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a0155500 msgr2=0x7f23a0148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f239de00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a0155500 0x7f23a0148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f239de00640 1 -- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a00c1200 msgr2=0x7f23a01483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f239de00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a00c1200 0x7f23a01483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f239de00640 1 -- 172.21.15.50:0/391149910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390009420 con 0x7f23a006f240 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f239de00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23a006f240 0x7f23a01544f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f23900097c0 tx=0x7f23900190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f2396000640 1 -- 172.21.15.50:0/391149910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390003af0 con 0x7f23a006f240 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f2396000640 1 -- 172.21.15.50:0/391149910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390003c50 con 0x7f23a006f240 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f2396000640 1 -- 172.21.15.50:0/391149910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900ab440 con 0x7f23a006f240 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a014e2c0 con 0x7f23a006f240 2024-01-30T08:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00aab50 con 0x7f23a006f240 2024-01-30T08:09:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a0074a20 con 0x7f23a006f240 2024-01-30T08:09:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f2396000640 1 -- 172.21.15.50:0/391149910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f23900b2040 con 0x7f23a006f240 2024-01-30T08:09:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f2396000640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2378066500 0x7f23780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.634+0000 7f2396000640 1 -- 172.21.15.50:0/391149910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f239011de70 con 0x7f23a006f240 2024-01-30T08:09:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.638+0000 7f239d400640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2378066500 0x7f23780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.638+0000 7f239d400640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2378066500 0x7f23780689c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23a00c4380 tx=0x7f2388009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.638+0000 7f2396000640 1 -- 172.21.15.50:0/391149910 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f23900eaec0 con 0x7f23a006f240 2024-01-30T08:09:29.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f23a00c83c0 con 0x7f23a006f240 2024-01-30T08:09:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f2396000640 1 -- 172.21.15.50:0/391149910 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f23900b0020 con 0x7f23a006f240 2024-01-30T08:09:29.802 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2378066500 msgr2=0x7f23780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2378066500 0x7f23780689c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23a00c4380 tx=0x7f2388009190 comp rx=0 tx=0).stop 2024-01-30T08:09:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23a006f240 msgr2=0x7f23a01544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23a006f240 0x7f23a01544f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f23900097c0 tx=0x7f23900190d0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 shutdown_connections 2024-01-30T08:09:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a00c1200 0x7f23a01483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2378066500 0x7f23780689c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23a0155500 0x7f23a0148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 --2- 172.21.15.50:0/391149910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23a006f240 0x7f23a01544f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 >> 172.21.15.50:0/391149910 conn(0x7f23a00727c0 msgr2=0x7f23a006d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 shutdown_connections 2024-01-30T08:09:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.802+0000 7f23a4c00640 1 -- 172.21.15.50:0/391149910 wait complete. 2024-01-30T08:09:29.833 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-30T08:09:29.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:29.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eba800640 1 Processor -- start 2024-01-30T08:09:29.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eba800640 1 -- start start 2024-01-30T08:09:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eba800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406de40 0x7f8eb40a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eba800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8eb41584a0 0x7f8eb415f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eba800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb40c7b40 con 0x7f8eb406e220 2024-01-30T08:09:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eba800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb40a7770 con 0x7f8eb41584a0 2024-01-30T08:09:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eba800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4155310 con 0x7f8eb406de40 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb3e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8eb41584a0 0x7f8eb415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb3400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406de40 0x7f8eb40a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb2a00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8eb406e220 0x7f8eb4157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:33114/0 (socket says 172.21.15.50:33114) 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb2a00640 1 -- 172.21.15.50:0/1747008004 learned_addr learned my addr 172.21.15.50:0/1747008004 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb3e00640 1 -- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406de40 msgr2=0x7f8eb40a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb3e00640 1 --2- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406de40 0x7f8eb40a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb3e00640 1 -- 172.21.15.50:0/1747008004 >> v1:172.21.15.125:6789/0 conn(0x7f8eb406e220 legacy=0x7f8eb4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb3e00640 1 -- 172.21.15.50:0/1747008004 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4155730 con 0x7f8eb41584a0 2024-01-30T08:09:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.982+0000 7f8eb3400640 1 --2- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406de40 0x7f8eb40a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eb3e00640 1 --2- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb415f120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009d90 tx=0x7f8eac01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6c9ccf95a63126 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eb2000640 1 -- 172.21.15.50:0/1747008004 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0a5810 con 0x7f8eb41584a0 2024-01-30T08:09:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eb2000640 1 -- 172.21.15.50:0/1747008004 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac0a5970 con 0x7f8eb41584a0 2024-01-30T08:09:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eb2000640 1 -- 172.21.15.50:0/1747008004 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0a5d00 con 0x7f8eb41584a0 2024-01-30T08:09:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 -- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 msgr2=0x7f8eb415f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 --2- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb415f120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009d90 tx=0x7f8eac01c950 comp rx=0 tx=0).stop 2024-01-30T08:09:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 -- 172.21.15.50:0/1747008004 shutdown_connections 2024-01-30T08:09:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 --2- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb415f120 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 --2- 172.21.15.50:0/1747008004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406de40 0x7f8eb40a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 -- 172.21.15.50:0/1747008004 >> 172.21.15.50:0/1747008004 conn(0x7f8eb40c4830 msgr2=0x7f8eb40c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 -- 172.21.15.50:0/1747008004 shutdown_connections 2024-01-30T08:09:29.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.986+0000 7f8eba800640 1 -- 172.21.15.50:0/1747008004 wait complete. 2024-01-30T08:09:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 Processor -- start 2024-01-30T08:09:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 -- start start 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb406de40 0x7f8eb41511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406e220 0x7f8eb41f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb41f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40a91f0 con 0x7f8eb406de40 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40a9500 con 0x7f8eb41584a0 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40a97e0 con 0x7f8eb406e220 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb406de40 0x7f8eb41511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb406de40 0x7f8eb41511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55088/0 (socket says 172.21.15.50:55088) 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 -- 172.21.15.50:0/919259052 learned_addr learned my addr 172.21.15.50:0/919259052 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb2a00640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406e220 0x7f8eb41f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3e00640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb41f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 -- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406e220 msgr2=0x7f8eb41f00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406e220 0x7f8eb41f00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 -- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 msgr2=0x7f8eb41f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb41f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 -- 172.21.15.50:0/919259052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009420 con 0x7f8eb406de40 2024-01-30T08:09:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3e00640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb41f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eb3400640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb406de40 0x7f8eb41511d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400ebe0 tx=0x7f8ea400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eab400640 1 -- 172.21.15.50:0/919259052 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400eee0 con 0x7f8eb406de40 2024-01-30T08:09:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eab400640 1 -- 172.21.15.50:0/919259052 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea400cc30 con 0x7f8eb406de40 2024-01-30T08:09:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eab400640 1 -- 172.21.15.50:0/919259052 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4013470 con 0x7f8eb406de40 2024-01-30T08:09:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.990+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac009a70 con 0x7f8eb406de40 2024-01-30T08:09:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.994+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb40a9da0 con 0x7f8eb406de40 2024-01-30T08:09:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.994+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4074a20 con 0x7f8eb406de40 2024-01-30T08:09:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.994+0000 7f8eab400640 1 -- 172.21.15.50:0/919259052 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8ea40135d0 con 0x7f8eb406de40 2024-01-30T08:09:29.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.994+0000 7f8eab400640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8e8c066500 0x7f8e8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:29.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.994+0000 7f8eab400640 1 -- 172.21.15.50:0/919259052 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ea40845b0 con 0x7f8eb406de40 2024-01-30T08:09:29.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.994+0000 7f8eb2a00640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8e8c066500 0x7f8e8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:29.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.994+0000 7f8eb2a00640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8e8c066500 0x7f8e8c0689c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40a73d0 tx=0x7f8e9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:29.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:29.998+0000 7f8eab400640 1 -- 172.21.15.50:0/919259052 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8ea4051480 con 0x7f8eb406de40 2024-01-30T08:09:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eb406ee10 con 0x7f8eb406de40 2024-01-30T08:09:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eab400640 1 -- 172.21.15.50:0/919259052 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18735 (secure 0 0 0) 0x7f8ea4054aa0 con 0x7f8eb406de40 2024-01-30T08:09:30.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:30.162 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:29.856342+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8e8c066500 msgr2=0x7f8e8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8e8c066500 0x7f8e8c0689c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40a73d0 tx=0x7f8e9c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb406de40 msgr2=0x7f8eb41511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb406de40 0x7f8eb41511d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400ebe0 tx=0x7f8ea400c520 comp rx=0 tx=0).stop 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 shutdown_connections 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8eb41584a0 0x7f8eb41f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8e8c066500 0x7f8e8c0689c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8eb406e220 0x7f8eb41f00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 --2- 172.21.15.50:0/919259052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb406de40 0x7f8eb41511d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.162+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 >> 172.21.15.50:0/919259052 conn(0x7f8eb40c4830 msgr2=0x7f8eb40c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.166+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 shutdown_connections 2024-01-30T08:09:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.166+0000 7f8eba800640 1 -- 172.21.15.50:0/919259052 wait complete. 2024-01-30T08:09:30.185 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:30.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:30.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.330+0000 7fb88ca00640 1 Processor -- start 2024-01-30T08:09:30.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.330+0000 7fb88ca00640 1 -- start start 2024-01-30T08:09:30.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88ca00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb884071e10 0x7fb8840727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88ca00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb884154290 0x7fb8841546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88ca00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8840c22b0 con 0x7fb88406c960 2024-01-30T08:09:30.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88ca00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8840c5890 con 0x7fb884154290 2024-01-30T08:09:30.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88ca00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8840c52d0 con 0x7fb884071e10 2024-01-30T08:09:30.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb884154290 0x7fb8841546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb884154290 0x7fb8841546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55090/0 (socket says 172.21.15.50:55090) 2024-01-30T08:09:30.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88aa00640 1 -- 172.21.15.50:0/2898961995 learned_addr learned my addr 172.21.15.50:0/2898961995 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:30.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88a000640 1 --2- 172.21.15.50:0/2898961995 >> v2:172.21.15.125:3300/0 conn(0x7fb884071e10 0x7fb8840727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88aa00640 1 -- 172.21.15.50:0/2898961995 >> v2:172.21.15.125:3300/0 conn(0x7fb884071e10 msgr2=0x7fb8840727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:30.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88aa00640 1 --2- 172.21.15.50:0/2898961995 >> v2:172.21.15.125:3300/0 conn(0x7fb884071e10 0x7fb8840727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88aa00640 1 -- 172.21.15.50:0/2898961995 >> v1:172.21.15.50:6789/0 conn(0x7fb88406c960 legacy=0x7fb8840c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb88aa00640 1 -- 172.21.15.50:0/2898961995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840c55b0 con 0x7fb884154290 2024-01-30T08:09:30.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.334+0000 7fb888c00640 1 -- 172.21.15.50:0/2898961995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577408719 0 0) 0x7fb8840c22b0 con 0x7fb88406c960 2024-01-30T08:09:30.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88aa00640 1 --2- 172.21.15.50:0/2898961995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884154290 0x7fb8841546e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb884073fd0 tx=0x7fb87c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d70bdc7d3b4e5b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:30.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb888c00640 1 -- 172.21.15.50:0/2898961995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c0a8450 con 0x7fb884154290 2024-01-30T08:09:30.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb888c00640 1 -- 172.21.15.50:0/2898961995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c0a85b0 con 0x7fb884154290 2024-01-30T08:09:30.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb888c00640 1 -- 172.21.15.50:0/2898961995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c0a8940 con 0x7fb884154290 2024-01-30T08:09:30.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 -- 172.21.15.50:0/2898961995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884154290 msgr2=0x7fb8841546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2898961995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884154290 0x7fb8841546e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb884073fd0 tx=0x7fb87c01c8b0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 -- 172.21.15.50:0/2898961995 shutdown_connections 2024-01-30T08:09:30.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2898961995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884154290 0x7fb8841546e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2898961995 >> v2:172.21.15.125:3300/0 conn(0x7fb884071e10 0x7fb8840727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 -- 172.21.15.50:0/2898961995 >> 172.21.15.50:0/2898961995 conn(0x7fb8840c5b30 msgr2=0x7fb8840c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:30.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 -- 172.21.15.50:0/2898961995 shutdown_connections 2024-01-30T08:09:30.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 -- 172.21.15.50:0/2898961995 wait complete. 2024-01-30T08:09:30.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 Processor -- start 2024-01-30T08:09:30.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.338+0000 7fb88ca00640 1 -- start start 2024-01-30T08:09:30.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb88406c960 0x7fb8841f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884071e10 0x7fb8840c0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb884154290 0x7fb88415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8841f11b0 con 0x7fb884071e10 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88414fb10 con 0x7fb88406c960 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8841f0b60 con 0x7fb884154290 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884071e10 0x7fb8840c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884071e10 0x7fb8840c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55092/0 (socket says 172.21.15.50:55092) 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 -- 172.21.15.50:0/2139570908 learned_addr learned my addr 172.21.15.50:0/2139570908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88a000640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb88406c960 0x7fb8841f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88aa00640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb884154290 0x7fb88415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 -- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb884154290 msgr2=0x7fb88415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb884154290 0x7fb88415eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 -- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb88406c960 msgr2=0x7fb8841f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb88406c960 0x7fb8841f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 -- 172.21.15.50:0/2139570908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c009b30 con 0x7fb884071e10 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88a000640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb88406c960 0x7fb8841f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb889600640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884071e10 0x7fb8840c0610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb86c001ec0 tx=0x7fb86c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb882000640 1 -- 172.21.15.50:0/2139570908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0054e0 con 0x7fb884071e10 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb882000640 1 -- 172.21.15.50:0/2139570908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c003600 con 0x7fb884071e10 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb882000640 1 -- 172.21.15.50:0/2139570908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0039b0 con 0x7fb884071e10 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8841f0e40 con 0x7fb884071e10 2024-01-30T08:09:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88414fdf0 con 0x7fb884071e10 2024-01-30T08:09:30.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8841f1320 con 0x7fb884071e10 2024-01-30T08:09:30.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.342+0000 7fb882000640 1 -- 172.21.15.50:0/2139570908 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb86c003b10 con 0x7fb884071e10 2024-01-30T08:09:30.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.346+0000 7fb882000640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb85c066500 0x7fb85c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.346+0000 7fb882000640 1 -- 172.21.15.50:0/2139570908 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb86c0838f0 con 0x7fb884071e10 2024-01-30T08:09:30.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.346+0000 7fb88a000640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb85c066500 0x7fb85c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.346+0000 7fb88a000640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb85c066500 0x7fb85c0689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb8740097a0 tx=0x7fb874008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:30.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.350+0000 7fb882000640 1 -- 172.21.15.50:0/2139570908 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb86c050740 con 0x7fb884071e10 2024-01-30T08:09:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.510+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb884074a20 con 0x7fb884071e10 2024-01-30T08:09:30.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.510+0000 7fb882000640 1 -- 172.21.15.50:0/2139570908 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb86c017020 con 0x7fb884071e10 2024-01-30T08:09:30.511 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:30.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.510+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb85c066500 msgr2=0x7fb85c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.510+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb85c066500 0x7fb85c0689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb8740097a0 tx=0x7fb874008040 comp rx=0 tx=0).stop 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.510+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884071e10 msgr2=0x7fb8840c0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.510+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884071e10 0x7fb8840c0610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb86c001ec0 tx=0x7fb86c00c8e0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 shutdown_connections 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb85c066500 0x7fb85c0689c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb884154290 0x7fb88415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb884071e10 0x7fb8840c0610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 --2- 172.21.15.50:0/2139570908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb88406c960 0x7fb8841f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 >> 172.21.15.50:0/2139570908 conn(0x7fb8840c5b30 msgr2=0x7fb8841516d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 shutdown_connections 2024-01-30T08:09:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.514+0000 7fb88ca00640 1 -- 172.21.15.50:0/2139570908 wait complete. 2024-01-30T08:09:30.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:30.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.674+0000 7f4948800640 1 Processor -- start 2024-01-30T08:09:30.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.674+0000 7f4948800640 1 -- start start 2024-01-30T08:09:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4948800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4940155500 0x7f49400c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4948800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f6d0 0x7f49400c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4948800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4940158b70 con 0x7f494006f240 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4948800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4940157f60 con 0x7f4940155500 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4948800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4940158240 con 0x7f494006f6d0 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4945e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4940155500 0x7f49400c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4945e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4940155500 0x7f49400c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55094/0 (socket says 172.21.15.50:55094) 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4945e00640 1 -- 172.21.15.50:0/444111485 learned_addr learned my addr 172.21.15.50:0/444111485 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4946800640 1 --2- 172.21.15.50:0/444111485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f6d0 0x7f49400c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4945e00640 1 -- 172.21.15.50:0/444111485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f6d0 msgr2=0x7f49400c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4945e00640 1 --2- 172.21.15.50:0/444111485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f6d0 0x7f49400c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4945e00640 1 -- 172.21.15.50:0/444111485 >> v1:172.21.15.125:6789/0 conn(0x7f494006f240 legacy=0x7f49400c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4945e00640 1 -- 172.21.15.50:0/444111485 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940158520 con 0x7f4940155500 2024-01-30T08:09:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.678+0000 7f4946800640 1 --2- 172.21.15.50:0/444111485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f6d0 0x7f49400c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4945e00640 1 --2- 172.21.15.50:0/444111485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4940155500 0x7f49400c85e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4930009870 tx=0x7f493001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaf5d733385eaa server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4944a00640 1 -- 172.21.15.50:0/444111485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300ab600 con 0x7f4940155500 2024-01-30T08:09:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4944a00640 1 -- 172.21.15.50:0/444111485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49300a7050 con 0x7f4940155500 2024-01-30T08:09:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4944a00640 1 -- 172.21.15.50:0/444111485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300ab980 con 0x7f4940155500 2024-01-30T08:09:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 -- 172.21.15.50:0/444111485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4940155500 msgr2=0x7f49400c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 --2- 172.21.15.50:0/444111485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4940155500 0x7f49400c85e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4930009870 tx=0x7f493001c420 comp rx=0 tx=0).stop 2024-01-30T08:09:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 -- 172.21.15.50:0/444111485 shutdown_connections 2024-01-30T08:09:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 --2- 172.21.15.50:0/444111485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f6d0 0x7f49400c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 --2- 172.21.15.50:0/444111485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4940155500 0x7f49400c85e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 -- 172.21.15.50:0/444111485 >> 172.21.15.50:0/444111485 conn(0x7f49400727c0 msgr2=0x7f494006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:30.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 -- 172.21.15.50:0/444111485 shutdown_connections 2024-01-30T08:09:30.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 -- 172.21.15.50:0/444111485 wait complete. 2024-01-30T08:09:30.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 Processor -- start 2024-01-30T08:09:30.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.682+0000 7f4948800640 1 -- start start 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f240 0x7f49401487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494006f6d0 0x7f494015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4940155500 0x7f4940156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940148d00 con 0x7f494006f6d0 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940155db0 con 0x7f4940155500 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4940156090 con 0x7f494006f240 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494006f6d0 0x7f494015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494006f6d0 0x7f494015e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55100/0 (socket says 172.21.15.50:55100) 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 -- 172.21.15.50:0/4061042929 learned_addr learned my addr 172.21.15.50:0/4061042929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945e00640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f240 0x7f49401487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4946800640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4940155500 0x7f4940156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 -- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f240 msgr2=0x7f49401487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f240 0x7f49401487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 -- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4940155500 msgr2=0x7f4940156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4940155500 0x7f4940156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 -- 172.21.15.50:0/4061042929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49300094d0 con 0x7f494006f6d0 2024-01-30T08:09:30.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4945400640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494006f6d0 0x7f494015e390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f492800c370 tx=0x7f492800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:30.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f493e000640 1 -- 172.21.15.50:0/4061042929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49280052d0 con 0x7f494006f6d0 2024-01-30T08:09:30.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f493e000640 1 -- 172.21.15.50:0/4061042929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928005430 con 0x7f494006f6d0 2024-01-30T08:09:30.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4940156370 con 0x7f494006f6d0 2024-01-30T08:09:30.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f493e000640 1 -- 172.21.15.50:0/4061042929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928007260 con 0x7f494006f6d0 2024-01-30T08:09:30.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4940156930 con 0x7f494006f6d0 2024-01-30T08:09:30.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.686+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4940074a20 con 0x7f494006f6d0 2024-01-30T08:09:30.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.690+0000 7f493e000640 1 -- 172.21.15.50:0/4061042929 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f49280073c0 con 0x7f494006f6d0 2024-01-30T08:09:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.690+0000 7f493e000640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4918066500 0x7f49180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:30.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.690+0000 7f493e000640 1 -- 172.21.15.50:0/4061042929 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4928083610 con 0x7f494006f6d0 2024-01-30T08:09:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.690+0000 7f4945e00640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4918066500 0x7f49180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:30.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.690+0000 7f4945e00640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4918066500 0x7f49180689c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f49300ad000 tx=0x7f4930008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:30.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.694+0000 7f493e000640 1 -- 172.21.15.50:0/4061042929 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4928050500 con 0x7f494006f6d0 2024-01-30T08:09:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49400c83c0 con 0x7f494006f6d0 2024-01-30T08:09:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f493e000640 1 -- 172.21.15.50:0/4061042929 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4928053b20 con 0x7f494006f6d0 2024-01-30T08:09:30.854 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4918066500 msgr2=0x7f49180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4918066500 0x7f49180689c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f49300ad000 tx=0x7f4930008040 comp rx=0 tx=0).stop 2024-01-30T08:09:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494006f6d0 msgr2=0x7f494015e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494006f6d0 0x7f494015e390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f492800c370 tx=0x7f492800c830 comp rx=0 tx=0).stop 2024-01-30T08:09:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 shutdown_connections 2024-01-30T08:09:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4940155500 0x7f4940156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4918066500 0x7f49180689c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494006f6d0 0x7f494015e390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 --2- 172.21.15.50:0/4061042929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f494006f240 0x7f49401487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.854+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 >> 172.21.15.50:0/4061042929 conn(0x7f49400727c0 msgr2=0x7f494006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.858+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 shutdown_connections 2024-01-30T08:09:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:30.858+0000 7f4948800640 1 -- 172.21.15.50:0/4061042929 wait complete. 2024-01-30T08:09:30.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.022+0000 7fbc46800640 1 Processor -- start 2024-01-30T08:09:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.022+0000 7fbc46800640 1 -- start start 2024-01-30T08:09:31.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc46800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbc40155500 0x7fbc400c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc46800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 0x7fbc4006f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc46800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc40158b70 con 0x7fbc400c1200 2024-01-30T08:09:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc46800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc40157f60 con 0x7fbc40155500 2024-01-30T08:09:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc46800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40158240 con 0x7fbc4006f240 2024-01-30T08:09:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3fe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbc400c1200 0x7fbc400c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53856/0 (socket says 172.21.15.50:53856) 2024-01-30T08:09:31.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3fe00640 1 -- 172.21.15.50:0/1928265194 learned_addr learned my addr 172.21.15.50:0/1928265194 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1928265194 >> v2:172.21.15.125:3300/0 conn(0x7fbc40155500 0x7fbc400c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167001703 0 0) 0x7fbc40158b70 con 0x7fbc400c1200 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3ea00640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 0x7fbc4006f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc20003530 con 0x7fbc400c1200 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056609757 0 0) 0x7fbc20003530 con 0x7fbc400c1200 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 msgr2=0x7fbc4006f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 0x7fbc4006f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 >> v2:172.21.15.125:3300/0 conn(0x7fbc40155500 msgr2=0x7fbc400c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 --2- 172.21.15.50:0/1928265194 >> v2:172.21.15.125:3300/0 conn(0x7fbc40155500 0x7fbc400c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40158520 con 0x7fbc400c1200 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fbc38001a00 con 0x7fbc400c1200 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 >> v1:172.21.15.50:6789/0 conn(0x7fbc400c1200 legacy=0x7fbc400c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc20003980 0x7fbc20003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc200047d0 0x7fbc20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 0x7fbc20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40157f60 con 0x7fbc20003980 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40158240 con 0x7fbc200047d0 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2000bac0 con 0x7fbc4006f240 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc20003980 0x7fbc20003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3ea00640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc200047d0 0x7fbc20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3fe00640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 0x7fbc20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3f400640 1 -- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 msgr2=0x7fbc20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc4006f240 0x7fbc20005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3f400640 1 -- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc200047d0 msgr2=0x7fbc20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc200047d0 0x7fbc20004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.026+0000 7fbc3f400640 1 -- 172.21.15.50:0/1928265194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20003530 con 0x7fbc20003980 2024-01-30T08:09:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc20003980 0x7fbc20003da0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009ab0 tx=0x7fbc3001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b80e8340a3e2a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a5610 con 0x7fbc20003980 2024-01-30T08:09:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc300a5770 con 0x7fbc20003980 2024-01-30T08:09:31.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc3e000640 1 -- 172.21.15.50:0/1928265194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a5b20 con 0x7fbc20003980 2024-01-30T08:09:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc46800640 1 -- 172.21.15.50:0/1928265194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc20003980 msgr2=0x7fbc20003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc46800640 1 --2- 172.21.15.50:0/1928265194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc20003980 0x7fbc20003da0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009ab0 tx=0x7fbc3001ca20 comp rx=0 tx=0).stop 2024-01-30T08:09:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc3fe00640 1 -- 172.21.15.50:0/1928265194 reap_dead start 2024-01-30T08:09:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc46800640 1 -- 172.21.15.50:0/1928265194 shutdown_connections 2024-01-30T08:09:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc46800640 1 -- 172.21.15.50:0/1928265194 >> 172.21.15.50:0/1928265194 conn(0x7fbc400727c0 msgr2=0x7fbc4006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:31.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc46800640 1 -- 172.21.15.50:0/1928265194 shutdown_connections 2024-01-30T08:09:31.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.030+0000 7fbc46800640 1 -- 172.21.15.50:0/1928265194 wait complete. 2024-01-30T08:09:31.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 Processor -- start 2024-01-30T08:09:31.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 -- start start 2024-01-30T08:09:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc20003980 0x7fbc40154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc4006d5a0 0x7fbc401f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc400a7960 0x7fbc401f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40152a90 con 0x7fbc400a7960 2024-01-30T08:09:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4006b8f0 con 0x7fbc4006d5a0 2024-01-30T08:09:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4006bbd0 con 0x7fbc20003980 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc400a7960 0x7fbc401f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc400a7960 0x7fbc401f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55104/0 (socket says 172.21.15.50:55104) 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 -- 172.21.15.50:0/1837727220 learned_addr learned my addr 172.21.15.50:0/1837727220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3ea00640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc4006d5a0 0x7fbc401f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc20003980 0x7fbc40154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 -- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc20003980 msgr2=0x7fbc40154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc20003980 0x7fbc40154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 -- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc4006d5a0 msgr2=0x7fbc401f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc4006d5a0 0x7fbc401f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 -- 172.21.15.50:0/1837727220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40154650 con 0x7fbc400a7960 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc3fe00640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc400a7960 0x7fbc401f0b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc4006f070 tx=0x7fbc38007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc37400640 1 -- 172.21.15.50:0/1837727220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800eb00 con 0x7fbc400a7960 2024-01-30T08:09:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc37400640 1 -- 172.21.15.50:0/1837727220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3800ec60 con 0x7fbc400a7960 2024-01-30T08:09:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc40152d70 con 0x7fbc400a7960 2024-01-30T08:09:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc37400640 1 -- 172.21.15.50:0/1837727220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38013420 con 0x7fbc400a7960 2024-01-30T08:09:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.034+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc401f1040 con 0x7fbc400a7960 2024-01-30T08:09:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.038+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4006c0f0 con 0x7fbc400a7960 2024-01-30T08:09:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.038+0000 7fbc37400640 1 -- 172.21.15.50:0/1837727220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbc38013580 con 0x7fbc400a7960 2024-01-30T08:09:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.038+0000 7fbc37400640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbc18066530 0x7fbc180689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.038+0000 7fbc37400640 1 -- 172.21.15.50:0/1837727220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc38084710 con 0x7fbc400a7960 2024-01-30T08:09:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.038+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbc18066530 0x7fbc180689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.042+0000 7fbc3f400640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbc18066530 0x7fbc180689f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbc300af000 tx=0x7fbc300046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.042+0000 7fbc37400640 1 -- 172.21.15.50:0/1837727220 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbc38051550 con 0x7fbc400a7960 2024-01-30T08:09:31.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc401f1260 con 0x7fbc400a7960 2024-01-30T08:09:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc37400640 1 -- 172.21.15.50:0/1837727220 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc38054b70 con 0x7fbc400a7960 2024-01-30T08:09:31.213 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbc18066530 msgr2=0x7fbc180689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbc18066530 0x7fbc180689f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbc300af000 tx=0x7fbc300046d0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc400a7960 msgr2=0x7fbc401f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc400a7960 0x7fbc401f0b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc4006f070 tx=0x7fbc38007bc0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 shutdown_connections 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc4006d5a0 0x7fbc401f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbc18066530 0x7fbc180689f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc400a7960 0x7fbc401f0b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 --2- 172.21.15.50:0/1837727220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc20003980 0x7fbc40154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 >> 172.21.15.50:0/1837727220 conn(0x7fbc400727c0 msgr2=0x7fbc400c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:31.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 shutdown_connections 2024-01-30T08:09:31.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.206+0000 7fbc46800640 1 -- 172.21.15.50:0/1837727220 wait complete. 2024-01-30T08:09:31.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:31.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.374+0000 7feee9600640 1 Processor -- start 2024-01-30T08:09:31.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.374+0000 7feee9600640 1 -- start start 2024-01-30T08:09:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.374+0000 7feee9600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feee406f6d0 0x7feee40c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.374+0000 7feee9600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee4158b70 con 0x7feee406f240 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.374+0000 7feee9600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40c8cf0 con 0x7feee4155500 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.374+0000 7feee9600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee406fae0 con 0x7feee406f6d0 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee2000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feee406f240 0x7feee40c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53862/0 (socket says 172.21.15.50:53862) 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee3400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feee406f6d0 0x7feee40c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee2000640 1 -- 172.21.15.50:0/2253002262 learned_addr learned my addr 172.21.15.50:0/2253002262 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee3400640 1 -- 172.21.15.50:0/2253002262 >> v1:172.21.15.125:6789/0 conn(0x7feee4155500 legacy=0x7feee40c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee3400640 1 -- 172.21.15.50:0/2253002262 >> v1:172.21.15.50:6789/0 conn(0x7feee406f240 legacy=0x7feee40c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee3400640 1 -- 172.21.15.50:0/2253002262 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4157f60 con 0x7feee406f6d0 2024-01-30T08:09:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee1600640 1 -- 172.21.15.50:0/2253002262 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990370752 0 0) 0x7feee4158b70 con 0x7feee406f240 2024-01-30T08:09:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee3400640 1 --2- 172.21.15.50:0/2253002262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee406f6d0 0x7feee40c1910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feee406fc20 tx=0x7feedc01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11133fe8c9450785 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee1600640 1 -- 172.21.15.50:0/2253002262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a58a0 con 0x7feee406f6d0 2024-01-30T08:09:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee1600640 1 -- 172.21.15.50:0/2253002262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc0a5a00 con 0x7feee406f6d0 2024-01-30T08:09:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.378+0000 7feee1600640 1 -- 172.21.15.50:0/2253002262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a5d90 con 0x7feee406f6d0 2024-01-30T08:09:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- 172.21.15.50:0/2253002262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee406f6d0 msgr2=0x7feee40c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 --2- 172.21.15.50:0/2253002262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee406f6d0 0x7feee40c1910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feee406fc20 tx=0x7feedc01c7e0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- 172.21.15.50:0/2253002262 shutdown_connections 2024-01-30T08:09:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 --2- 172.21.15.50:0/2253002262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee406f6d0 0x7feee40c1910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- 172.21.15.50:0/2253002262 >> 172.21.15.50:0/2253002262 conn(0x7feee40727c0 msgr2=0x7feee406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- 172.21.15.50:0/2253002262 shutdown_connections 2024-01-30T08:09:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- 172.21.15.50:0/2253002262 wait complete. 2024-01-30T08:09:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 Processor -- start 2024-01-30T08:09:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- start start 2024-01-30T08:09:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee406f240 0x7feee41eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feee406f6d0 0x7feee41f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee4155500 0x7feee40a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee41f0c50 con 0x7feee4155500 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee4159890 con 0x7feee406f240 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee9600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40a8810 con 0x7feee406f6d0 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee4155500 0x7feee40a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee4155500 0x7feee40a8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55118/0 (socket says 172.21.15.50:55118) 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee3400640 1 -- 172.21.15.50:0/1087000726 learned_addr learned my addr 172.21.15.50:0/1087000726 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee2a00640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee406f240 0x7feee41eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.382+0000 7feee2000640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feee406f6d0 0x7feee41f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee3400640 1 -- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feee406f6d0 msgr2=0x7feee41f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee3400640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feee406f6d0 0x7feee41f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee3400640 1 -- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee406f240 msgr2=0x7feee41eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee3400640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee406f240 0x7feee41eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee3400640 1 -- 172.21.15.50:0/1087000726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc009a70 con 0x7feee4155500 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee2000640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feee406f6d0 0x7feee41f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee3400640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee4155500 0x7feee40a8ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feedc01a410 tx=0x7feedc019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feedaa00640 1 -- 172.21.15.50:0/1087000726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0ad850 con 0x7feee4155500 2024-01-30T08:09:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feedaa00640 1 -- 172.21.15.50:0/1087000726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc0ad9b0 con 0x7feee4155500 2024-01-30T08:09:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee415d020 con 0x7feee4155500 2024-01-30T08:09:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feedaa00640 1 -- 172.21.15.50:0/1087000726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0add40 con 0x7feee4155500 2024-01-30T08:09:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee41592d0 con 0x7feee4155500 2024-01-30T08:09:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee4067cc0 con 0x7feee4155500 2024-01-30T08:09:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.386+0000 7feedaa00640 1 -- 172.21.15.50:0/1087000726 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7feedc0b4050 con 0x7feee4155500 2024-01-30T08:09:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.390+0000 7feedaa00640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feebc066530 0x7feebc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.390+0000 7feedaa00640 1 -- 172.21.15.50:0/1087000726 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feedc11f1d0 con 0x7feee4155500 2024-01-30T08:09:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.390+0000 7feee2a00640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feebc066530 0x7feebc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.390+0000 7feee2a00640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feebc066530 0x7feebc0689f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feed4007fd0 tx=0x7feed4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.394+0000 7feedaa00640 1 -- 172.21.15.50:0/1087000726 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7feedc0ec310 con 0x7feee4155500 2024-01-30T08:09:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.554+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feee4074a20 con 0x7feee4155500 2024-01-30T08:09:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.554+0000 7feedaa00640 1 -- 172.21.15.50:0/1087000726 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7feedc0ef930 con 0x7feee4155500 2024-01-30T08:09:31.555 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feebc066530 msgr2=0x7feebc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feebc066530 0x7feebc0689f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feed4007fd0 tx=0x7feed4009040 comp rx=0 tx=0).stop 2024-01-30T08:09:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee4155500 msgr2=0x7feee40a8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee4155500 0x7feee40a8ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feedc01a410 tx=0x7feedc019580 comp rx=0 tx=0).stop 2024-01-30T08:09:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 shutdown_connections 2024-01-30T08:09:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feebc066530 0x7feebc0689f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee4155500 0x7feee40a8ca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feee406f6d0 0x7feee41f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 --2- 172.21.15.50:0/1087000726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee406f240 0x7feee41eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 >> 172.21.15.50:0/1087000726 conn(0x7feee40727c0 msgr2=0x7feee40c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 shutdown_connections 2024-01-30T08:09:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.558+0000 7feee9600640 1 -- 172.21.15.50:0/1087000726 wait complete. 2024-01-30T08:09:31.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-30T08:09:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 Processor -- start 2024-01-30T08:09:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 -- start start 2024-01-30T08:09:31.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18bc0c1840 0x7f18bc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18bc0c4760 0x7f18bc06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc0a8cf0 con 0x7f18bc0c1840 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc072a30 con 0x7f18bc0c4760 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c3a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0a8f40 con 0x7f18bc0c5650 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18bc0c1840 0x7f18bc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18bc0c1840 0x7f18bc0a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55134/0 (socket says 172.21.15.50:55134) 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1000640 1 -- 172.21.15.50:0/3437623188 learned_addr learned my addr 172.21.15.50:0/3437623188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18bbe00640 1 --2- 172.21.15.50:0/3437623188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1a00640 1 --2- 172.21.15.50:0/3437623188 >> v2:172.21.15.125:3300/0 conn(0x7f18bc0c4760 0x7f18bc06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1000640 1 -- 172.21.15.50:0/3437623188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 msgr2=0x7f18bc0a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1000640 1 --2- 172.21.15.50:0/3437623188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc0a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1000640 1 -- 172.21.15.50:0/3437623188 >> v2:172.21.15.125:3300/0 conn(0x7f18bc0c4760 msgr2=0x7f18bc06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:31.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.718+0000 7f18c1000640 1 --2- 172.21.15.50:0/3437623188 >> v2:172.21.15.125:3300/0 conn(0x7f18bc0c4760 0x7f18bc06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18c1000640 1 -- 172.21.15.50:0/3437623188 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc072cd0 con 0x7f18bc0c1840 2024-01-30T08:09:31.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18c1a00640 1 --2- 172.21.15.50:0/3437623188 >> v2:172.21.15.125:3300/0 conn(0x7f18bc0c4760 0x7f18bc06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:31.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18c1000640 1 --2- 172.21.15.50:0/3437623188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c1840 0x7f18bc0a4d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f18bc06c410 tx=0x7f18ac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb0388235de411a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18bb400640 1 -- 172.21.15.50:0/3437623188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc06dc50 con 0x7f18bc0c1840 2024-01-30T08:09:31.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18bb400640 1 -- 172.21.15.50:0/3437623188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac0aa640 con 0x7f18bc0c1840 2024-01-30T08:09:31.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18bb400640 1 -- 172.21.15.50:0/3437623188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0aa9d0 con 0x7f18bc0c1840 2024-01-30T08:09:31.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18c3a00640 1 -- 172.21.15.50:0/3437623188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c1840 msgr2=0x7f18bc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.722+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3437623188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c1840 0x7f18bc0a4d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f18bc06c410 tx=0x7f18ac01c500 comp rx=0 tx=0).stop 2024-01-30T08:09:31.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- 172.21.15.50:0/3437623188 shutdown_connections 2024-01-30T08:09:31.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3437623188 >> v2:172.21.15.125:3300/0 conn(0x7f18bc0c4760 0x7f18bc06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3437623188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc0a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3437623188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c1840 0x7f18bc0a4d50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- 172.21.15.50:0/3437623188 >> 172.21.15.50:0/3437623188 conn(0x7f18bc0c5b50 msgr2=0x7f18bc0c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:31.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- 172.21.15.50:0/3437623188 shutdown_connections 2024-01-30T08:09:31.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- 172.21.15.50:0/3437623188 wait complete. 2024-01-30T08:09:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 Processor -- start 2024-01-30T08:09:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- start start 2024-01-30T08:09:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18bc0c1840 0x7f18bc0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c4760 0x7f18bc14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc1edad0 con 0x7f18bc0c4760 2024-01-30T08:09:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc14fe80 con 0x7f18bc0c1840 2024-01-30T08:09:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c3a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc15a8c0 con 0x7f18bc0c5650 2024-01-30T08:09:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c4760 0x7f18bc14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c4760 0x7f18bc14f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55150/0 (socket says 172.21.15.50:55150) 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 -- 172.21.15.50:0/3144285699 learned_addr learned my addr 172.21.15.50:0/3144285699 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c1a00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18c1000640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18bc0c1840 0x7f18bc0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 -- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 msgr2=0x7f18bc070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 -- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18bc0c1840 msgr2=0x7f18bc0721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18bc0c1840 0x7f18bc0721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 -- 172.21.15.50:0/3144285699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0094d0 con 0x7f18bc0c4760 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.726+0000 7f18bbe00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c4760 0x7f18bc14f940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18a400d5f0 tx=0x7f18a400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18b8c00640 1 -- 172.21.15.50:0/3144285699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40125f0 con 0x7f18bc0c4760 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18b8c00640 1 -- 172.21.15.50:0/3144285699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4012750 con 0x7f18bc0c4760 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18b8c00640 1 -- 172.21.15.50:0/3144285699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4012b00 con 0x7f18bc0c4760 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc15a5e0 con 0x7f18bc0c4760 2024-01-30T08:09:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc153ca0 con 0x7f18bc0c4760 2024-01-30T08:09:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc074a20 con 0x7f18bc0c4760 2024-01-30T08:09:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18b8c00640 1 -- 172.21.15.50:0/3144285699 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f18a4012c60 con 0x7f18bc0c4760 2024-01-30T08:09:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18b8c00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1894066530 0x7f18940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18b8c00640 1 -- 172.21.15.50:0/3144285699 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18a40846e0 con 0x7f18bc0c4760 2024-01-30T08:09:31.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.730+0000 7f18c1000640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1894066530 0x7f18940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.734+0000 7f18c1000640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1894066530 0x7f18940689f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0ae000 tx=0x7f18ac0b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.734+0000 7f18b8c00640 1 -- 172.21.15.50:0/3144285699 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f18a4051540 con 0x7f18bc0c4760 2024-01-30T08:09:31.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:31.954+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f18bc1566d0 con 0x7f18bc0c4760 2024-01-30T08:09:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18b8c00640 1 -- 172.21.15.50:0/3144285699 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v64) v1 ==== 162+0+0 (secure 0 0 0) 0x7f18a4054b60 con 0x7f18bc0c4760 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1894066530 msgr2=0x7f18940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1894066530 0x7f18940689f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0ae000 tx=0x7f18ac0b5040 comp rx=0 tx=0).stop 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c4760 msgr2=0x7f18bc14f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c4760 0x7f18bc14f940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18a400d5f0 tx=0x7f18a400dab0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 shutdown_connections 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1894066530 0x7f18940689f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18bc0c5650 0x7f18bc070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0c4760 0x7f18bc14f940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 --2- 172.21.15.50:0/3144285699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18bc0c1840 0x7f18bc0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 >> 172.21.15.50:0/3144285699 conn(0x7f18bc0c5b50 msgr2=0x7f18bc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 shutdown_connections 2024-01-30T08:09:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.182+0000 7f18c3a00640 1 -- 172.21.15.50:0/3144285699 wait complete. 2024-01-30T08:09:32.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-30T08:09:32.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5c400640 1 Processor -- start 2024-01-30T08:09:32.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5c400640 1 -- start start 2024-01-30T08:09:32.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5c400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 0x7fde540a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5c400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5406c4c0 con 0x7fde5406bfe0 2024-01-30T08:09:32.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5c400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde540c0550 con 0x7fde540a51e0 2024-01-30T08:09:32.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5c400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540c07c0 con 0x7fde54072b60 2024-01-30T08:09:32.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde59000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde5406bfe0 0x7fde540c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53876/0 (socket says 172.21.15.50:53876) 2024-01-30T08:09:32.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde59000640 1 -- 172.21.15.50:0/1505417007 learned_addr learned my addr 172.21.15.50:0/1505417007 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:32.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde59a00640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 0x7fde540a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102338766 0 0) 0x7fde5406c4c0 con 0x7fde5406bfe0 2024-01-30T08:09:32.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde34003530 con 0x7fde5406bfe0 2024-01-30T08:09:32.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495726255 0 0) 0x7fde34003530 con 0x7fde5406bfe0 2024-01-30T08:09:32.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 msgr2=0x7fde540a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:32.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 0x7fde540a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 >> v1:172.21.15.125:6789/0 conn(0x7fde540a51e0 legacy=0x7fde5415bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540c0aa0 con 0x7fde5406bfe0 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fde3c001680 con 0x7fde5406bfe0 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 >> v1:172.21.15.50:6789/0 conn(0x7fde5406bfe0 legacy=0x7fde540c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde340039b0 0x7fde34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 0x7fde340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540c07c0 con 0x7fde34004d10 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3400ba40 con 0x7fde340039b0 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3400bc00 con 0x7fde54072b60 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5a400640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde59a00640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde340039b0 0x7fde34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde59000640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 0x7fde340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5a400640 1 -- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 msgr2=0x7fde340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5a400640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde54072b60 0x7fde340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5a400640 1 -- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde340039b0 msgr2=0x7fde34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:32.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5a400640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde340039b0 0x7fde34003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.350+0000 7fde5a400640 1 -- 172.21.15.50:0/1505417007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34003530 con 0x7fde34004d10 2024-01-30T08:09:32.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5a400640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde34005190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde4c001f60 tx=0x7fde4c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab834f1bc57e37c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:32.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0a6630 con 0x7fde34004d10 2024-01-30T08:09:32.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c0a6790 con 0x7fde34004d10 2024-01-30T08:09:32.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde53e00640 1 -- 172.21.15.50:0/1505417007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0a6bc0 con 0x7fde34004d10 2024-01-30T08:09:32.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5c400640 1 -- 172.21.15.50:0/1505417007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 msgr2=0x7fde34005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5c400640 1 --2- 172.21.15.50:0/1505417007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde34005190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde4c001f60 tx=0x7fde4c01c830 comp rx=0 tx=0).stop 2024-01-30T08:09:32.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5a400640 1 -- 172.21.15.50:0/1505417007 reap_dead start 2024-01-30T08:09:32.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5c400640 1 -- 172.21.15.50:0/1505417007 shutdown_connections 2024-01-30T08:09:32.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5c400640 1 -- 172.21.15.50:0/1505417007 >> 172.21.15.50:0/1505417007 conn(0x7fde540c5b30 msgr2=0x7fde540c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:32.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5c400640 1 -- 172.21.15.50:0/1505417007 shutdown_connections 2024-01-30T08:09:32.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.354+0000 7fde5c400640 1 -- 172.21.15.50:0/1505417007 wait complete. 2024-01-30T08:09:32.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 Processor -- start 2024-01-30T08:09:32.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 -- start start 2024-01-30T08:09:32.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde54150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde541473b0 0x7fde541e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde540aa6c0 0x7fde541e9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde541ec540 con 0x7fde34004d10 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540aacb0 con 0x7fde540aa6c0 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde541ec790 con 0x7fde541473b0 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde54150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde54150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55180/0 (socket says 172.21.15.50:55180) 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 -- 172.21.15.50:0/3890531051 learned_addr learned my addr 172.21.15.50:0/3890531051 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59000640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde541473b0 0x7fde541e8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5a400640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde540aa6c0 0x7fde541e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 -- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde541473b0 msgr2=0x7fde541e8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde541473b0 0x7fde541e8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 -- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde540aa6c0 msgr2=0x7fde541e9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde540aa6c0 0x7fde541e9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 -- 172.21.15.50:0/3890531051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde541eca70 con 0x7fde34004d10 2024-01-30T08:09:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde59a00640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde54150b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde44011de0 tx=0x7fde44010810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde51600640 1 -- 172.21.15.50:0/3890531051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44016070 con 0x7fde34004d10 2024-01-30T08:09:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde51600640 1 -- 172.21.15.50:0/3890531051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4400f5e0 con 0x7fde34004d10 2024-01-30T08:09:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde51600640 1 -- 172.21.15.50:0/3890531051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400f970 con 0x7fde34004d10 2024-01-30T08:09:32.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde541ecd50 con 0x7fde34004d10 2024-01-30T08:09:32.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.358+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde54151050 con 0x7fde34004d10 2024-01-30T08:09:32.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.362+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde54151330 con 0x7fde34004d10 2024-01-30T08:09:32.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.362+0000 7fde51600640 1 -- 172.21.15.50:0/3890531051 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fde4400fad0 con 0x7fde34004d10 2024-01-30T08:09:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.362+0000 7fde51600640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde2c066500 0x7fde2c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.362+0000 7fde51600640 1 -- 172.21.15.50:0/3890531051 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fde44087050 con 0x7fde34004d10 2024-01-30T08:09:32.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.362+0000 7fde59000640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde2c066500 0x7fde2c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.366+0000 7fde59000640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde2c066500 0x7fde2c0689c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0010f0 tx=0x7fde3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:32.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.366+0000 7fde51600640 1 -- 172.21.15.50:0/3890531051 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fde440b8590 con 0x7fde34004d10 2024-01-30T08:09:32.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.530+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fde541ed420 con 0x7fde34004d10 2024-01-30T08:09:32.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.534+0000 7fde51600640 1 -- 172.21.15.50:0/3890531051 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde4401f020 con 0x7fde34004d10 2024-01-30T08:09:32.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde2c066500 msgr2=0x7fde2c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde2c066500 0x7fde2c0689c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0010f0 tx=0x7fde3c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:32.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 msgr2=0x7fde54150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde54150b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde44011de0 tx=0x7fde44010810 comp rx=0 tx=0).stop 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 shutdown_connections 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde540aa6c0 0x7fde541e9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde2c066500 0x7fde2c0689c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde541473b0 0x7fde541e8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 --2- 172.21.15.50:0/3890531051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde34004d10 0x7fde54150b10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 >> 172.21.15.50:0/3890531051 conn(0x7fde540c5b30 msgr2=0x7fde540a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 shutdown_connections 2024-01-30T08:09:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.538+0000 7fde5c400640 1 -- 172.21.15.50:0/3890531051 wait complete. 2024-01-30T08:09:32.557 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-30T08:09:32.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-30T08:09:32.635 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-30T08:09:32.682 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-30T08:09:32.682 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:09:32.682 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:32.692 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:09:32.692 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:32.740 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:09:32.740 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:32.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:32.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2fa00640 1 Processor -- start 2024-01-30T08:09:32.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2fa00640 1 -- start start 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2fa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc2814fbf0 0x7efc281559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2fa00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc280c3ed0 con 0x7efc280c1de0 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2fa00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2806bca0 con 0x7efc2814fbf0 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2806bef0 con 0x7efc280c0ee0 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc2814fbf0 0x7efc281559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc2814fbf0 0x7efc281559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55186/0 (socket says 172.21.15.50:55186) 2024-01-30T08:09:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2d000640 1 -- 172.21.15.50:0/2965179971 learned_addr learned my addr 172.21.15.50:0/2965179971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc27e00640 1 --2- 172.21.15.50:0/2965179971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2d000640 1 -- 172.21.15.50:0/2965179971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 msgr2=0x7efc280a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2d000640 1 --2- 172.21.15.50:0/2965179971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2d000640 1 -- 172.21.15.50:0/2965179971 >> v1:172.21.15.125:6789/0 conn(0x7efc280c1de0 legacy=0x7efc2806a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.978+0000 7efc2d000640 1 -- 172.21.15.50:0/2965179971 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280c3b60 con 0x7efc2814fbf0 2024-01-30T08:09:32.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2d000640 1 --2- 172.21.15.50:0/2965179971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2814fbf0 0x7efc281559c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efc18009870 tx=0x7efc1801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d92e0af95711dfe server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc27400640 1 -- 172.21.15.50:0/2965179971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18004230 con 0x7efc2814fbf0 2024-01-30T08:09:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc27400640 1 -- 172.21.15.50:0/2965179971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc180a7050 con 0x7efc2814fbf0 2024-01-30T08:09:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc27400640 1 -- 172.21.15.50:0/2965179971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18003620 con 0x7efc2814fbf0 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 -- 172.21.15.50:0/2965179971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2814fbf0 msgr2=0x7efc281559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2965179971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2814fbf0 0x7efc281559c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efc18009870 tx=0x7efc1801c420 comp rx=0 tx=0).stop 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 -- 172.21.15.50:0/2965179971 shutdown_connections 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2965179971 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2965179971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2814fbf0 0x7efc281559c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 -- 172.21.15.50:0/2965179971 >> 172.21.15.50:0/2965179971 conn(0x7efc280c5b50 msgr2=0x7efc280c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 -- 172.21.15.50:0/2965179971 shutdown_connections 2024-01-30T08:09:32.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.982+0000 7efc2fa00640 1 -- 172.21.15.50:0/2965179971 wait complete. 2024-01-30T08:09:32.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 Processor -- start 2024-01-30T08:09:32.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 -- start start 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280c1de0 0x7efc2814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc2814fbf0 0x7efc2814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2814e7e0 con 0x7efc280c1de0 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc281f02e0 con 0x7efc2814fbf0 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc281f05c0 con 0x7efc280c0ee0 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280c1de0 0x7efc2814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280c1de0 0x7efc2814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55200/0 (socket says 172.21.15.50:55200) 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 -- 172.21.15.50:0/2762631236 learned_addr learned my addr 172.21.15.50:0/2762631236 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2da00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc2814fbf0 0x7efc2814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2d000640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 -- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 msgr2=0x7efc280a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 -- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc2814fbf0 msgr2=0x7efc2814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc2814fbf0 0x7efc2814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 -- 172.21.15.50:0/2762631236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180094d0 con 0x7efc280c1de0 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc27e00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280c1de0 0x7efc2814d580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc1000d5f0 tx=0x7efc1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc24c00640 1 -- 172.21.15.50:0/2762631236 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100125f0 con 0x7efc280c1de0 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc24c00640 1 -- 172.21.15.50:0/2762631236 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10012750 con 0x7efc280c1de0 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc281f08a0 con 0x7efc280c1de0 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc24c00640 1 -- 172.21.15.50:0/2762631236 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10012b00 con 0x7efc280c1de0 2024-01-30T08:09:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.986+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc281f0e60 con 0x7efc280c1de0 2024-01-30T08:09:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.990+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc28074a20 con 0x7efc280c1de0 2024-01-30T08:09:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.990+0000 7efc24c00640 1 -- 172.21.15.50:0/2762631236 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7efc10012c60 con 0x7efc280c1de0 2024-01-30T08:09:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.990+0000 7efc24c00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efc00066500 0x7efc000689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.990+0000 7efc24c00640 1 -- 172.21.15.50:0/2762631236 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc10084690 con 0x7efc280c1de0 2024-01-30T08:09:32.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.990+0000 7efc2d000640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efc00066500 0x7efc000689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:32.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.990+0000 7efc2d000640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efc00066500 0x7efc000689c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efc180ad000 tx=0x7efc180a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:32.994+0000 7efc24c00640 1 -- 172.21.15.50:0/2762631236 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7efc10051610 con 0x7efc280c1de0 2024-01-30T08:09:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.158+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc28156820 con 0x7efc280c1de0 2024-01-30T08:09:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.158+0000 7efc24c00640 1 -- 172.21.15.50:0/2762631236 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18735 (secure 0 0 0) 0x7efc10054c30 con 0x7efc280c1de0 2024-01-30T08:09:33.160 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:33.160 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:30.858267+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:33.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efc00066500 msgr2=0x7efc000689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efc00066500 0x7efc000689c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efc180ad000 tx=0x7efc180a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:33.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280c1de0 msgr2=0x7efc2814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280c1de0 0x7efc2814d580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc1000d5f0 tx=0x7efc1000dab0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 shutdown_connections 2024-01-30T08:09:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc2814fbf0 0x7efc2814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7efc00066500 0x7efc000689c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc280c1de0 0x7efc2814d580 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 --2- 172.21.15.50:0/2762631236 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc280c0ee0 0x7efc280a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 >> 172.21.15.50:0/2762631236 conn(0x7efc280c5b50 msgr2=0x7efc280c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:33.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 shutdown_connections 2024-01-30T08:09:33.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.162+0000 7efc2fa00640 1 -- 172.21.15.50:0/2762631236 wait complete. 2024-01-30T08:09:33.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:33.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:33.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f09a00640 1 Processor -- start 2024-01-30T08:09:33.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f09a00640 1 -- start start 2024-01-30T08:09:33.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f09a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4f04071320 0x7f4f04072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f09a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f04071700 0x7f4f040c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f09a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040c0240 con 0x7f4f040c4bb0 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f09a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040c2910 con 0x7f4f04071700 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f09a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0406ab20 con 0x7f4f04071320 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f04071700 0x7f4f040c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f04071700 0x7f4f040c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55212/0 (socket says 172.21.15.50:55212) 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02000640 1 -- 172.21.15.50:0/2242766659 learned_addr learned my addr 172.21.15.50:0/2242766659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f03400640 1 --1- 172.21.15.50:0/2242766659 >> v1:172.21.15.50:6789/0 conn(0x7f4f040c4bb0 0x7f4f040a5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53878/0 (socket says 172.21.15.50:53878) 2024-01-30T08:09:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02000640 1 -- 172.21.15.50:0/2242766659 >> v2:172.21.15.125:3300/0 conn(0x7f4f04071320 msgr2=0x7f4f04072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02a00640 1 --2- 172.21.15.50:0/2242766659 >> v2:172.21.15.125:3300/0 conn(0x7f4f04071320 0x7f4f04072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02000640 1 --2- 172.21.15.50:0/2242766659 >> v2:172.21.15.125:3300/0 conn(0x7f4f04071320 0x7f4f04072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02000640 1 -- 172.21.15.50:0/2242766659 >> v1:172.21.15.50:6789/0 conn(0x7f4f040c4bb0 legacy=0x7f4f040a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f01600640 1 -- 172.21.15.50:0/2242766659 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745460478 0 0) 0x7f4f040c0240 con 0x7f4f040c4bb0 2024-01-30T08:09:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02000640 1 -- 172.21.15.50:0/2242766659 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0406ae00 con 0x7f4f04071700 2024-01-30T08:09:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.326+0000 7f4f02a00640 1 --2- 172.21.15.50:0/2242766659 >> v2:172.21.15.125:3300/0 conn(0x7f4f04071320 0x7f4f04072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.330+0000 7f4f02000640 1 --2- 172.21.15.50:0/2242766659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f04071700 0x7f4f040c06d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f04071070 tx=0x7f4eec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a9a62ce9147ddc server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.330+0000 7f4f01600640 1 -- 172.21.15.50:0/2242766659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec0aa650 con 0x7f4f04071700 2024-01-30T08:09:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.330+0000 7f4f01600640 1 -- 172.21.15.50:0/2242766659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec0aa7b0 con 0x7f4f04071700 2024-01-30T08:09:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.330+0000 7f4f01600640 1 -- 172.21.15.50:0/2242766659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec0aab40 con 0x7f4f04071700 2024-01-30T08:09:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.330+0000 7f4f09a00640 1 -- 172.21.15.50:0/2242766659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f04071700 msgr2=0x7f4f040c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.330+0000 7f4f09a00640 1 --2- 172.21.15.50:0/2242766659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f04071700 0x7f4f040c06d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f04071070 tx=0x7f4eec01c4d0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- 172.21.15.50:0/2242766659 shutdown_connections 2024-01-30T08:09:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 --2- 172.21.15.50:0/2242766659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f04071700 0x7f4f040c06d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 --2- 172.21.15.50:0/2242766659 >> v2:172.21.15.125:3300/0 conn(0x7f4f04071320 0x7f4f04072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- 172.21.15.50:0/2242766659 >> 172.21.15.50:0/2242766659 conn(0x7f4f040c6c60 msgr2=0x7f4f040c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- 172.21.15.50:0/2242766659 shutdown_connections 2024-01-30T08:09:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- 172.21.15.50:0/2242766659 wait complete. 2024-01-30T08:09:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 Processor -- start 2024-01-30T08:09:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- start start 2024-01-30T08:09:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f04071320 0x7f4f041597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f04071700 0x7f4f040a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f040c4bb0 0x7f4f04151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0415a5c0 con 0x7f4f040c4bb0 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0406de60 con 0x7f4f04071320 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f09a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0406e350 con 0x7f4f04071700 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f040c4bb0 0x7f4f04151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f040c4bb0 0x7f4f04151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55218/0 (socket says 172.21.15.50:55218) 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 -- 172.21.15.50:0/3683272164 learned_addr learned my addr 172.21.15.50:0/3683272164 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f02a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f04071320 0x7f4f041597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f02000640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f04071700 0x7f4f040a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 -- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f04071700 msgr2=0x7f4f040a6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f04071700 0x7f4f040a6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 -- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f04071320 msgr2=0x7f4f041597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f04071320 0x7f4f041597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f03400640 1 -- 172.21.15.50:0/3683272164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0094d0 con 0x7f4f040c4bb0 2024-01-30T08:09:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.334+0000 7f4f02a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f04071320 0x7f4f041597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4f03400640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f040c4bb0 0x7f4f04151f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c6d0 tx=0x7f4efc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4efaa00640 1 -- 172.21.15.50:0/3683272164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc004d70 con 0x7f4f040c4bb0 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4efaa00640 1 -- 172.21.15.50:0/3683272164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00a640 con 0x7f4f040c4bb0 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0406e070 con 0x7f4f040c4bb0 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4efaa00640 1 -- 172.21.15.50:0/3683272164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00aa70 con 0x7f4f040c4bb0 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0406eab0 con 0x7f4f040c4bb0 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0406e630 con 0x7f4f040c4bb0 2024-01-30T08:09:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4efaa00640 1 -- 172.21.15.50:0/3683272164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4efc0070d0 con 0x7f4f040c4bb0 2024-01-30T08:09:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4efaa00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4edc066530 0x7f4edc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4efaa00640 1 -- 172.21.15.50:0/3683272164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4efc083ca0 con 0x7f4f040c4bb0 2024-01-30T08:09:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.338+0000 7f4f02a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4edc066530 0x7f4edc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.342+0000 7f4f02a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4edc066530 0x7f4edc0689f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006fd0 tx=0x7f4ef4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.342+0000 7f4efaa00640 1 -- 172.21.15.50:0/3683272164 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4f0406e630 con 0x7f4f040c4bb0 2024-01-30T08:09:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.502+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f041f0610 con 0x7f4f040c4bb0 2024-01-30T08:09:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.502+0000 7f4efaa00640 1 -- 172.21.15.50:0/3683272164 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f041f0610 con 0x7f4f040c4bb0 2024-01-30T08:09:33.503 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4edc066530 msgr2=0x7f4edc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4edc066530 0x7f4edc0689f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006fd0 tx=0x7f4ef4008040 comp rx=0 tx=0).stop 2024-01-30T08:09:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f040c4bb0 msgr2=0x7f4f04151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f040c4bb0 0x7f4f04151f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c6d0 tx=0x7f4efc00cb90 comp rx=0 tx=0).stop 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 shutdown_connections 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4edc066530 0x7f4edc0689f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f040c4bb0 0x7f4f04151f50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4f04071700 0x7f4f040a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 --2- 172.21.15.50:0/3683272164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f04071320 0x7f4f041597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 >> 172.21.15.50:0/3683272164 conn(0x7f4f040c6c60 msgr2=0x7f4f041554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 shutdown_connections 2024-01-30T08:09:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.506+0000 7f4f09a00640 1 -- 172.21.15.50:0/3683272164 wait complete. 2024-01-30T08:09:33.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:33.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f9015400640 1 Processor -- start 2024-01-30T08:09:33.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f9015400640 1 -- start start 2024-01-30T08:09:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f9015400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100a4da0 0x7f9010153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f9015400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90100c04b0 0x7f901006ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f9015400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100c54e0 con 0x7f901014fbf0 2024-01-30T08:09:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f9015400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9010152bf0 con 0x7f90100c04b0 2024-01-30T08:09:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f9015400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9010072d90 con 0x7f90100a4da0 2024-01-30T08:09:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900de00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100a4da0 0x7f9010153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900e800640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f901014fbf0 0x7f90100c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:33166/0 (socket says 172.21.15.50:33166) 2024-01-30T08:09:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900f200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90100c04b0 0x7f901006ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900e800640 1 -- 172.21.15.50:0/3886582804 learned_addr learned my addr 172.21.15.50:0/3886582804 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:33.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900f200640 1 -- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100a4da0 msgr2=0x7f9010153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:33.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900f200640 1 --2- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100a4da0 0x7f9010153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900f200640 1 -- 172.21.15.50:0/3886582804 >> v1:172.21.15.125:6789/0 conn(0x7f901014fbf0 legacy=0x7f90100c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900f200640 1 -- 172.21.15.50:0/3886582804 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90101525e0 con 0x7f90100c04b0 2024-01-30T08:09:33.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900d400640 1 -- 172.21.15.50:0/3886582804 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934365778 0 0) 0x7f90100c54e0 con 0x7f901014fbf0 2024-01-30T08:09:33.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.670+0000 7f900de00640 1 --2- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100a4da0 0x7f9010153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:33.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.674+0000 7f900f200640 1 --2- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100c04b0 0x7f901006ffb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9008009d90 tx=0x7f900801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a3a0b9068eef9a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:33.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.674+0000 7f900d400640 1 -- 172.21.15.50:0/3886582804 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080a5870 con 0x7f90100c04b0 2024-01-30T08:09:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.674+0000 7f900d400640 1 -- 172.21.15.50:0/3886582804 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080a59d0 con 0x7f90100c04b0 2024-01-30T08:09:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.674+0000 7f900d400640 1 -- 172.21.15.50:0/3886582804 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080a5d60 con 0x7f90100c04b0 2024-01-30T08:09:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.674+0000 7f9015400640 1 -- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100c04b0 msgr2=0x7f901006ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.674+0000 7f9015400640 1 --2- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100c04b0 0x7f901006ffb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9008009d90 tx=0x7f900801c8c0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- 172.21.15.50:0/3886582804 shutdown_connections 2024-01-30T08:09:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 --2- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100c04b0 0x7f901006ffb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 --2- 172.21.15.50:0/3886582804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100a4da0 0x7f9010153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- 172.21.15.50:0/3886582804 >> 172.21.15.50:0/3886582804 conn(0x7f90100c5b30 msgr2=0x7f90100c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- 172.21.15.50:0/3886582804 shutdown_connections 2024-01-30T08:09:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- 172.21.15.50:0/3886582804 wait complete. 2024-01-30T08:09:33.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 Processor -- start 2024-01-30T08:09:33.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- start start 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100a4da0 0x7f90100aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100c04b0 0x7f90101ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901014fbf0 0x7f901015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901006d8f0 con 0x7f901014fbf0 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90101edcc0 con 0x7f90100a4da0 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f9015400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901006db40 con 0x7f90100c04b0 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901014fbf0 0x7f901015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901014fbf0 0x7f901015b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55230/0 (socket says 172.21.15.50:55230) 2024-01-30T08:09:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 -- 172.21.15.50:0/1213024229 learned_addr learned my addr 172.21.15.50:0/1213024229 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900de00640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100c04b0 0x7f90101ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900e800640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100a4da0 0x7f90100aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 -- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100c04b0 msgr2=0x7f90101ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100c04b0 0x7f90101ed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 -- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100a4da0 msgr2=0x7f90100aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100a4da0 0x7f90100aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.678+0000 7f900f200640 1 -- 172.21.15.50:0/1213024229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009420 con 0x7f901014fbf0 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f900f200640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901014fbf0 0x7f901015b400 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f90080b0040 tx=0x7f9008019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9006a00640 1 -- 172.21.15.50:0/1213024229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080ad8d0 con 0x7f901014fbf0 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9006a00640 1 -- 172.21.15.50:0/1213024229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080ada30 con 0x7f901014fbf0 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9008009a70 con 0x7f901014fbf0 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9006a00640 1 -- 172.21.15.50:0/1213024229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080adde0 con 0x7f901014fbf0 2024-01-30T08:09:33.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901006c360 con 0x7f901014fbf0 2024-01-30T08:09:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9010074a20 con 0x7f901014fbf0 2024-01-30T08:09:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9006a00640 1 -- 172.21.15.50:0/1213024229 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f90080b9450 con 0x7f901014fbf0 2024-01-30T08:09:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9006a00640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8fe8066500 0x7f8fe80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f9006a00640 1 -- 172.21.15.50:0/1213024229 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f900811f7f0 con 0x7f901014fbf0 2024-01-30T08:09:33.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.682+0000 7f900e800640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8fe8066500 0x7f8fe80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:33.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.686+0000 7f900e800640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8fe8066500 0x7f8fe80689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9000000f70 tx=0x7f9000007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:33.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.686+0000 7f9006a00640 1 -- 172.21.15.50:0/1213024229 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f90080ec6c0 con 0x7f901014fbf0 2024-01-30T08:09:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.846+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90100c2320 con 0x7f901014fbf0 2024-01-30T08:09:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.846+0000 7f9006a00640 1 -- 172.21.15.50:0/1213024229 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90080efce0 con 0x7f901014fbf0 2024-01-30T08:09:33.848 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8fe8066500 msgr2=0x7f8fe80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8fe8066500 0x7f8fe80689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9000000f70 tx=0x7f9000007c10 comp rx=0 tx=0).stop 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901014fbf0 msgr2=0x7f901015b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901014fbf0 0x7f901015b400 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f90080b0040 tx=0x7f9008019660 comp rx=0 tx=0).stop 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 shutdown_connections 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8fe8066500 0x7f8fe80689c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901014fbf0 0x7f901015b400 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f90100c04b0 0x7f90101ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 --2- 172.21.15.50:0/1213024229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90100a4da0 0x7f90100aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 >> 172.21.15.50:0/1213024229 conn(0x7f90100c5b30 msgr2=0x7f901015c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 shutdown_connections 2024-01-30T08:09:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:33.850+0000 7f9015400640 1 -- 172.21.15.50:0/1213024229 wait complete. 2024-01-30T08:09:33.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:34.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2fa5800640 1 Processor -- start 2024-01-30T08:09:34.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2fa5800640 1 -- start start 2024-01-30T08:09:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2fa5800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fa00a6480 0x7f2fa0072870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2fa5800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00c0a20 con 0x7f2fa006f060 2024-01-30T08:09:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2fa5800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00716f0 con 0x7f2fa0071b80 2024-01-30T08:09:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2fa5800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00c0c70 con 0x7f2fa00a6480 2024-01-30T08:09:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2f9e000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2fa006f060 0x7f2fa006a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53892/0 (socket says 172.21.15.50:53892) 2024-01-30T08:09:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.014+0000 7f2f9e000640 1 -- 172.21.15.50:0/4106407521 learned_addr learned my addr 172.21.15.50:0/4106407521 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/4106407521 >> v2:172.21.15.125:3300/0 conn(0x7f2fa00a6480 0x7f2fa0072870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126939659 0 0) 0x7f2fa00c0a20 con 0x7f2fa006f060 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f80003530 con 0x7f2fa006f060 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153874032 0 0) 0x7f2fa00716f0 con 0x7f2fa0071b80 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa00c0a20 con 0x7f2fa0071b80 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2483765687 0 0) 0x7f2f80003530 con 0x7f2fa006f060 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 >> v2:172.21.15.125:3300/0 conn(0x7f2fa00a6480 msgr2=0x7f2fa0072870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 --2- 172.21.15.50:0/4106407521 >> v2:172.21.15.125:3300/0 conn(0x7f2fa00a6480 0x7f2fa0072870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 >> v1:172.21.15.125:6789/0 conn(0x7f2fa0071b80 legacy=0x7f2fa0071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00c0f50 con 0x7f2fa006f060 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f2f88001680 con 0x7f2fa006f060 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/4106407521 >> v2:172.21.15.125:3300/0 conn(0x7f2fa00a6480 0x7f2fa0072870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 >> v1:172.21.15.50:6789/0 conn(0x7f2fa006f060 legacy=0x7f2fa006a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80003b60 0x7f2f80003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f800047d0 0x7f2f80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f80005190 0x7f2f8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c0c70 con 0x7f2f80003b60 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8000c060 con 0x7f2f800047d0 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8000c220 con 0x7f2f80005190 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80003b60 0x7f2f80003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9e000640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f800047d0 0x7f2f80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9f400640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f80005190 0x7f2f8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 -- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f80005190 msgr2=0x7f2f8000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f80005190 0x7f2f8000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 -- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f800047d0 msgr2=0x7f2f80004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f800047d0 0x7f2f80004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9ea00640 1 -- 172.21.15.50:0/4106407521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80003530 con 0x7f2f80003b60 2024-01-30T08:09:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.018+0000 7f2f9f400640 1 -- 172.21.15.50:0/4106407521 reap_dead start 2024-01-30T08:09:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80003b60 0x7f2f80003f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009cb0 tx=0x7f2f9001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa055c17e3ea1a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900a5790 con 0x7f2f80003b60 2024-01-30T08:09:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900a58f0 con 0x7f2f80003b60 2024-01-30T08:09:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2f9d600640 1 -- 172.21.15.50:0/4106407521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900a5ce0 con 0x7f2f80003b60 2024-01-30T08:09:34.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 -- 172.21.15.50:0/4106407521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80003b60 msgr2=0x7f2f80003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80003b60 0x7f2f80003f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009cb0 tx=0x7f2f9001cbe0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 -- 172.21.15.50:0/4106407521 shutdown_connections 2024-01-30T08:09:34.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 --2- 172.21.15.50:0/4106407521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80003b60 0x7f2f80003f60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 -- 172.21.15.50:0/4106407521 >> 172.21.15.50:0/4106407521 conn(0x7f2fa00c6c60 msgr2=0x7f2fa00c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:34.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 -- 172.21.15.50:0/4106407521 shutdown_connections 2024-01-30T08:09:34.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 -- 172.21.15.50:0/4106407521 wait complete. 2024-01-30T08:09:34.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 Processor -- start 2024-01-30T08:09:34.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.022+0000 7f2fa5800640 1 -- start start 2024-01-30T08:09:34.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f80003b60 0x7f2fa00a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fa006cd20 0x7f2fa00a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fa00a9e10 0x7f2fa01f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa009a840 con 0x7f2fa00a9e10 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00999e0 con 0x7f2f80003b60 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa009a150 con 0x7f2fa006cd20 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fa00a9e10 0x7f2fa01f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fa00a9e10 0x7f2fa01f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55242/0 (socket says 172.21.15.50:55242) 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 -- 172.21.15.50:0/3511635790 learned_addr learned my addr 172.21.15.50:0/3511635790 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f80003b60 0x7f2fa00a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9e000640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fa006cd20 0x7f2fa00a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 -- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fa006cd20 msgr2=0x7f2fa00a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fa006cd20 0x7f2fa00a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 -- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f80003b60 msgr2=0x7f2fa00a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f80003b60 0x7f2fa00a7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 -- 172.21.15.50:0/3511635790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00ab790 con 0x7f2fa00a9e10 2024-01-30T08:09:34.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f80003b60 0x7f2fa00a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:34.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f9f400640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fa00a9e10 0x7f2fa01f0e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006f4f0 tx=0x7f2f9800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f96a00640 1 -- 172.21.15.50:0/3511635790 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800ee50 con 0x7f2fa00a9e10 2024-01-30T08:09:34.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f96a00640 1 -- 172.21.15.50:0/3511635790 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98003b90 con 0x7f2fa00a9e10 2024-01-30T08:09:34.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa01ee410 con 0x7f2fa00a9e10 2024-01-30T08:09:34.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f96a00640 1 -- 172.21.15.50:0/3511635790 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980050d0 con 0x7f2fa00a9e10 2024-01-30T08:09:34.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa0099c30 con 0x7f2fa00a9e10 2024-01-30T08:09:34.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa0067cc0 con 0x7f2fa00a9e10 2024-01-30T08:09:34.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.026+0000 7f2f96a00640 1 -- 172.21.15.50:0/3511635790 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2f98005230 con 0x7f2fa00a9e10 2024-01-30T08:09:34.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.030+0000 7f2f96a00640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f78066530 0x7f2f780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.030+0000 7f2f96a00640 1 -- 172.21.15.50:0/3511635790 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f98084080 con 0x7f2fa00a9e10 2024-01-30T08:09:34.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.030+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f78066530 0x7f2f780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.030+0000 7f2f9ea00640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f78066530 0x7f2f780689f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f900af000 tx=0x7f2f90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.034+0000 7f2f96a00640 1 -- 172.21.15.50:0/3511635790 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2f98050f50 con 0x7f2fa00a9e10 2024-01-30T08:09:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.194+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fa0067cc0 con 0x7f2fa00a9e10 2024-01-30T08:09:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.194+0000 7f2f96a00640 1 -- 172.21.15.50:0/3511635790 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f98054570 con 0x7f2fa00a9e10 2024-01-30T08:09:34.195 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f78066530 msgr2=0x7f2f780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f78066530 0x7f2f780689f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f900af000 tx=0x7f2f90008040 comp rx=0 tx=0).stop 2024-01-30T08:09:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fa00a9e10 msgr2=0x7f2fa01f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fa00a9e10 0x7f2fa01f0e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006f4f0 tx=0x7f2f9800ec00 comp rx=0 tx=0).stop 2024-01-30T08:09:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 shutdown_connections 2024-01-30T08:09:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f78066530 0x7f2f780689f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fa00a9e10 0x7f2fa01f0e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fa006cd20 0x7f2fa00a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 --2- 172.21.15.50:0/3511635790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f80003b60 0x7f2fa00a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 >> 172.21.15.50:0/3511635790 conn(0x7f2fa00c6c60 msgr2=0x7f2fa0157640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 shutdown_connections 2024-01-30T08:09:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.198+0000 7f2fa5800640 1 -- 172.21.15.50:0/3511635790 wait complete. 2024-01-30T08:09:34.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.362+0000 7fdda4400640 1 Processor -- start 2024-01-30T08:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.362+0000 7fdda4400640 1 -- start start 2024-01-30T08:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.362+0000 7fdda4400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c06c960 0x7fdd9c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.362+0000 7fdda4400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0c22b0 con 0x7fdd9c071e10 2024-01-30T08:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.362+0000 7fdda4400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0c5890 con 0x7fdd9c154290 2024-01-30T08:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.362+0000 7fdda4400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0c52d0 con 0x7fdd9c06c960 2024-01-30T08:09:34.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdd9c071e10 0x7fdd9c0c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53894/0 (socket says 172.21.15.50:53894) 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1a00640 1 -- 172.21.15.50:0/2948538533 learned_addr learned my addr 172.21.15.50:0/2948538533 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c06c960 0x7fdd9c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150580547 0 0) 0x7fdd9c0c22b0 con 0x7fdd9c071e10 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd7c003530 con 0x7fdd9c071e10 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386237858 0 0) 0x7fdd9c0c5890 con 0x7fdd9c154290 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd9c0c22b0 con 0x7fdd9c154290 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96671559 0 0) 0x7fdd7c003530 con 0x7fdd9c071e10 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c06c960 msgr2=0x7fdd9c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c06c960 0x7fdd9c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 >> v1:172.21.15.125:6789/0 conn(0x7fdd9c154290 legacy=0x7fdd9c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0c55b0 con 0x7fdd9c071e10 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fdd8c001680 con 0x7fdd9c071e10 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 >> v1:172.21.15.50:6789/0 conn(0x7fdd9c071e10 legacy=0x7fdd9c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd7c003b40 0x7fdd7c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd7c005190 0x7fdd7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0c52d0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c00c0c0 con 0x7fdd7c005190 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c00c280 con 0x7fdd7c003b40 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c06c960 0x7fdd9c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1a00640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd7c003b40 0x7fdd7c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda2400640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd7c005190 0x7fdd7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 -- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd7c003b40 msgr2=0x7fdd7c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd7c003b40 0x7fdd7c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 -- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd7c005190 msgr2=0x7fdd7c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd7c005190 0x7fdd7c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.366+0000 7fdda1000640 1 -- 172.21.15.50:0/2948538533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c003530 con 0x7fdd7c0047d0 2024-01-30T08:09:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda1000640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd7c004c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c06b640 tx=0x7fdd8401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de86f12f60707afa server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84004030 con 0x7fdd7c0047d0 2024-01-30T08:09:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84004190 con 0x7fdd7c0047d0 2024-01-30T08:09:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdd9be00640 1 -- 172.21.15.50:0/2948538533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84004520 con 0x7fdd7c0047d0 2024-01-30T08:09:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 -- 172.21.15.50:0/2948538533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 msgr2=0x7fdd7c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 --2- 172.21.15.50:0/2948538533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd7c004c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c06b640 tx=0x7fdd8401ca60 comp rx=0 tx=0).stop 2024-01-30T08:09:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda2400640 1 -- 172.21.15.50:0/2948538533 reap_dead start 2024-01-30T08:09:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 -- 172.21.15.50:0/2948538533 shutdown_connections 2024-01-30T08:09:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 -- 172.21.15.50:0/2948538533 >> 172.21.15.50:0/2948538533 conn(0x7fdd9c0c5b30 msgr2=0x7fdd9c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 -- 172.21.15.50:0/2948538533 shutdown_connections 2024-01-30T08:09:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 -- 172.21.15.50:0/2948538533 wait complete. 2024-01-30T08:09:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 Processor -- start 2024-01-30T08:09:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.370+0000 7fdda4400640 1 -- start start 2024-01-30T08:09:34.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd9c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9c1523b0 0x7fdd9c1f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c1f0d60 0x7fdd9c0bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c1540a0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c1521b0 con 0x7fdd9c1523b0 2024-01-30T08:09:34.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c1f11e0 con 0x7fdd9c1f0d60 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd9c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd9c0c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55272/0 (socket says 172.21.15.50:55272) 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 -- 172.21.15.50:0/1403297030 learned_addr learned my addr 172.21.15.50:0/1403297030 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda2400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c1f0d60 0x7fdd9c0bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1000640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9c1523b0 0x7fdd9c1f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 -- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c1f0d60 msgr2=0x7fdd9c0bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c1f0d60 0x7fdd9c0bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 -- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9c1523b0 msgr2=0x7fdd9c1f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9c1523b0 0x7fdd9c1f0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 -- 172.21.15.50:0/1403297030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0a9170 con 0x7fdd7c0047d0 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1000640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9c1523b0 0x7fdd9c1f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda2400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c1f0d60 0x7fdd9c0bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda1a00640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd9c0c61a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c004eb0 tx=0x7fdd8c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdd99600640 1 -- 172.21.15.50:0/1403297030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00f750 con 0x7fdd7c0047d0 2024-01-30T08:09:34.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdd99600640 1 -- 172.21.15.50:0/1403297030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00f8f0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdd99600640 1 -- 172.21.15.50:0/1403297030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00fca0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c0a9710 con 0x7fdd7c0047d0 2024-01-30T08:09:34.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c0c66e0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.374+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c074a20 con 0x7fdd7c0047d0 2024-01-30T08:09:34.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.378+0000 7fdd99600640 1 -- 172.21.15.50:0/1403297030 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdd8c01d460 con 0x7fdd7c0047d0 2024-01-30T08:09:34.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.378+0000 7fdd99600640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd74066500 0x7fdd740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.378+0000 7fdd99600640 1 -- 172.21.15.50:0/1403297030 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd8c0842e0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.378+0000 7fdda1000640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd74066500 0x7fdd740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.378+0000 7fdda1000640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd74066500 0x7fdd740689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd840ad000 tx=0x7fdd840046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.382+0000 7fdd99600640 1 -- 172.21.15.50:0/1403297030 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdd8c0511b0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.542+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdd9c0a5530 con 0x7fdd7c0047d0 2024-01-30T08:09:34.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.542+0000 7fdd99600640 1 -- 172.21.15.50:0/1403297030 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdd8c0547d0 con 0x7fdd7c0047d0 2024-01-30T08:09:34.543 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.542+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd74066500 msgr2=0x7fdd740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.542+0000 7fdda4400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd74066500 0x7fdd740689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd840ad000 tx=0x7fdd840046d0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 msgr2=0x7fdd9c0c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd9c0c61a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c004eb0 tx=0x7fdd8c007430 comp rx=0 tx=0).stop 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 shutdown_connections 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd9c1523b0 0x7fdd9c1f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd74066500 0x7fdd740689c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd9c1f0d60 0x7fdd9c0bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 --2- 172.21.15.50:0/1403297030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd7c0047d0 0x7fdd9c0c61a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 >> 172.21.15.50:0/1403297030 conn(0x7fdd9c0c5b30 msgr2=0x7fdd9c154700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 shutdown_connections 2024-01-30T08:09:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.546+0000 7fdda4400640 1 -- 172.21.15.50:0/1403297030 wait complete. 2024-01-30T08:09:34.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-30T08:09:34.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff210200640 1 Processor -- start 2024-01-30T08:09:34.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff210200640 1 -- start start 2024-01-30T08:09:34.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff210200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2080ba370 0x7ff2080c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff210200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2080c2470 con 0x7ff208071f40 2024-01-30T08:09:34.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff210200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff208072d30 con 0x7ff20806a740 2024-01-30T08:09:34.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff210200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff208158940 con 0x7ff2080ba370 2024-01-30T08:09:34.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff20d800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff208071f40 0x7ff208071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53896/0 (socket says 172.21.15.50:53896) 2024-01-30T08:09:34.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff20d800640 1 -- 172.21.15.50:0/4144836032 learned_addr learned my addr 172.21.15.50:0/4144836032 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:34.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff20ce00640 1 --2- 172.21.15.50:0/4144836032 >> v2:172.21.15.125:3300/0 conn(0x7ff2080ba370 0x7ff2080c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff207e00640 1 -- 172.21.15.50:0/4144836032 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379657929 0 0) 0x7ff2080c2470 con 0x7ff208071f40 2024-01-30T08:09:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff207e00640 1 -- 172.21.15.50:0/4144836032 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e8003530 con 0x7ff208071f40 2024-01-30T08:09:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff207e00640 1 -- 172.21.15.50:0/4144836032 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505881495 0 0) 0x7ff208072d30 con 0x7ff20806a740 2024-01-30T08:09:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff207e00640 1 -- 172.21.15.50:0/4144836032 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2080c2470 con 0x7ff20806a740 2024-01-30T08:09:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff20ce00640 1 -- 172.21.15.50:0/4144836032 >> v1:172.21.15.125:6789/0 conn(0x7ff20806a740 legacy=0x7ff20815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff20ce00640 1 -- 172.21.15.50:0/4144836032 >> v1:172.21.15.50:6789/0 conn(0x7ff208071f40 legacy=0x7ff208071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.710+0000 7ff20ce00640 1 -- 172.21.15.50:0/4144836032 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208158c20 con 0x7ff2080ba370 2024-01-30T08:09:34.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff20ce00640 1 --2- 172.21.15.50:0/4144836032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 0x7ff2080c2ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00097f0 tx=0x7ff1f001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ca46e37cc19a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff207e00640 1 -- 172.21.15.50:0/4144836032 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00ab600 con 0x7ff2080ba370 2024-01-30T08:09:34.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff207e00640 1 -- 172.21.15.50:0/4144836032 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00a7050 con 0x7ff2080ba370 2024-01-30T08:09:34.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff207e00640 1 -- 172.21.15.50:0/4144836032 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00ab980 con 0x7ff2080ba370 2024-01-30T08:09:34.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff210200640 1 -- 172.21.15.50:0/4144836032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 msgr2=0x7ff2080c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff210200640 1 --2- 172.21.15.50:0/4144836032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 0x7ff2080c2ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00097f0 tx=0x7ff1f001c480 comp rx=0 tx=0).stop 2024-01-30T08:09:34.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff210200640 1 -- 172.21.15.50:0/4144836032 shutdown_connections 2024-01-30T08:09:34.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff210200640 1 --2- 172.21.15.50:0/4144836032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 0x7ff2080c2ea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.714+0000 7ff210200640 1 -- 172.21.15.50:0/4144836032 >> 172.21.15.50:0/4144836032 conn(0x7ff2080c6c20 msgr2=0x7ff2080c7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:34.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 -- 172.21.15.50:0/4144836032 shutdown_connections 2024-01-30T08:09:34.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 -- 172.21.15.50:0/4144836032 wait complete. 2024-01-30T08:09:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 Processor -- start 2024-01-30T08:09:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 -- start start 2024-01-30T08:09:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff20806a740 0x7ff2081f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff208071f40 0x7ff20814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 0x7ff2080be780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080c10e0 con 0x7ff20806a740 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080be2f0 con 0x7ff2080ba370 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080bdfc0 con 0x7ff208071f40 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff20806a740 0x7ff2081f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff20806a740 0x7ff2081f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55288/0 (socket says 172.21.15.50:55288) 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 -- 172.21.15.50:0/1496271500 learned_addr learned my addr 172.21.15.50:0/1496271500 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20e200640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 0x7ff2080be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20ce00640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff208071f40 0x7ff20814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 -- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff208071f40 msgr2=0x7ff20814fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff208071f40 0x7ff20814fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 -- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 msgr2=0x7ff2080be780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 0x7ff2080be780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 -- 172.21.15.50:0/1496271500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0009420 con 0x7ff20806a740 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff20d800640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff20806a740 0x7ff2081f15e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c500 tx=0x7ff1f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff205600640 1 -- 172.21.15.50:0/1496271500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8005cf0 con 0x7ff20806a740 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff205600640 1 -- 172.21.15.50:0/1496271500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8005e50 con 0x7ff20806a740 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff205600640 1 -- 172.21.15.50:0/1496271500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80072f0 con 0x7ff20806a740 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.718+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2081f1f30 con 0x7ff20806a740 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.722+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2080bce10 con 0x7ff20806a740 2024-01-30T08:09:34.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.722+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff208067a10 con 0x7ff20806a740 2024-01-30T08:09:34.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.722+0000 7ff205600640 1 -- 172.21.15.50:0/1496271500 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff1f8007450 con 0x7ff20806a740 2024-01-30T08:09:34.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.722+0000 7ff205600640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1e0066500 0x7ff1e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:34.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.722+0000 7ff205600640 1 -- 172.21.15.50:0/1496271500 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff1f8083800 con 0x7ff20806a740 2024-01-30T08:09:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.722+0000 7ff20ce00640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1e0066500 0x7ff1e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.726+0000 7ff20ce00640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1e0066500 0x7ff1e00689c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00ad000 tx=0x7ff1f00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.726+0000 7ff205600640 1 -- 172.21.15.50:0/1496271500 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff1f8050780 con 0x7ff20806a740 2024-01-30T08:09:34.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.898+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff2081f20c0 con 0x7ff20806a740 2024-01-30T08:09:34.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.898+0000 7ff205600640 1 -- 172.21.15.50:0/1496271500 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff1f8053da0 con 0x7ff20806a740 2024-01-30T08:09:34.899 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-01-30T08:09:34.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1e0066500 msgr2=0x7ff1e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1e0066500 0x7ff1e00689c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00ad000 tx=0x7ff1f00a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff20806a740 msgr2=0x7ff2081f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff20806a740 0x7ff2081f15e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c500 tx=0x7ff1f800c9c0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 shutdown_connections 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2080ba370 0x7ff2080be780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1e0066500 0x7ff1e00689c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff208071f40 0x7ff20814fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 --2- 172.21.15.50:0/1496271500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff20806a740 0x7ff2081f15e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 >> 172.21.15.50:0/1496271500 conn(0x7ff2080c6c20 msgr2=0x7ff2080c4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 shutdown_connections 2024-01-30T08:09:34.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:34.902+0000 7ff210200640 1 -- 172.21.15.50:0/1496271500 wait complete. 2024-01-30T08:09:34.921 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-30T08:09:34.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:34.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-30T08:09:34.956 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:09:34.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:34.957 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-30T08:09:35.010 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:09:35.010 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:35.020 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:09:35.020 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:35.070 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:09:35.070 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:09:35.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:35.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 Processor -- start 2024-01-30T08:09:35.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 -- start start 2024-01-30T08:09:35.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44cc0c4e00 0x7f44cc0729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f44cc0a4e50 0x7f44cc0a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a9ad0 0x7f44cc0c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0c42d0 con 0x7f44cc0c4e00 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0c3e40 con 0x7f44cc0a4e50 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d2e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0a8c20 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44cc0c4e00 0x7f44cc0729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44cc0c4e00 0x7f44cc0729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55298/0 (socket says 172.21.15.50:55298) 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 -- 172.21.15.50:0/2915935000 learned_addr learned my addr 172.21.15.50:0/2915935000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44d0e00640 1 --2- 172.21.15.50:0/2915935000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a9ad0 0x7f44cc0c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cb400640 1 --2- 172.21.15.50:0/2915935000 >> v2:172.21.15.125:3300/0 conn(0x7f44cc0a4e50 0x7f44cc0a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 -- 172.21.15.50:0/2915935000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a9ad0 msgr2=0x7f44cc0c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 --2- 172.21.15.50:0/2915935000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a9ad0 0x7f44cc0c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 -- 172.21.15.50:0/2915935000 >> v2:172.21.15.125:3300/0 conn(0x7f44cc0a4e50 msgr2=0x7f44cc0a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:35.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 --2- 172.21.15.50:0/2915935000 >> v2:172.21.15.125:3300/0 conn(0x7f44cc0a4e50 0x7f44cc0a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.266+0000 7f44cbe00640 1 -- 172.21.15.50:0/2915935000 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0c3b10 con 0x7f44cc0c4e00 2024-01-30T08:09:35.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44cbe00640 1 --2- 172.21.15.50:0/2915935000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0c4e00 0x7f44cc0729a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0a5300 tx=0x7f44bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b716cf4d9c4193 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44caa00640 1 -- 172.21.15.50:0/2915935000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0ab600 con 0x7f44cc0c4e00 2024-01-30T08:09:35.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44caa00640 1 -- 172.21.15.50:0/2915935000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc0a7050 con 0x7f44cc0c4e00 2024-01-30T08:09:35.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44caa00640 1 -- 172.21.15.50:0/2915935000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0ab980 con 0x7f44cc0c4e00 2024-01-30T08:09:35.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 -- 172.21.15.50:0/2915935000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0c4e00 msgr2=0x7f44cc0729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 --2- 172.21.15.50:0/2915935000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0c4e00 0x7f44cc0729a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0a5300 tx=0x7f44bc01c500 comp rx=0 tx=0).stop 2024-01-30T08:09:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 -- 172.21.15.50:0/2915935000 shutdown_connections 2024-01-30T08:09:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 --2- 172.21.15.50:0/2915935000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a9ad0 0x7f44cc0c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 --2- 172.21.15.50:0/2915935000 >> v2:172.21.15.125:3300/0 conn(0x7f44cc0a4e50 0x7f44cc0a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 --2- 172.21.15.50:0/2915935000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0c4e00 0x7f44cc0729a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 -- 172.21.15.50:0/2915935000 >> 172.21.15.50:0/2915935000 conn(0x7f44cc0c5b50 msgr2=0x7f44cc0c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 -- 172.21.15.50:0/2915935000 shutdown_connections 2024-01-30T08:09:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 -- 172.21.15.50:0/2915935000 wait complete. 2024-01-30T08:09:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.270+0000 7f44d2e00640 1 Processor -- start 2024-01-30T08:09:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 -- start start 2024-01-30T08:09:35.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a4e50 0x7f44cc1ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0a9ad0 0x7f44cc0a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44cc0c4e00 0x7f44cc15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1f0e00 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc159ac0 con 0x7f44cc0c4e00 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0aa940 con 0x7f44cc0a4e50 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0a9ad0 0x7f44cc0a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0a9ad0 0x7f44cc0a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55302/0 (socket says 172.21.15.50:55302) 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 -- 172.21.15.50:0/4219187613 learned_addr learned my addr 172.21.15.50:0/4219187613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d0e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44cc0c4e00 0x7f44cc15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cbe00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a4e50 0x7f44cc1ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 -- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a4e50 msgr2=0x7f44cc1ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a4e50 0x7f44cc1ec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 -- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44cc0c4e00 msgr2=0x7f44cc15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44cc0c4e00 0x7f44cc15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 -- 172.21.15.50:0/4219187613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0094d0 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44cb400640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0a9ad0 0x7f44cc0a62b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44b400d830 tx=0x7f44b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44c3e00640 1 -- 172.21.15.50:0/4219187613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40096a0 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44c3e00640 1 -- 172.21.15.50:0/4219187613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4009800 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc1f0880 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44c3e00640 1 -- 172.21.15.50:0/4219187613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4009b70 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc159750 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.274+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc074a20 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.278+0000 7f44c3e00640 1 -- 172.21.15.50:0/4219187613 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f44b4014410 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.278+0000 7f44c3e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f44a4066530 0x7f44a40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.278+0000 7f44c3e00640 1 -- 172.21.15.50:0/4219187613 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44b4084a10 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.278+0000 7f44cbe00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f44a4066530 0x7f44a40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.278+0000 7f44cbe00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f44a4066530 0x7f44a40689f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0ad000 tx=0x7f44bc0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.282+0000 7f44c3e00640 1 -- 172.21.15.50:0/4219187613 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f44b4051990 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.442+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44cc159c00 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.442+0000 7f44c3e00640 1 -- 172.21.15.50:0/4219187613 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18735 (secure 0 0 0) 0x7f44b4054fb0 con 0x7f44cc0a9ad0 2024-01-30T08:09:35.444 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:35.444 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:30.858267+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f44a4066530 msgr2=0x7f44a40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f44a4066530 0x7f44a40689f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0ad000 tx=0x7f44bc0a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0a9ad0 msgr2=0x7f44cc0a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0a9ad0 0x7f44cc0a62b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44b400d830 tx=0x7f44b400dcf0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 shutdown_connections 2024-01-30T08:09:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44cc0c4e00 0x7f44cc15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f44a4066530 0x7f44a40689f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44cc0a9ad0 0x7f44cc0a62b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 --2- 172.21.15.50:0/4219187613 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44cc0a4e50 0x7f44cc1ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 >> 172.21.15.50:0/4219187613 conn(0x7f44cc0c5b50 msgr2=0x7f44cc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 shutdown_connections 2024-01-30T08:09:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.446+0000 7f44d2e00640 1 -- 172.21.15.50:0/4219187613 wait complete. 2024-01-30T08:09:35.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:35.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:35.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 Processor -- start 2024-01-30T08:09:35.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 -- start start 2024-01-30T08:09:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd988071e10 0x7fd9880727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd98806c960 0x7fd9880c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd9880c4800 0x7fd988154290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9880c22b0 con 0x7fd98806c960 2024-01-30T08:09:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9880c5890 con 0x7fd9880c4800 2024-01-30T08:09:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd98f600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880c52d0 con 0x7fd988071e10 2024-01-30T08:09:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd987e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd98806c960 0x7fd9880c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd987e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd98806c960 0x7fd9880c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55318/0 (socket says 172.21.15.50:55318) 2024-01-30T08:09:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.610+0000 7fd987e00640 1 -- 172.21.15.50:0/2538012548 learned_addr learned my addr 172.21.15.50:0/2538012548 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd98cc00640 1 --2- 172.21.15.50:0/2538012548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd988071e10 0x7fd9880727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd98d600640 1 --2- 172.21.15.50:0/2538012548 >> v2:172.21.15.125:3300/0 conn(0x7fd9880c4800 0x7fd988154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987e00640 1 -- 172.21.15.50:0/2538012548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd988071e10 msgr2=0x7fd9880727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987e00640 1 --2- 172.21.15.50:0/2538012548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd988071e10 0x7fd9880727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987e00640 1 -- 172.21.15.50:0/2538012548 >> v2:172.21.15.125:3300/0 conn(0x7fd9880c4800 msgr2=0x7fd988154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:35.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987e00640 1 --2- 172.21.15.50:0/2538012548 >> v2:172.21.15.125:3300/0 conn(0x7fd9880c4800 0x7fd988154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987e00640 1 -- 172.21.15.50:0/2538012548 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9880c55b0 con 0x7fd98806c960 2024-01-30T08:09:35.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd98d600640 1 --2- 172.21.15.50:0/2538012548 >> v2:172.21.15.125:3300/0 conn(0x7fd9880c4800 0x7fd988154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987e00640 1 --2- 172.21.15.50:0/2538012548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd98806c960 0x7fd9880c42c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd988155330 tx=0x7fd97001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01c31bfb59f17df server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987400640 1 -- 172.21.15.50:0/2538012548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700a4ea0 con 0x7fd98806c960 2024-01-30T08:09:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987400640 1 -- 172.21.15.50:0/2538012548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9700a7050 con 0x7fd98806c960 2024-01-30T08:09:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.614+0000 7fd987400640 1 -- 172.21.15.50:0/2538012548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700ab820 con 0x7fd98806c960 2024-01-30T08:09:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- 172.21.15.50:0/2538012548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd98806c960 msgr2=0x7fd9880c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 --2- 172.21.15.50:0/2538012548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd98806c960 0x7fd9880c42c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd988155330 tx=0x7fd97001c3e0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- 172.21.15.50:0/2538012548 shutdown_connections 2024-01-30T08:09:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 --2- 172.21.15.50:0/2538012548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd98806c960 0x7fd9880c42c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 --2- 172.21.15.50:0/2538012548 >> v2:172.21.15.125:3300/0 conn(0x7fd9880c4800 0x7fd988154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 --2- 172.21.15.50:0/2538012548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd988071e10 0x7fd9880727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- 172.21.15.50:0/2538012548 >> 172.21.15.50:0/2538012548 conn(0x7fd9880c5b30 msgr2=0x7fd9880c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- 172.21.15.50:0/2538012548 shutdown_connections 2024-01-30T08:09:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- 172.21.15.50:0/2538012548 wait complete. 2024-01-30T08:09:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 Processor -- start 2024-01-30T08:09:35.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- start start 2024-01-30T08:09:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98806c960 0x7fd9881f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd988071e10 0x7fd988159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880c4800 0x7fd988146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98814f280 con 0x7fd9880c4800 2024-01-30T08:09:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98814fe20 con 0x7fd988071e10 2024-01-30T08:09:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98f600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9881493d0 con 0x7fd98806c960 2024-01-30T08:09:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880c4800 0x7fd988146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880c4800 0x7fd988146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55320/0 (socket says 172.21.15.50:55320) 2024-01-30T08:09:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98d600640 1 -- 172.21.15.50:0/1096341970 learned_addr learned my addr 172.21.15.50:0/1096341970 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd98cc00640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98806c960 0x7fd9881f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.618+0000 7fd987e00640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd988071e10 0x7fd988159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98d600640 1 -- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98806c960 msgr2=0x7fd9881f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98d600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98806c960 0x7fd9881f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98d600640 1 -- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd988071e10 msgr2=0x7fd988159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98d600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd988071e10 0x7fd988159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98d600640 1 -- 172.21.15.50:0/1096341970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700094d0 con 0x7fd9880c4800 2024-01-30T08:09:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd987e00640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd988071e10 0x7fd988159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98d600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880c4800 0x7fd988146bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd980007e20 tx=0x7fd98000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd984c00640 1 -- 172.21.15.50:0/1096341970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980003ba0 con 0x7fd9880c4800 2024-01-30T08:09:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd984c00640 1 -- 172.21.15.50:0/1096341970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98000f040 con 0x7fd9880c4800 2024-01-30T08:09:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd984c00640 1 -- 172.21.15.50:0/1096341970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000de80 con 0x7fd9880c4800 2024-01-30T08:09:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd988149f80 con 0x7fd9880c4800 2024-01-30T08:09:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98814a520 con 0x7fd9880c4800 2024-01-30T08:09:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98814fff0 con 0x7fd9880c4800 2024-01-30T08:09:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.622+0000 7fd984c00640 1 -- 172.21.15.50:0/1096341970 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd980004030 con 0x7fd9880c4800 2024-01-30T08:09:35.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.626+0000 7fd984c00640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd960066500 0x7fd9600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.626+0000 7fd984c00640 1 -- 172.21.15.50:0/1096341970 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd980084580 con 0x7fd9880c4800 2024-01-30T08:09:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.626+0000 7fd98cc00640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd960066500 0x7fd9600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.626+0000 7fd98cc00640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd960066500 0x7fd9600689c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd978009ae0 tx=0x7fd978009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.630+0000 7fd984c00640 1 -- 172.21.15.50:0/1096341970 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd98814fff0 con 0x7fd9880c4800 2024-01-30T08:09:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd98814fff0 con 0x7fd9880c4800 2024-01-30T08:09:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd984c00640 1 -- 172.21.15.50:0/1096341970 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd98814fff0 con 0x7fd9880c4800 2024-01-30T08:09:35.794 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd960066500 msgr2=0x7fd9600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd960066500 0x7fd9600689c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd978009ae0 tx=0x7fd978009190 comp rx=0 tx=0).stop 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880c4800 msgr2=0x7fd988146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880c4800 0x7fd988146bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd980007e20 tx=0x7fd98000d4a0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 shutdown_connections 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd988071e10 0x7fd988159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd960066500 0x7fd9600689c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880c4800 0x7fd988146bc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 --2- 172.21.15.50:0/1096341970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd98806c960 0x7fd9881f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 >> 172.21.15.50:0/1096341970 conn(0x7fd9880c5b30 msgr2=0x7fd9880c19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 shutdown_connections 2024-01-30T08:09:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.794+0000 7fd98f600640 1 -- 172.21.15.50:0/1096341970 wait complete. 2024-01-30T08:09:35.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.958+0000 7f10a7e00640 1 Processor -- start 2024-01-30T08:09:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.958+0000 7f10a7e00640 1 -- start start 2024-01-30T08:09:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c50d0 0x7f10a0156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a7e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f10a00c7ae0 0x7f10a01566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a7e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00c8a50 con 0x7f10a00c5c90 2024-01-30T08:09:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a7e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00c7070 con 0x7f10a00c7ae0 2024-01-30T08:09:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a7e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00c8d30 con 0x7f10a00c50d0 2024-01-30T08:09:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a5e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f10a00c5c90 0x7f10a00c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53910/0 (socket says 172.21.15.50:53910) 2024-01-30T08:09:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a5e00640 1 -- 172.21.15.50:0/1089807937 learned_addr learned my addr 172.21.15.50:0/1089807937 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a4a00640 1 --2- 172.21.15.50:0/1089807937 >> v2:172.21.15.125:3300/0 conn(0x7f10a00c7ae0 0x7f10a01566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a5400640 1 --2- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c50d0 0x7f10a0156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f109fe00640 1 -- 172.21.15.50:0/1089807937 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268266230 0 0) 0x7f10a00c8a50 con 0x7f10a00c5c90 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f109fe00640 1 -- 172.21.15.50:0/1089807937 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1080003530 con 0x7f10a00c5c90 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a4a00640 1 -- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c50d0 msgr2=0x7f10a0156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f109fe00640 1 -- 172.21.15.50:0/1089807937 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1337476970 0 0) 0x7f1080003530 con 0x7f10a00c5c90 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a4a00640 1 --2- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c50d0 0x7f10a0156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a4a00640 1 -- 172.21.15.50:0/1089807937 >> v1:172.21.15.50:6789/0 conn(0x7f10a00c5c90 legacy=0x7f10a00c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a4a00640 1 -- 172.21.15.50:0/1089807937 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00c66d0 con 0x7f10a00c7ae0 2024-01-30T08:09:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.962+0000 7f10a5400640 1 --2- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c50d0 0x7f10a0156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a4a00640 1 --2- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c7ae0 0x7f10a01566d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10880097c0 tx=0x7f108801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7648557db4a9f1ff server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f109fe00640 1 -- 172.21.15.50:0/1089807937 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098001a00 con 0x7f10a00c7ae0 2024-01-30T08:09:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f109fe00640 1 -- 172.21.15.50:0/1089807937 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10880a7050 con 0x7f10a00c7ae0 2024-01-30T08:09:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f109fe00640 1 -- 172.21.15.50:0/1089807937 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880ab620 con 0x7f10a00c7ae0 2024-01-30T08:09:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 -- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c7ae0 msgr2=0x7f10a01566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 --2- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c7ae0 0x7f10a01566d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10880097c0 tx=0x7f108801c2e0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 -- 172.21.15.50:0/1089807937 shutdown_connections 2024-01-30T08:09:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 --2- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c7ae0 0x7f10a01566d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 --2- 172.21.15.50:0/1089807937 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c50d0 0x7f10a0156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 -- 172.21.15.50:0/1089807937 >> 172.21.15.50:0/1089807937 conn(0x7f10a00727c0 msgr2=0x7f10a006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 -- 172.21.15.50:0/1089807937 shutdown_connections 2024-01-30T08:09:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 -- 172.21.15.50:0/1089807937 wait complete. 2024-01-30T08:09:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 Processor -- start 2024-01-30T08:09:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.966+0000 7f10a7e00640 1 -- start start 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c50d0 0x7f10a0153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c5c90 0x7f10a0144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00c7ae0 0x7f10a0146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0153890 con 0x7f10a00c7ae0 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0146220 con 0x7f10a00c50d0 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0146800 con 0x7f10a00c5c90 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00c7ae0 0x7f10a0146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00c7ae0 0x7f10a0146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55336/0 (socket says 172.21.15.50:55336) 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 -- 172.21.15.50:0/71961418 learned_addr learned my addr 172.21.15.50:0/71961418 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a4a00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c5c90 0x7f10a0144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5400640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c50d0 0x7f10a0153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 -- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c5c90 msgr2=0x7f10a0144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c5c90 0x7f10a0144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 -- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c50d0 msgr2=0x7f10a0153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c50d0 0x7f10a0153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 -- 172.21.15.50:0/71961418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090009420 con 0x7f10a00c7ae0 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a5e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00c7ae0 0x7f10a0146c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1098001fb0 tx=0x7f109800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f109d600640 1 -- 172.21.15.50:0/71961418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098012400 con 0x7f10a00c7ae0 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f109d600640 1 -- 172.21.15.50:0/71961418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1098012560 con 0x7f10a00c7ae0 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f109d600640 1 -- 172.21.15.50:0/71961418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980128f0 con 0x7f10a00c7ae0 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1088009420 con 0x7f10a00c7ae0 2024-01-30T08:09:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a0146490 con 0x7f10a00c7ae0 2024-01-30T08:09:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.970+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0067cc0 con 0x7f10a00c7ae0 2024-01-30T08:09:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.974+0000 7f109d600640 1 -- 172.21.15.50:0/71961418 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1098012a50 con 0x7f10a00c7ae0 2024-01-30T08:09:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.974+0000 7f109d600640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1078066500 0x7f10780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.974+0000 7f109d600640 1 -- 172.21.15.50:0/71961418 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1098084910 con 0x7f10a00c7ae0 2024-01-30T08:09:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.974+0000 7f10a5400640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1078066500 0x7f10780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.974+0000 7f10a5400640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1078066500 0x7f10780689c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1090009cf0 tx=0x7f1090009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:35.978+0000 7f109d600640 1 -- 172.21.15.50:0/71961418 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1098051890 con 0x7f10a00c7ae0 2024-01-30T08:09:36.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.134+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10a0074a20 con 0x7f10a00c7ae0 2024-01-30T08:09:36.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.134+0000 7f109d600640 1 -- 172.21.15.50:0/71961418 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1098054eb0 con 0x7f10a00c7ae0 2024-01-30T08:09:36.136 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1078066500 msgr2=0x7f10780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1078066500 0x7f10780689c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1090009cf0 tx=0x7f1090009190 comp rx=0 tx=0).stop 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00c7ae0 msgr2=0x7f10a0146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00c7ae0 0x7f10a0146c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1098001fb0 tx=0x7f109800a430 comp rx=0 tx=0).stop 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 shutdown_connections 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1078066500 0x7f10780689c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10a00c7ae0 0x7f10a0146c50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10a00c5c90 0x7f10a0144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 --2- 172.21.15.50:0/71961418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10a00c50d0 0x7f10a0153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 >> 172.21.15.50:0/71961418 conn(0x7f10a00727c0 msgr2=0x7f10a00c3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:36.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 shutdown_connections 2024-01-30T08:09:36.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.138+0000 7f10a7e00640 1 -- 172.21.15.50:0/71961418 wait complete. 2024-01-30T08:09:36.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:36.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.302+0000 7f3074600640 1 Processor -- start 2024-01-30T08:09:36.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.302+0000 7f3074600640 1 -- start start 2024-01-30T08:09:36.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.302+0000 7f3074600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.302+0000 7f3074600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0c54e0 con 0x7f306c0a4da0 2024-01-30T08:09:36.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.302+0000 7f3074600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c152bf0 con 0x7f306c0c04b0 2024-01-30T08:09:36.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.302+0000 7f3074600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c072d90 con 0x7f306c14fbf0 2024-01-30T08:09:36.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f3071200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f306c0a4da0 0x7f306c0c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53912/0 (socket says 172.21.15.50:53912) 2024-01-30T08:09:36.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f3071200640 1 -- 172.21.15.50:0/2449724768 learned_addr learned my addr 172.21.15.50:0/2449724768 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f3071c00640 1 --2- 172.21.15.50:0/2449724768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f306be00640 1 -- 172.21.15.50:0/2449724768 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577198731 0 0) 0x7f306c0c54e0 con 0x7f306c0a4da0 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f306be00640 1 -- 172.21.15.50:0/2449724768 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f304c003530 con 0x7f306c0a4da0 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f306be00640 1 -- 172.21.15.50:0/2449724768 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244791912 0 0) 0x7f306c152bf0 con 0x7f306c0c04b0 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f306be00640 1 -- 172.21.15.50:0/2449724768 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f306c0c54e0 con 0x7f306c0c04b0 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f3071c00640 1 -- 172.21.15.50:0/2449724768 >> v1:172.21.15.125:6789/0 conn(0x7f306c0c04b0 legacy=0x7f306c06ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f3071c00640 1 -- 172.21.15.50:0/2449724768 >> v1:172.21.15.50:6789/0 conn(0x7f306c0a4da0 legacy=0x7f306c0c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f3071c00640 1 -- 172.21.15.50:0/2449724768 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c1525e0 con 0x7f306c14fbf0 2024-01-30T08:09:36.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.306+0000 7f3071c00640 1 --2- 172.21.15.50:0/2449724768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c153080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f305c0097f0 tx=0x7f305c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e951649198014805 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f306be00640 1 -- 172.21.15.50:0/2449724768 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0ab600 con 0x7f306c14fbf0 2024-01-30T08:09:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f306be00640 1 -- 172.21.15.50:0/2449724768 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0a7050 con 0x7f306c14fbf0 2024-01-30T08:09:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f306be00640 1 -- 172.21.15.50:0/2449724768 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0ab980 con 0x7f306c14fbf0 2024-01-30T08:09:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- 172.21.15.50:0/2449724768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 msgr2=0x7f306c153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 --2- 172.21.15.50:0/2449724768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c153080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f305c0097f0 tx=0x7f305c01c430 comp rx=0 tx=0).stop 2024-01-30T08:09:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- 172.21.15.50:0/2449724768 shutdown_connections 2024-01-30T08:09:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 --2- 172.21.15.50:0/2449724768 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c153080 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- 172.21.15.50:0/2449724768 >> 172.21.15.50:0/2449724768 conn(0x7f306c0c5b30 msgr2=0x7f306c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- 172.21.15.50:0/2449724768 shutdown_connections 2024-01-30T08:09:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- 172.21.15.50:0/2449724768 wait complete. 2024-01-30T08:09:36.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 Processor -- start 2024-01-30T08:09:36.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- start start 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0a4da0 0x7f306c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f306c0c04b0 0x7f306c1f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c1ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1ecf30 con 0x7f306c0a4da0 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1ec940 con 0x7f306c0c04b0 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.310+0000 7f3074600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1f0e00 con 0x7f306c14fbf0 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0a4da0 0x7f306c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0a4da0 0x7f306c1559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55346/0 (socket says 172.21.15.50:55346) 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 -- 172.21.15.50:0/2271478941 learned_addr learned my addr 172.21.15.50:0/2271478941 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071200640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f306c0c04b0 0x7f306c1f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3072600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c1ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 -- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 msgr2=0x7f306c1ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c1ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 -- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f306c0c04b0 msgr2=0x7f306c1f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f306c0c04b0 0x7f306c1f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 -- 172.21.15.50:0/2271478941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009420 con 0x7f306c0a4da0 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071200640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f306c0c04b0 0x7f306c1f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3072600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c1ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3071c00640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0a4da0 0x7f306c1559b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f305c0097f0 tx=0x7f305c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3069600640 1 -- 172.21.15.50:0/2271478941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0b4610 con 0x7f306c0a4da0 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3069600640 1 -- 172.21.15.50:0/2271478941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0b4790 con 0x7f306c0a4da0 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c1ed890 con 0x7f306c0a4da0 2024-01-30T08:09:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3069600640 1 -- 172.21.15.50:0/2271478941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0b4b40 con 0x7f306c0a4da0 2024-01-30T08:09:36.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c1562e0 con 0x7f306c0a4da0 2024-01-30T08:09:36.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c074a20 con 0x7f306c0a4da0 2024-01-30T08:09:36.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.314+0000 7f3069600640 1 -- 172.21.15.50:0/2271478941 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f305c0b2040 con 0x7f306c0a4da0 2024-01-30T08:09:36.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.318+0000 7f3069600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3044066500 0x7f30440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.318+0000 7f3069600640 1 -- 172.21.15.50:0/2271478941 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f305c11e5b0 con 0x7f306c0a4da0 2024-01-30T08:09:36.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.318+0000 7f3071200640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3044066500 0x7f30440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.318+0000 7f3071200640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3044066500 0x7f30440689c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3054000f70 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.322+0000 7f3069600640 1 -- 172.21.15.50:0/2271478941 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f305c0eb5a0 con 0x7f306c0a4da0 2024-01-30T08:09:36.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f306c0c2320 con 0x7f306c0a4da0 2024-01-30T08:09:36.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3069600640 1 -- 172.21.15.50:0/2271478941 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f305c0eebc0 con 0x7f306c0a4da0 2024-01-30T08:09:36.482 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:36.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3044066500 msgr2=0x7f30440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3044066500 0x7f30440689c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3054000f70 tx=0x7f3054009040 comp rx=0 tx=0).stop 2024-01-30T08:09:36.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0a4da0 msgr2=0x7f306c1559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0a4da0 0x7f306c1559b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f305c0097f0 tx=0x7f305c0191d0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 shutdown_connections 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f306c0c04b0 0x7f306c1f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3044066500 0x7f30440689c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f306c14fbf0 0x7f306c1ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 --2- 172.21.15.50:0/2271478941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f306c0a4da0 0x7f306c1559b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 >> 172.21.15.50:0/2271478941 conn(0x7f306c0c5b30 msgr2=0x7f306c0bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 shutdown_connections 2024-01-30T08:09:36.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.482+0000 7f3074600640 1 -- 172.21.15.50:0/2271478941 wait complete. 2024-01-30T08:09:36.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad3a00640 1 Processor -- start 2024-01-30T08:09:36.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad3a00640 1 -- start start 2024-01-30T08:09:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad3a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc06f240 0x7f9acc06f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad3a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc158b70 con 0x7f9acc155500 2024-01-30T08:09:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad3a00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc0c8cf0 con 0x7f9acc0c1200 2024-01-30T08:09:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad3a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc157f60 con 0x7f9acc06f240 2024-01-30T08:09:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad1000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9acc155500 0x7f9acc0c85e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53924/0 (socket says 172.21.15.50:53924) 2024-01-30T08:09:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9ad1000640 1 -- 172.21.15.50:0/3062881574 learned_addr learned my addr 172.21.15.50:0/3062881574 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.646+0000 7f9acbe00640 1 --2- 172.21.15.50:0/3062881574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc06f240 0x7f9acc06f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acb400640 1 -- 172.21.15.50:0/3062881574 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125329983 0 0) 0x7f9acc158b70 con 0x7f9acc155500 2024-01-30T08:09:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acb400640 1 -- 172.21.15.50:0/3062881574 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aac003530 con 0x7f9acc155500 2024-01-30T08:09:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acb400640 1 -- 172.21.15.50:0/3062881574 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104052705 0 0) 0x7f9acc0c8cf0 con 0x7f9acc0c1200 2024-01-30T08:09:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acb400640 1 -- 172.21.15.50:0/3062881574 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9acc158b70 con 0x7f9acc0c1200 2024-01-30T08:09:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acbe00640 1 -- 172.21.15.50:0/3062881574 >> v1:172.21.15.125:6789/0 conn(0x7f9acc0c1200 legacy=0x7f9acc0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acbe00640 1 -- 172.21.15.50:0/3062881574 >> v1:172.21.15.50:6789/0 conn(0x7f9acc155500 legacy=0x7f9acc0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acbe00640 1 -- 172.21.15.50:0/3062881574 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc158240 con 0x7f9acc06f240 2024-01-30T08:09:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acbe00640 1 --2- 172.21.15.50:0/3062881574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc06f240 0x7f9acc06f6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40097f0 tx=0x7f9ab401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9784fb60d915b401 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acb400640 1 -- 172.21.15.50:0/3062881574 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40ab600 con 0x7f9acc06f240 2024-01-30T08:09:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acb400640 1 -- 172.21.15.50:0/3062881574 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40a7050 con 0x7f9acc06f240 2024-01-30T08:09:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.650+0000 7f9acb400640 1 -- 172.21.15.50:0/3062881574 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40ab980 con 0x7f9acc06f240 2024-01-30T08:09:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- 172.21.15.50:0/3062881574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc06f240 msgr2=0x7f9acc06f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/3062881574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc06f240 0x7f9acc06f6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40097f0 tx=0x7f9ab401c370 comp rx=0 tx=0).stop 2024-01-30T08:09:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- 172.21.15.50:0/3062881574 shutdown_connections 2024-01-30T08:09:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/3062881574 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc06f240 0x7f9acc06f6a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- 172.21.15.50:0/3062881574 >> 172.21.15.50:0/3062881574 conn(0x7f9acc0727c0 msgr2=0x7f9acc06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- 172.21.15.50:0/3062881574 shutdown_connections 2024-01-30T08:09:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- 172.21.15.50:0/3062881574 wait complete. 2024-01-30T08:09:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 Processor -- start 2024-01-30T08:09:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- start start 2024-01-30T08:09:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9acc06f240 0x7f9acc1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc0c1200 0x7f9acc0a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9acc155500 0x7f9acc0a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0a89b0 con 0x7f9acc06f240 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1ee190 con 0x7f9acc155500 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad3a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1f0430 con 0x7f9acc0c1200 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad1000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9acc06f240 0x7f9acc1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad1000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9acc06f240 0x7f9acc1544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55360/0 (socket says 172.21.15.50:55360) 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.654+0000 7f9ad1000640 1 -- 172.21.15.50:0/24582857 learned_addr learned my addr 172.21.15.50:0/24582857 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9acbe00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc0c1200 0x7f9acc0a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9acc155500 0x7f9acc0a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1000640 1 -- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc0c1200 msgr2=0x7f9acc0a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1000640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc0c1200 0x7f9acc0a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1000640 1 -- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9acc155500 msgr2=0x7f9acc0a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1000640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9acc155500 0x7f9acc0a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1000640 1 -- 172.21.15.50:0/24582857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab4009420 con 0x7f9acc06f240 2024-01-30T08:09:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9acc155500 0x7f9acc0a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad1000640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9acc06f240 0x7f9acc1544f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c420 tx=0x7f9abc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ac8c00640 1 -- 172.21.15.50:0/24582857 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc005cf0 con 0x7f9acc06f240 2024-01-30T08:09:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ac8c00640 1 -- 172.21.15.50:0/24582857 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc005e50 con 0x7f9acc06f240 2024-01-30T08:09:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc0a8c00 con 0x7f9acc06f240 2024-01-30T08:09:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ac8c00640 1 -- 172.21.15.50:0/24582857 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc007310 con 0x7f9acc06f240 2024-01-30T08:09:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc0a91c0 con 0x7f9acc06f240 2024-01-30T08:09:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc067cc0 con 0x7f9acc06f240 2024-01-30T08:09:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.658+0000 7f9ac8c00640 1 -- 172.21.15.50:0/24582857 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9abc007470 con 0x7f9acc06f240 2024-01-30T08:09:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.662+0000 7f9ac8c00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9aa4066500 0x7f9aa40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.662+0000 7f9ac8c00640 1 -- 172.21.15.50:0/24582857 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9abc083810 con 0x7f9acc06f240 2024-01-30T08:09:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.662+0000 7f9acbe00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9aa4066500 0x7f9aa40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.662+0000 7f9acbe00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9aa4066500 0x7f9aa40689c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40ad000 tx=0x7f9ab4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.662+0000 7f9ac8c00640 1 -- 172.21.15.50:0/24582857 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9abc050790 con 0x7f9acc06f240 2024-01-30T08:09:36.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9acc0a93e0 con 0x7f9acc06f240 2024-01-30T08:09:36.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ac8c00640 1 -- 172.21.15.50:0/24582857 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9abc017020 con 0x7f9acc06f240 2024-01-30T08:09:36.823 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:36.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9aa4066500 msgr2=0x7f9aa40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9aa4066500 0x7f9aa40689c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40ad000 tx=0x7f9ab4008040 comp rx=0 tx=0).stop 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9acc06f240 msgr2=0x7f9acc1544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9acc06f240 0x7f9acc1544f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c420 tx=0x7f9abc00c8e0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 shutdown_connections 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9acc155500 0x7f9acc0a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9aa4066500 0x7f9aa40689c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9acc0c1200 0x7f9acc0a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 --2- 172.21.15.50:0/24582857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9acc06f240 0x7f9acc1544f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 >> 172.21.15.50:0/24582857 conn(0x7f9acc0727c0 msgr2=0x7f9acc06f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 shutdown_connections 2024-01-30T08:09:36.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.822+0000 7f9ad3a00640 1 -- 172.21.15.50:0/24582857 wait complete. 2024-01-30T08:09:36.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-30T08:09:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbef200640 1 Processor -- start 2024-01-30T08:09:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbef200640 1 -- start start 2024-01-30T08:09:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbef200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffbe8154490 0x7ffbe806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbef200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbe80c5540 0x7ffbe80bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbef200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe8154aa0 con 0x7ffbe80c4280 2024-01-30T08:09:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbef200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe8154870 con 0x7ffbe80c5540 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbef200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe80bc470 con 0x7ffbe8154490 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.986+0000 7ffbed200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbe80c5540 0x7ffbe80bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbed200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbe80c5540 0x7ffbe80bbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55362/0 (socket says 172.21.15.50:55362) 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbed200640 1 -- 172.21.15.50:0/3459156416 learned_addr learned my addr 172.21.15.50:0/3459156416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbe7e00640 1 --2- 172.21.15.50:0/3459156416 >> v2:172.21.15.125:3300/0 conn(0x7ffbe8154490 0x7ffbe806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbed200640 1 -- 172.21.15.50:0/3459156416 >> v2:172.21.15.125:3300/0 conn(0x7ffbe8154490 msgr2=0x7ffbe806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbed200640 1 --2- 172.21.15.50:0/3459156416 >> v2:172.21.15.125:3300/0 conn(0x7ffbe8154490 0x7ffbe806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbed200640 1 -- 172.21.15.50:0/3459156416 >> v1:172.21.15.125:6789/0 conn(0x7ffbe80c4280 legacy=0x7ffbe80bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbed200640 1 -- 172.21.15.50:0/3459156416 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe8154cf0 con 0x7ffbe80c5540 2024-01-30T08:09:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbed200640 1 --2- 172.21.15.50:0/3459156416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80bbf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80c4180 tx=0x7ffbe001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a04e190c4d725ba server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbe6a00640 1 -- 172.21.15.50:0/3459156416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe00a5860 con 0x7ffbe80c5540 2024-01-30T08:09:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbe6a00640 1 -- 172.21.15.50:0/3459156416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe00a59c0 con 0x7ffbe80c5540 2024-01-30T08:09:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.990+0000 7ffbe6a00640 1 -- 172.21.15.50:0/3459156416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe00a5d50 con 0x7ffbe80c5540 2024-01-30T08:09:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- 172.21.15.50:0/3459156416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 msgr2=0x7ffbe80bbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 --2- 172.21.15.50:0/3459156416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80bbf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80c4180 tx=0x7ffbe001c9a0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- 172.21.15.50:0/3459156416 shutdown_connections 2024-01-30T08:09:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 --2- 172.21.15.50:0/3459156416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80bbf30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 --2- 172.21.15.50:0/3459156416 >> v2:172.21.15.125:3300/0 conn(0x7ffbe8154490 0x7ffbe806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- 172.21.15.50:0/3459156416 >> 172.21.15.50:0/3459156416 conn(0x7ffbe80c5f10 msgr2=0x7ffbe80c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- 172.21.15.50:0/3459156416 shutdown_connections 2024-01-30T08:09:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- 172.21.15.50:0/3459156416 wait complete. 2024-01-30T08:09:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 Processor -- start 2024-01-30T08:09:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- start start 2024-01-30T08:09:36.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe80c4280 0x7ffbe80a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe8154490 0x7ffbe81edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe80a8620 con 0x7ffbe80c5540 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8071240 con 0x7ffbe80c4280 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbef200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe806feb0 con 0x7ffbe8154490 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbe7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbe7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80a80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55378/0 (socket says 172.21.15.50:55378) 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbe7400640 1 -- 172.21.15.50:0/4129692345 learned_addr learned my addr 172.21.15.50:0/4129692345 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbed200640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe8154490 0x7ffbe81edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.994+0000 7ffbe7e00640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe80c4280 0x7ffbe80a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbe7400640 1 -- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe8154490 msgr2=0x7ffbe81edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbe7400640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe8154490 0x7ffbe81edc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbe7400640 1 -- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe80c4280 msgr2=0x7ffbe80a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbe7400640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe80c4280 0x7ffbe80a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbe7400640 1 -- 172.21.15.50:0/4129692345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe0009b30 con 0x7ffbe80c5540 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbe7400640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80a80e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000c370 tx=0x7ffbd000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbdfe00640 1 -- 172.21.15.50:0/4129692345 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00052d0 con 0x7ffbe80c5540 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbdfe00640 1 -- 172.21.15.50:0/4129692345 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd0005430 con 0x7ffbe80c5540 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbdfe00640 1 -- 172.21.15.50:0/4129692345 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0007260 con 0x7ffbe80c5540 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe81ee1b0 con 0x7ffbe80c5540 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe80bbec0 con 0x7ffbe80c5540 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe804ead0 con 0x7ffbe80c5540 2024-01-30T08:09:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbdfe00640 1 -- 172.21.15.50:0/4129692345 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ffbd00073c0 con 0x7ffbe80c5540 2024-01-30T08:09:37.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbdfe00640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffbc0066530 0x7ffbc00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:36.998+0000 7ffbdfe00640 1 -- 172.21.15.50:0/4129692345 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffbd00835e0 con 0x7ffbe80c5540 2024-01-30T08:09:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.002+0000 7ffbe7e00640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffbc0066530 0x7ffbc00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.002+0000 7ffbe7e00640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffbc0066530 0x7ffbc00689f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80c2210 tx=0x7ffbd8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:37.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.002+0000 7ffbdfe00640 1 -- 172.21.15.50:0/4129692345 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ffbd00504d0 con 0x7ffbe80c5540 2024-01-30T08:09:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.174+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffbe80c4690 con 0x7ffbe80c5540 2024-01-30T08:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.174+0000 7ffbdfe00640 1 -- 172.21.15.50:0/4129692345 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffbd0053af0 con 0x7ffbe80c5540 2024-01-30T08:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffbc0066530 msgr2=0x7ffbc00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffbc0066530 0x7ffbc00689f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80c2210 tx=0x7ffbd8009190 comp rx=0 tx=0).stop 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 msgr2=0x7ffbe80a80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80a80e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000c370 tx=0x7ffbd000c830 comp rx=0 tx=0).stop 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 shutdown_connections 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffbc0066530 0x7ffbc00689f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe8154490 0x7ffbe81edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbe80c5540 0x7ffbe80a80e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 --2- 172.21.15.50:0/4129692345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe80c4280 0x7ffbe80a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 >> 172.21.15.50:0/4129692345 conn(0x7ffbe80c5f10 msgr2=0x7ffbe8150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 shutdown_connections 2024-01-30T08:09:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.178+0000 7ffbef200640 1 -- 172.21.15.50:0/4129692345 wait complete. 2024-01-30T08:09:37.198 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-30T08:09:37.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:37.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-30T08:09:37.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:09:37.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:09:37.297 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-30T08:09:37.312 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-30T08:09:37.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f663b000640 1 Processor -- start 2024-01-30T08:09:37.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f663b000640 1 -- start start 2024-01-30T08:09:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f663b000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f663406de40 0x7f663406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f663b000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634152f00 con 0x7f6634153390 2024-01-30T08:09:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f663b000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66341525f0 con 0x7f66340c4310 2024-01-30T08:09:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f663b000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340a7680 con 0x7f663406de40 2024-01-30T08:09:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6633e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f663406de40 0x7f663406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6633e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f663406de40 0x7f663406e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55384/0 (socket says 172.21.15.50:55384) 2024-01-30T08:09:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6633e00640 1 -- 172.21.15.50:0/1795862605 learned_addr learned my addr 172.21.15.50:0/1795862605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6633400640 1 --1- 172.21.15.50:0/1795862605 >> v1:172.21.15.50:6789/0 conn(0x7f6634153390 0x7f66340a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53936/0 (socket says 172.21.15.50:53936) 2024-01-30T08:09:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6633e00640 1 -- 172.21.15.50:0/1795862605 >> v1:172.21.15.125:6789/0 conn(0x7f66340c4310 legacy=0x7f6634155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6633e00640 1 -- 172.21.15.50:0/1795862605 >> v1:172.21.15.50:6789/0 conn(0x7f6634153390 legacy=0x7f66340a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6633e00640 1 -- 172.21.15.50:0/1795862605 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66341528b0 con 0x7f663406de40 2024-01-30T08:09:37.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.454+0000 7f6632a00640 1 -- 172.21.15.50:0/1795862605 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567041435 0 0) 0x7f6634152f00 con 0x7f6634153390 2024-01-30T08:09:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f6633e00640 1 --2- 172.21.15.50:0/1795862605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663406e220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fdfb5cc90f0d52 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f6632a00640 1 -- 172.21.15.50:0/1795862605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240ab610 con 0x7f663406de40 2024-01-30T08:09:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f6632a00640 1 -- 172.21.15.50:0/1795862605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66240ab770 con 0x7f663406de40 2024-01-30T08:09:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f6632a00640 1 -- 172.21.15.50:0/1795862605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240abb00 con 0x7f663406de40 2024-01-30T08:09:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f663b000640 1 -- 172.21.15.50:0/1795862605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 msgr2=0x7f663406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f663b000640 1 --2- 172.21.15.50:0/1795862605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663406e220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f663b000640 1 -- 172.21.15.50:0/1795862605 shutdown_connections 2024-01-30T08:09:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f663b000640 1 --2- 172.21.15.50:0/1795862605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663406e220 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f663b000640 1 -- 172.21.15.50:0/1795862605 >> 172.21.15.50:0/1795862605 conn(0x7f66340c4830 msgr2=0x7f66340c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f663b000640 1 -- 172.21.15.50:0/1795862605 shutdown_connections 2024-01-30T08:09:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.458+0000 7f663b000640 1 -- 172.21.15.50:0/1795862605 wait complete. 2024-01-30T08:09:37.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 Processor -- start 2024-01-30T08:09:37.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 -- start start 2024-01-30T08:09:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66340c4310 0x7f6634148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6634153390 0x7f6634147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a7b50 con 0x7f663406de40 2024-01-30T08:09:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340aa1c0 con 0x7f66340c4310 2024-01-30T08:09:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340aa780 con 0x7f6634153390 2024-01-30T08:09:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663414bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55386/0 (socket says 172.21.15.50:55386) 2024-01-30T08:09:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 -- 172.21.15.50:0/3964605109 learned_addr learned my addr 172.21.15.50:0/3964605109 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633400640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66340c4310 0x7f6634148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6639000640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6634153390 0x7f6634147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 -- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6634153390 msgr2=0x7f6634147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6634153390 0x7f6634147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 -- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66340c4310 msgr2=0x7f6634148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66340c4310 0x7f6634148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 -- 172.21.15.50:0/3964605109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240094d0 con 0x7f663406de40 2024-01-30T08:09:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f6633e00640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663414bb50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f662be00640 1 -- 172.21.15.50:0/3964605109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624004030 con 0x7f663406de40 2024-01-30T08:09:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f662be00640 1 -- 172.21.15.50:0/3964605109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66240b8070 con 0x7f663406de40 2024-01-30T08:09:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663414c090 con 0x7f663406de40 2024-01-30T08:09:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f662be00640 1 -- 172.21.15.50:0/3964605109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240043b0 con 0x7f663406de40 2024-01-30T08:09:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66340a8080 con 0x7f663406de40 2024-01-30T08:09:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.462+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634074a20 con 0x7f663406de40 2024-01-30T08:09:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.466+0000 7f662be00640 1 -- 172.21.15.50:0/3964605109 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6624003620 con 0x7f663406de40 2024-01-30T08:09:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.466+0000 7f662be00640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f660c066500 0x7f660c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.466+0000 7f662be00640 1 -- 172.21.15.50:0/3964605109 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f662411e7d0 con 0x7f663406de40 2024-01-30T08:09:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.466+0000 7f6633400640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f660c066500 0x7f660c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.466+0000 7f6633400640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f660c066500 0x7f660c0689c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66340c6d90 tx=0x7f661c007b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:37.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.470+0000 7f662be00640 1 -- 172.21.15.50:0/3964605109 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f66240eb750 con 0x7f663406de40 2024-01-30T08:09:37.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f663406ec60 con 0x7f663406de40 2024-01-30T08:09:37.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f662be00640 1 -- 172.21.15.50:0/3964605109 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7f66240eed70 con 0x7f663406de40 2024-01-30T08:09:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:37.662 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f660c066500 msgr2=0x7f660c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f660c066500 0x7f660c0689c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66340c6d90 tx=0x7f661c007b10 comp rx=0 tx=0).stop 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 msgr2=0x7f663414bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663414bb50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401ac30 comp rx=0 tx=0).stop 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 shutdown_connections 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66340c4310 0x7f6634148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f660c066500 0x7f660c0689c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6634153390 0x7f6634147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 --2- 172.21.15.50:0/3964605109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663406de40 0x7f663414bb50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 >> 172.21.15.50:0/3964605109 conn(0x7f66340c4830 msgr2=0x7f66341558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 shutdown_connections 2024-01-30T08:09:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.662+0000 7f663b000640 1 -- 172.21.15.50:0/3964605109 wait complete. 2024-01-30T08:09:37.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.822+0000 7fd48fa00640 1 Processor -- start 2024-01-30T08:09:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.822+0000 7fd48fa00640 1 -- start start 2024-01-30T08:09:37.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.822+0000 7fd48fa00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd48806de40 0x7fd48806e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd48fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd4880a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd48fa00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd488152f00 con 0x7fd4880c4310 2024-01-30T08:09:37.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd48fa00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4881525f0 con 0x7fd48806de40 2024-01-30T08:09:37.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd48fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880a7680 con 0x7fd488153390 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd487e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd4880a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd487e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd4880a6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:50162/0 (socket says 172.21.15.50:50162) 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd487e00640 1 -- 172.21.15.50:0/1717371635 learned_addr learned my addr 172.21.15.50:0/1717371635 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd48d000640 1 --2- 172.21.15.50:0/1717371635 >> v2:172.21.15.125:3300/0 conn(0x7fd48806de40 0x7fd48806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd487e00640 1 -- 172.21.15.50:0/1717371635 >> v2:172.21.15.125:3300/0 conn(0x7fd48806de40 msgr2=0x7fd48806e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd487e00640 1 --2- 172.21.15.50:0/1717371635 >> v2:172.21.15.125:3300/0 conn(0x7fd48806de40 0x7fd48806e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd487e00640 1 -- 172.21.15.50:0/1717371635 >> v1:172.21.15.125:6789/0 conn(0x7fd4880c4310 legacy=0x7fd488155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.826+0000 7fd487e00640 1 -- 172.21.15.50:0/1717371635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4881528b0 con 0x7fd488153390 2024-01-30T08:09:37.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd487e00640 1 --2- 172.21.15.50:0/1717371635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd4880a6de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd470009870 tx=0x7fd47001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ce4b13ca0cf3afd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:37.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd487400640 1 -- 172.21.15.50:0/1717371635 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700ab610 con 0x7fd488153390 2024-01-30T08:09:37.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd487400640 1 -- 172.21.15.50:0/1717371635 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700ab770 con 0x7fd488153390 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd487400640 1 -- 172.21.15.50:0/1717371635 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700abb00 con 0x7fd488153390 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 -- 172.21.15.50:0/1717371635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 msgr2=0x7fd4880a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 --2- 172.21.15.50:0/1717371635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd4880a6de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd470009870 tx=0x7fd47001c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 -- 172.21.15.50:0/1717371635 shutdown_connections 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 --2- 172.21.15.50:0/1717371635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd4880a6de0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 --2- 172.21.15.50:0/1717371635 >> v2:172.21.15.125:3300/0 conn(0x7fd48806de40 0x7fd48806e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 -- 172.21.15.50:0/1717371635 >> 172.21.15.50:0/1717371635 conn(0x7fd4880c4830 msgr2=0x7fd4880c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 -- 172.21.15.50:0/1717371635 shutdown_connections 2024-01-30T08:09:37.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 -- 172.21.15.50:0/1717371635 wait complete. 2024-01-30T08:09:37.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 Processor -- start 2024-01-30T08:09:37.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.830+0000 7fd48fa00640 1 -- start start 2024-01-30T08:09:37.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd48806de40 0x7fd488150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4880c4310 0x7fd48814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd48814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48814b540 con 0x7fd4880c4310 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880ac370 con 0x7fd48806de40 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880aabc0 con 0x7fd488153390 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4880c4310 0x7fd48814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4880c4310 0x7fd48814a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55394/0 (socket says 172.21.15.50:55394) 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd487e00640 1 -- 172.21.15.50:0/2226366694 learned_addr learned my addr 172.21.15.50:0/2226366694 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48d000640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd48806de40 0x7fd488150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48da00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd48814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48d000640 1 -- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 msgr2=0x7fd48814ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48d000640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd48814ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48d000640 1 -- 172.21.15.50:0/2226366694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4880c4310 msgr2=0x7fd48814a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48d000640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4880c4310 0x7fd48814a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48d000640 1 -- 172.21.15.50:0/2226366694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4700094d0 con 0x7fd48806de40 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd487e00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4880c4310 0x7fd48814a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48d000640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd48806de40 0x7fd488150c40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e870 tx=0x7fd47800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd484c00640 1 -- 172.21.15.50:0/2226366694 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4780095d0 con 0x7fd48806de40 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd484c00640 1 -- 172.21.15.50:0/2226366694 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47800c940 con 0x7fd48806de40 2024-01-30T08:09:37.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd484c00640 1 -- 172.21.15.50:0/2226366694 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800ccb0 con 0x7fd48806de40 2024-01-30T08:09:37.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4880aaea0 con 0x7fd48806de40 2024-01-30T08:09:37.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4880adbe0 con 0x7fd48806de40 2024-01-30T08:09:37.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.834+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd488074a20 con 0x7fd48806de40 2024-01-30T08:09:37.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.838+0000 7fd484c00640 1 -- 172.21.15.50:0/2226366694 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd478013470 con 0x7fd48806de40 2024-01-30T08:09:37.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.838+0000 7fd484c00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd460066500 0x7fd4600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:37.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.838+0000 7fd484c00640 1 -- 172.21.15.50:0/2226366694 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd4780843b0 con 0x7fd48806de40 2024-01-30T08:09:37.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.838+0000 7fd487e00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd460066500 0x7fd4600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:37.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.838+0000 7fd487e00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd460066500 0x7fd4600689c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd47001c430 tx=0x7fd4700a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:37.842+0000 7fd484c00640 1 -- 172.21.15.50:0/2226366694 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd478051330 con 0x7fd48806de40 2024-01-30T08:09:38.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.006+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4881f0360 con 0x7fd48806de40 2024-01-30T08:09:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.006+0000 7fd484c00640 1 -- 172.21.15.50:0/2226366694 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18735 (secure 0 0 0) 0x7fd478054950 con 0x7fd48806de40 2024-01-30T08:09:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:38.008 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:30.858267+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd460066500 msgr2=0x7fd4600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd460066500 0x7fd4600689c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd47001c430 tx=0x7fd4700a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd48806de40 msgr2=0x7fd488150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd48806de40 0x7fd488150c40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e870 tx=0x7fd47800ed30 comp rx=0 tx=0).stop 2024-01-30T08:09:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 shutdown_connections 2024-01-30T08:09:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd460066500 0x7fd4600689c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd488153390 0x7fd48814ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4880c4310 0x7fd48814a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 --2- 172.21.15.50:0/2226366694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd48806de40 0x7fd488150c40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 >> 172.21.15.50:0/2226366694 conn(0x7fd4880c4830 msgr2=0x7fd48814c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 shutdown_connections 2024-01-30T08:09:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.010+0000 7fd48fa00640 1 -- 172.21.15.50:0/2226366694 wait complete. 2024-01-30T08:09:38.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:08:39.607431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:08:40.654969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-30T08:08:44.324249+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-30T08:09:38.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:38.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.174+0000 7fcd13000640 1 Processor -- start 2024-01-30T08:09:38.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.174+0000 7fcd13000640 1 -- start start 2024-01-30T08:09:38.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.174+0000 7fcd13000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd0c14fbf0 0x7fcd0c153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd13000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0c04b0 0x7fcd0c06ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd13000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c0c54e0 con 0x7fcd0c0a4da0 2024-01-30T08:09:38.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd13000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c152bf0 con 0x7fcd0c14fbf0 2024-01-30T08:09:38.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd13000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c072d90 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd0be00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd0c14fbf0 0x7fcd0c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd11000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0c04b0 0x7fcd0c06ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd0b400640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcd0c0a4da0 0x7fcd0c0c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:33224/0 (socket says 172.21.15.50:33224) 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd0b400640 1 -- 172.21.15.50:0/4048214492 learned_addr learned my addr 172.21.15.50:0/4048214492 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd0be00640 1 -- 172.21.15.50:0/4048214492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0c04b0 msgr2=0x7fcd0c06ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd0be00640 1 --2- 172.21.15.50:0/4048214492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0c04b0 0x7fcd0c06ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd0be00640 1 -- 172.21.15.50:0/4048214492 >> v1:172.21.15.125:6789/0 conn(0x7fcd0c0a4da0 legacy=0x7fcd0c0c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.178+0000 7fcd0be00640 1 -- 172.21.15.50:0/4048214492 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c1525e0 con 0x7fcd0c14fbf0 2024-01-30T08:09:38.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd0be00640 1 --2- 172.21.15.50:0/4048214492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 0x7fcd0c153080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0097c0 tx=0x7fccfc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38c825e4d56d02e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd0aa00640 1 -- 172.21.15.50:0/4048214492 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0ab600 con 0x7fcd0c14fbf0 2024-01-30T08:09:38.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd0aa00640 1 -- 172.21.15.50:0/4048214492 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc0a7050 con 0x7fcd0c14fbf0 2024-01-30T08:09:38.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd0aa00640 1 -- 172.21.15.50:0/4048214492 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0ab980 con 0x7fcd0c14fbf0 2024-01-30T08:09:38.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 -- 172.21.15.50:0/4048214492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 msgr2=0x7fcd0c153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 --2- 172.21.15.50:0/4048214492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 0x7fcd0c153080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0097c0 tx=0x7fccfc01c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 -- 172.21.15.50:0/4048214492 shutdown_connections 2024-01-30T08:09:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 --2- 172.21.15.50:0/4048214492 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0c04b0 0x7fcd0c06ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 --2- 172.21.15.50:0/4048214492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 0x7fcd0c153080 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 -- 172.21.15.50:0/4048214492 >> 172.21.15.50:0/4048214492 conn(0x7fcd0c0c5b30 msgr2=0x7fcd0c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 -- 172.21.15.50:0/4048214492 shutdown_connections 2024-01-30T08:09:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 -- 172.21.15.50:0/4048214492 wait complete. 2024-01-30T08:09:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 Processor -- start 2024-01-30T08:09:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.182+0000 7fcd13000640 1 -- start start 2024-01-30T08:09:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0a4da0 0x7fcd0c0aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd0c0c04b0 0x7fcd0c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 0x7fcd0c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c155020 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0aad40 con 0x7fcd0c14fbf0 2024-01-30T08:09:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0aba80 con 0x7fcd0c0a4da0 2024-01-30T08:09:38.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd0c0c04b0 0x7fcd0c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd0c0c04b0 0x7fcd0c150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55396/0 (socket says 172.21.15.50:55396) 2024-01-30T08:09:38.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 -- 172.21.15.50:0/3058857825 learned_addr learned my addr 172.21.15.50:0/3058857825 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:38.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0be00640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0a4da0 0x7fcd0c0aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd11000640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 0x7fcd0c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 -- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0a4da0 msgr2=0x7fcd0c0aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0a4da0 0x7fcd0c0aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 -- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 msgr2=0x7fcd0c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 0x7fcd0c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 -- 172.21.15.50:0/3058857825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009420 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd0b400640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd0c0c04b0 0x7fcd0c150d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c420 tx=0x7fccf400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd03e00640 1 -- 172.21.15.50:0/3058857825 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4005cf0 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd03e00640 1 -- 172.21.15.50:0/3058857825 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4005e50 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd03e00640 1 -- 172.21.15.50:0/3058857825 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40072f0 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0abdb0 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c1512c0 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c067cc0 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.186+0000 7fcd03e00640 1 -- 172.21.15.50:0/3058857825 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fccf4007450 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.190+0000 7fcd03e00640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcce4066500 0x7fcce40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.190+0000 7fcd03e00640 1 -- 172.21.15.50:0/3058857825 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fccf4083880 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.190+0000 7fcd0be00640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcce4066500 0x7fcce40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.190+0000 7fcd0be00640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcce4066500 0x7fcce40689c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0ad000 tx=0x7fccfc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.194+0000 7fcd03e00640 1 -- 172.21.15.50:0/3058857825 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fccf40506f0 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd0c074a20 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd03e00640 1 -- 172.21.15.50:0/3058857825 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccf4053d10 con 0x7fcd0c0c04b0 2024-01-30T08:09:38.358 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:38.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcce4066500 msgr2=0x7fcce40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcce4066500 0x7fcce40689c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0ad000 tx=0x7fccfc008040 comp rx=0 tx=0).stop 2024-01-30T08:09:38.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd0c0c04b0 msgr2=0x7fcd0c150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd0c0c04b0 0x7fcd0c150d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c420 tx=0x7fccf400c8e0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 shutdown_connections 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c14fbf0 0x7fcd0c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcce4066500 0x7fcce40689c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd0c0c04b0 0x7fcd0c150d80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 --2- 172.21.15.50:0/3058857825 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd0c0a4da0 0x7fcd0c0aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 >> 172.21.15.50:0/3058857825 conn(0x7fcd0c0c5b30 msgr2=0x7fcd0c0c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 shutdown_connections 2024-01-30T08:09:38.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.358+0000 7fcd13000640 1 -- 172.21.15.50:0/3058857825 wait complete. 2024-01-30T08:09:38.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:09:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f051d200640 1 Processor -- start 2024-01-30T08:09:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f051d200640 1 -- start start 2024-01-30T08:09:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f051d200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 0x7f0518072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f051d200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f05180c4bb0 0x7f05180a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f051d200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05180c0240 con 0x7f0518071320 2024-01-30T08:09:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f051d200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05180c2910 con 0x7f05180c4bb0 2024-01-30T08:09:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f051d200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051806ab20 con 0x7f0518071700 2024-01-30T08:09:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0518071320 0x7f05180c06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53950/0 (socket says 172.21.15.50:53950) 2024-01-30T08:09:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 -- 172.21.15.50:0/3449810714 learned_addr learned my addr 172.21.15.50:0/3449810714 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515400640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 0x7f0518072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0516800640 1 --2- 172.21.15.50:0/3449810714 >> v2:172.21.15.125:3300/0 conn(0x7f05180c4bb0 0x7f05180a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563622216 0 0) 0x7f05180c0240 con 0x7f0518071320 2024-01-30T08:09:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f8003530 con 0x7f0518071320 2024-01-30T08:09:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870717216 0 0) 0x7f04f8003530 con 0x7f0518071320 2024-01-30T08:09:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 msgr2=0x7f0518072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 0x7f0518072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 >> v2:172.21.15.125:3300/0 conn(0x7f05180c4bb0 msgr2=0x7f05180a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 --2- 172.21.15.50:0/3449810714 >> v2:172.21.15.125:3300/0 conn(0x7f05180c4bb0 0x7f05180a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051806ae00 con 0x7f0518071320 2024-01-30T08:09:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f0508001680 con 0x7f0518071320 2024-01-30T08:09:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0516800640 1 --2- 172.21.15.50:0/3449810714 >> v2:172.21.15.125:3300/0 conn(0x7f05180c4bb0 0x7f05180a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 >> v1:172.21.15.50:6789/0 conn(0x7f0518071320 legacy=0x7f05180c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f8003980 0x7f04f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 0x7f04f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04f8004d10 0x7f04f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051806ab20 con 0x7f04f8003980 2024-01-30T08:09:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f800b990 con 0x7f04f8004d10 2024-01-30T08:09:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f800bb00 con 0x7f0518071700 2024-01-30T08:09:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f8003980 0x7f04f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515400640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 0x7f04f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0516800640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04f8004d10 0x7f04f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 -- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 msgr2=0x7f04f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0518071700 0x7f04f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 -- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04f8004d10 msgr2=0x7f04f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04f8004d10 0x7f04f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.526+0000 7f0515e00640 1 -- 172.21.15.50:0/3449810714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8003530 con 0x7f04f8003980 2024-01-30T08:09:38.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f0515e00640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f8003980 0x7f04f8003da0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f050800c210 tx=0x7f050801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480cfed27a28b0da server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080a5930 con 0x7f04f8003980 2024-01-30T08:09:38.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05080a5a90 con 0x7f04f8003980 2024-01-30T08:09:38.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f0514a00640 1 -- 172.21.15.50:0/3449810714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080a5e60 con 0x7f04f8003980 2024-01-30T08:09:38.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f051d200640 1 -- 172.21.15.50:0/3449810714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f8003980 msgr2=0x7f04f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f051d200640 1 --2- 172.21.15.50:0/3449810714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f8003980 0x7f04f8003da0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f050800c210 tx=0x7f050801cc30 comp rx=0 tx=0).stop 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f0516800640 1 -- 172.21.15.50:0/3449810714 reap_dead start 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f051d200640 1 -- 172.21.15.50:0/3449810714 shutdown_connections 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f051d200640 1 -- 172.21.15.50:0/3449810714 >> 172.21.15.50:0/3449810714 conn(0x7f05180c6c60 msgr2=0x7f05180c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f051d200640 1 -- 172.21.15.50:0/3449810714 shutdown_connections 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.530+0000 7f051d200640 1 -- 172.21.15.50:0/3449810714 wait complete. 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 Processor -- start 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 -- start start 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04f8003980 0x7f0518146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0518146f40 0x7f051815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f051815a7e0 0x7f05181f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05180a7f00 con 0x7f0518146f40 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05180a6b80 con 0x7f051815a7e0 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05180a9b60 con 0x7f04f8003980 2024-01-30T08:09:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0518146f40 0x7f051815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0518146f40 0x7f051815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55416/0 (socket says 172.21.15.50:55416) 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 -- 172.21.15.50:0/3859096102 learned_addr learned my addr 172.21.15.50:0/3859096102 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0516800640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f051815a7e0 0x7f05181f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515e00640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04f8003980 0x7f0518146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 -- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04f8003980 msgr2=0x7f0518146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04f8003980 0x7f0518146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 -- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f051815a7e0 msgr2=0x7f05181f0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f051815a7e0 0x7f05181f0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 -- 172.21.15.50:0/3859096102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05180a7680 con 0x7f0518146f40 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f0515400640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0518146f40 0x7f051815a2a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0500011940 tx=0x7f0500011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f050e000640 1 -- 172.21.15.50:0/3859096102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500004240 con 0x7f0518146f40 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f050e000640 1 -- 172.21.15.50:0/3859096102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05000043a0 con 0x7f0518146f40 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f050e000640 1 -- 172.21.15.50:0/3859096102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000fb00 con 0x7f0518146f40 2024-01-30T08:09:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05181ee070 con 0x7f0518146f40 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.534+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05180a7c20 con 0x7f0518146f40 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.538+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0518067cc0 con 0x7f0518146f40 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.538+0000 7f050e000640 1 -- 172.21.15.50:0/3859096102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f050000fc60 con 0x7f0518146f40 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.538+0000 7f050e000640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f04f0066530 0x7f04f00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.538+0000 7f050e000640 1 -- 172.21.15.50:0/3859096102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f05000848c0 con 0x7f0518146f40 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.538+0000 7f0515e00640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f04f0066530 0x7f04f00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.538+0000 7f0515e00640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f04f0066530 0x7f04f00689f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f050800c210 tx=0x7f0508001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.542+0000 7f050e000640 1 -- 172.21.15.50:0/3859096102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0500051840 con 0x7f0518146f40 2024-01-30T08:09:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.698+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f051815abc0 con 0x7f0518146f40 2024-01-30T08:09:38.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.698+0000 7f050e000640 1 -- 172.21.15.50:0/3859096102 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0500019020 con 0x7f0518146f40 2024-01-30T08:09:38.701 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:38.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f04f0066530 msgr2=0x7f04f00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f04f0066530 0x7f04f00689f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f050800c210 tx=0x7f0508001a10 comp rx=0 tx=0).stop 2024-01-30T08:09:38.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0518146f40 msgr2=0x7f051815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0518146f40 0x7f051815a2a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0500011940 tx=0x7f0500011e00 comp rx=0 tx=0).stop 2024-01-30T08:09:38.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 shutdown_connections 2024-01-30T08:09:38.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f051815a7e0 0x7f05181f0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f04f0066530 0x7f04f00689f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0518146f40 0x7f051815a2a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 --2- 172.21.15.50:0/3859096102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04f8003980 0x7f0518146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 >> 172.21.15.50:0/3859096102 conn(0x7f05180c6c60 msgr2=0x7f051806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 shutdown_connections 2024-01-30T08:09:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.702+0000 7f051d200640 1 -- 172.21.15.50:0/3859096102 wait complete. 2024-01-30T08:09:38.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:09:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff22a000640 1 Processor -- start 2024-01-30T08:09:38.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff22a000640 1 -- start start 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff22a000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff224155500 0x7ff2240c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff22a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff22406f240 0x7ff22406f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff22a000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff224158b70 con 0x7ff2240c1200 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff22a000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff224157f60 con 0x7ff22406f240 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff22a000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff224158240 con 0x7ff224155500 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff222a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff22406f240 0x7ff22406f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff222a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff22406f240 0x7ff22406f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55432/0 (socket says 172.21.15.50:55432) 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.866+0000 7ff222a00640 1 -- 172.21.15.50:0/2029566589 learned_addr learned my addr 172.21.15.50:0/2029566589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff223400640 1 --2- 172.21.15.50:0/2029566589 >> v2:172.21.15.125:3300/0 conn(0x7ff224155500 0x7ff2240c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222a00640 1 -- 172.21.15.50:0/2029566589 >> v2:172.21.15.125:3300/0 conn(0x7ff224155500 msgr2=0x7ff2240c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222a00640 1 --2- 172.21.15.50:0/2029566589 >> v2:172.21.15.125:3300/0 conn(0x7ff224155500 0x7ff2240c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222a00640 1 -- 172.21.15.50:0/2029566589 >> v1:172.21.15.125:6789/0 conn(0x7ff2240c1200 legacy=0x7ff2240c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222a00640 1 -- 172.21.15.50:0/2029566589 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224158520 con 0x7ff22406f240 2024-01-30T08:09:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff223400640 1 --2- 172.21.15.50:0/2029566589 >> v2:172.21.15.125:3300/0 conn(0x7ff224155500 0x7ff2240c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222a00640 1 --2- 172.21.15.50:0/2029566589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22406f6d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff2240aaaf0 tx=0x7ff20c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e653e1ad80d8eb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222000640 1 -- 172.21.15.50:0/2029566589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0ad640 con 0x7ff22406f240 2024-01-30T08:09:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222000640 1 -- 172.21.15.50:0/2029566589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c0ad7a0 con 0x7ff22406f240 2024-01-30T08:09:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.870+0000 7ff222000640 1 -- 172.21.15.50:0/2029566589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0adb30 con 0x7ff22406f240 2024-01-30T08:09:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- 172.21.15.50:0/2029566589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 msgr2=0x7ff22406f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 --2- 172.21.15.50:0/2029566589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22406f6d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff2240aaaf0 tx=0x7ff20c01c370 comp rx=0 tx=0).stop 2024-01-30T08:09:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- 172.21.15.50:0/2029566589 shutdown_connections 2024-01-30T08:09:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 --2- 172.21.15.50:0/2029566589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22406f6d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 --2- 172.21.15.50:0/2029566589 >> v2:172.21.15.125:3300/0 conn(0x7ff224155500 0x7ff2240c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- 172.21.15.50:0/2029566589 >> 172.21.15.50:0/2029566589 conn(0x7ff2240727c0 msgr2=0x7ff22406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- 172.21.15.50:0/2029566589 shutdown_connections 2024-01-30T08:09:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- 172.21.15.50:0/2029566589 wait complete. 2024-01-30T08:09:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 Processor -- start 2024-01-30T08:09:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- start start 2024-01-30T08:09:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22414d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2240c1200 0x7ff224144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff224155500 0x7ff224145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240ab260 con 0x7ff22406f240 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240acda0 con 0x7ff2240c1200 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff22a000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240aaaf0 con 0x7ff224155500 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22414d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff222a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2240c1200 0x7ff224144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22414d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55438/0 (socket says 172.21.15.50:55438) 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 -- 172.21.15.50:0/4051032344 learned_addr learned my addr 172.21.15.50:0/4051032344 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223e00640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff224155500 0x7ff224145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 -- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff224155500 msgr2=0x7ff224145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff224155500 0x7ff224145440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 -- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2240c1200 msgr2=0x7ff224144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2240c1200 0x7ff224144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.874+0000 7ff223400640 1 -- 172.21.15.50:0/4051032344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0094d0 con 0x7ff22406f240 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff223400640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22414d8e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c7c0 tx=0x7ff21400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff21b400640 1 -- 172.21.15.50:0/4051032344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214007a30 con 0x7ff22406f240 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff21b400640 1 -- 172.21.15.50:0/4051032344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214007b90 con 0x7ff22406f240 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22414e6b0 con 0x7ff22406f240 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff21b400640 1 -- 172.21.15.50:0/4051032344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400ce70 con 0x7ff22406f240 2024-01-30T08:09:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2240ac750 con 0x7ff22406f240 2024-01-30T08:09:38.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224074a20 con 0x7ff22406f240 2024-01-30T08:09:38.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff21b400640 1 -- 172.21.15.50:0/4051032344 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff2140113f0 con 0x7ff22406f240 2024-01-30T08:09:38.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.878+0000 7ff21b400640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1fc066500 0x7ff1fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:38.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.882+0000 7ff21b400640 1 -- 172.21.15.50:0/4051032344 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff2140846c0 con 0x7ff22406f240 2024-01-30T08:09:38.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.882+0000 7ff222a00640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1fc066500 0x7ff1fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:38.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.882+0000 7ff222a00640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1fc066500 0x7ff1fc0689c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0af000 tx=0x7ff20c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:38.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:38.886+0000 7ff21b400640 1 -- 172.21.15.50:0/4051032344 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff214051640 con 0x7ff22406f240 2024-01-30T08:09:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.042+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2240c83c0 con 0x7ff22406f240 2024-01-30T08:09:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.042+0000 7ff21b400640 1 -- 172.21.15.50:0/4051032344 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff214054c60 con 0x7ff22406f240 2024-01-30T08:09:39.045 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:09:39.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1fc066500 msgr2=0x7ff1fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1fc066500 0x7ff1fc0689c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0af000 tx=0x7ff20c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:39.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 msgr2=0x7ff22414d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22414d8e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c7c0 tx=0x7ff21400cc80 comp rx=0 tx=0).stop 2024-01-30T08:09:39.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 shutdown_connections 2024-01-30T08:09:39.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2240c1200 0x7ff224144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1fc066500 0x7ff1fc0689c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff224155500 0x7ff224145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 --2- 172.21.15.50:0/4051032344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff22406f240 0x7ff22414d8e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 >> 172.21.15.50:0/4051032344 conn(0x7ff2240727c0 msgr2=0x7ff22406dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:39.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 shutdown_connections 2024-01-30T08:09:39.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.046+0000 7ff22a000640 1 -- 172.21.15.50:0/4051032344 wait complete. 2024-01-30T08:09:39.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-30T08:09:39.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f975bc00640 1 Processor -- start 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f975bc00640 1 -- start start 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f975bc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f975414fbf0 0x7f9754153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f975bc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97540c04b0 0x7f975406ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f975bc00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540c54e0 con 0x7f97540a4da0 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f975bc00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9754152bf0 con 0x7f975414fbf0 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f975bc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9754072d90 con 0x7f97540c04b0 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.210+0000 7f9759200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f975414fbf0 0x7f9754153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f975414fbf0 0x7f9754153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39250/0 (socket says 172.21.15.50:39250) 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9753e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f97540a4da0 0x7f97540c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41022/0 (socket says 172.21.15.50:41022) 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759200640 1 -- 172.21.15.50:0/2442537063 learned_addr learned my addr 172.21.15.50:0/2442537063 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:39.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759c00640 1 --2- 172.21.15.50:0/2442537063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97540c04b0 0x7f975406ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759200640 1 -- 172.21.15.50:0/2442537063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97540c04b0 msgr2=0x7f975406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759200640 1 --2- 172.21.15.50:0/2442537063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97540c04b0 0x7f975406ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759200640 1 -- 172.21.15.50:0/2442537063 >> v1:172.21.15.50:6789/0 conn(0x7f97540a4da0 legacy=0x7f97540c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759200640 1 -- 172.21.15.50:0/2442537063 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97541525e0 con 0x7f975414fbf0 2024-01-30T08:09:39.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9753400640 1 -- 172.21.15.50:0/2442537063 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408323284 0 0) 0x7f97540c54e0 con 0x7f97540a4da0 2024-01-30T08:09:39.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9759200640 1 --2- 172.21.15.50:0/2442537063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f975414fbf0 0x7f9754153080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9744009870 tx=0x7f974401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50fc69ee9369478 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9753400640 1 -- 172.21.15.50:0/2442537063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97440ac600 con 0x7f975414fbf0 2024-01-30T08:09:39.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9753400640 1 -- 172.21.15.50:0/2442537063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97440a8050 con 0x7f975414fbf0 2024-01-30T08:09:39.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.214+0000 7f9753400640 1 -- 172.21.15.50:0/2442537063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97440ac980 con 0x7f975414fbf0 2024-01-30T08:09:39.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- 172.21.15.50:0/2442537063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f975414fbf0 msgr2=0x7f9754153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 --2- 172.21.15.50:0/2442537063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f975414fbf0 0x7f9754153080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9744009870 tx=0x7f974401c4b0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- 172.21.15.50:0/2442537063 shutdown_connections 2024-01-30T08:09:39.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 --2- 172.21.15.50:0/2442537063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97540c04b0 0x7f975406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 --2- 172.21.15.50:0/2442537063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f975414fbf0 0x7f9754153080 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- 172.21.15.50:0/2442537063 >> 172.21.15.50:0/2442537063 conn(0x7f97540c5b30 msgr2=0x7f97540c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:39.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- 172.21.15.50:0/2442537063 shutdown_connections 2024-01-30T08:09:39.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- 172.21.15.50:0/2442537063 wait complete. 2024-01-30T08:09:39.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 Processor -- start 2024-01-30T08:09:39.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- start start 2024-01-30T08:09:39.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97540a4da0 0x7f975415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97540c04b0 0x7f975406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975414fbf0 0x7f9754154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754146f20 con 0x7f97540c04b0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97541f13c0 con 0x7f97540a4da0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f975bc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97541f07b0 con 0x7f975414fbf0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f9753e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97540c04b0 0x7f975406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f9753e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97540c04b0 0x7f975406d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39256/0 (socket says 172.21.15.50:39256) 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f9753e00640 1 -- 172.21.15.50:0/2469105034 learned_addr learned my addr 172.21.15.50:0/2469105034 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f9759c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975414fbf0 0x7f9754154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f9759200640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97540a4da0 0x7f975415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f9753e00640 1 -- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975414fbf0 msgr2=0x7f9754154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.218+0000 7f9753e00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975414fbf0 0x7f9754154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9753e00640 1 -- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97540a4da0 msgr2=0x7f975415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9753e00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97540a4da0 0x7f975415bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9753e00640 1 -- 172.21.15.50:0/2469105034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440094d0 con 0x7f97540c04b0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9753e00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97540c04b0 0x7f975406d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f973c0011f0 tx=0x7f973c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9750c00640 1 -- 172.21.15.50:0/2469105034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0074e0 con 0x7f97540c04b0 2024-01-30T08:09:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9750c00640 1 -- 172.21.15.50:0/2469105034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c007640 con 0x7f97540c04b0 2024-01-30T08:09:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9750c00640 1 -- 172.21.15.50:0/2469105034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c004a10 con 0x7f97540c04b0 2024-01-30T08:09:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97541f0a90 con 0x7f97540c04b0 2024-01-30T08:09:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97541f1050 con 0x7f97540c04b0 2024-01-30T08:09:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9754067cc0 con 0x7f97540c04b0 2024-01-30T08:09:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9750c00640 1 -- 172.21.15.50:0/2469105034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f973c004b70 con 0x7f97540c04b0 2024-01-30T08:09:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9750c00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f972c066500 0x7f972c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.222+0000 7f9750c00640 1 -- 172.21.15.50:0/2469105034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f973c083500 con 0x7f97540c04b0 2024-01-30T08:09:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.226+0000 7f9759200640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f972c066500 0x7f972c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.226+0000 7f9759200640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f972c066500 0x7f972c0689c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97440ae000 tx=0x7f97440a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.226+0000 7f9750c00640 1 -- 172.21.15.50:0/2469105034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f973c050400 con 0x7f97540c04b0 2024-01-30T08:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.386+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9754074a20 con 0x7f97540c04b0 2024-01-30T08:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.386+0000 7f9750c00640 1 -- 172.21.15.50:0/2469105034 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f973c053a20 con 0x7f97540c04b0 2024-01-30T08:09:39.388 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f972c066500 msgr2=0x7f972c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f972c066500 0x7f972c0689c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97440ae000 tx=0x7f97440a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97540c04b0 msgr2=0x7f975406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97540c04b0 0x7f975406d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f973c0011f0 tx=0x7f973c00c9b0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 shutdown_connections 2024-01-30T08:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f972c066500 0x7f972c0689c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f975414fbf0 0x7f9754154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97540c04b0 0x7f975406d300 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 --2- 172.21.15.50:0/2469105034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97540a4da0 0x7f975415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 >> 172.21.15.50:0/2469105034 conn(0x7f97540c5b30 msgr2=0x7f97540c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 shutdown_connections 2024-01-30T08:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.390+0000 7f975bc00640 1 -- 172.21.15.50:0/2469105034 wait complete. 2024-01-30T08:09:39.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:39.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.550+0000 7ff62e200640 1 Processor -- start 2024-01-30T08:09:39.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.550+0000 7ff62e200640 1 -- start start 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.550+0000 7ff62e200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c1840 0x7ff6280a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.550+0000 7ff62e200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6280c5650 0x7ff6280a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff62e200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6280c4760 0x7ff62806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff62e200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6280a8cf0 con 0x7ff6280c5650 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff62e200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff628072a30 con 0x7ff6280c4760 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff62e200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280a8f40 con 0x7ff6280c1840 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6280c5650 0x7ff6280a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6280c5650 0x7ff6280a5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39270/0 (socket says 172.21.15.50:39270) 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 -- 172.21.15.50:0/3030418538 learned_addr learned my addr 172.21.15.50:0/3030418538 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff627e00640 1 --2- 172.21.15.50:0/3030418538 >> v2:172.21.15.125:3300/0 conn(0x7ff6280c4760 0x7ff62806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff627400640 1 --2- 172.21.15.50:0/3030418538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c1840 0x7ff6280a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 -- 172.21.15.50:0/3030418538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c1840 msgr2=0x7ff6280a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 --2- 172.21.15.50:0/3030418538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c1840 0x7ff6280a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 -- 172.21.15.50:0/3030418538 >> v2:172.21.15.125:3300/0 conn(0x7ff6280c4760 msgr2=0x7ff62806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 --2- 172.21.15.50:0/3030418538 >> v2:172.21.15.125:3300/0 conn(0x7ff6280c4760 0x7ff62806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 -- 172.21.15.50:0/3030418538 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628072cd0 con 0x7ff6280c5650 2024-01-30T08:09:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626a00640 1 --2- 172.21.15.50:0/3030418538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c5650 0x7ff6280a5290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff62806c410 tx=0x7ff61001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f604e3839de9c34 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626000640 1 -- 172.21.15.50:0/3030418538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62806dc50 con 0x7ff6280c5650 2024-01-30T08:09:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626000640 1 -- 172.21.15.50:0/3030418538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6100ab660 con 0x7ff6280c5650 2024-01-30T08:09:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.554+0000 7ff626000640 1 -- 172.21.15.50:0/3030418538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6100ab9f0 con 0x7ff6280c5650 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- 172.21.15.50:0/3030418538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c5650 msgr2=0x7ff6280a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 --2- 172.21.15.50:0/3030418538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c5650 0x7ff6280a5290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff62806c410 tx=0x7ff61001c500 comp rx=0 tx=0).stop 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- 172.21.15.50:0/3030418538 shutdown_connections 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 --2- 172.21.15.50:0/3030418538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c5650 0x7ff6280a5290 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 --2- 172.21.15.50:0/3030418538 >> v2:172.21.15.125:3300/0 conn(0x7ff6280c4760 0x7ff62806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 --2- 172.21.15.50:0/3030418538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c1840 0x7ff6280a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- 172.21.15.50:0/3030418538 >> 172.21.15.50:0/3030418538 conn(0x7ff6280c5b50 msgr2=0x7ff6280c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- 172.21.15.50:0/3030418538 shutdown_connections 2024-01-30T08:09:39.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- 172.21.15.50:0/3030418538 wait complete. 2024-01-30T08:09:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 Processor -- start 2024-01-30T08:09:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- start start 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c1840 0x7ff628150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c4760 0x7ff628150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6280c5650 0x7ff6281536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628150550 con 0x7ff6280c1840 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628156080 con 0x7ff6280c5650 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff62e200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62814fd30 con 0x7ff6280c4760 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff627400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c1840 0x7ff628150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff627400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c1840 0x7ff628150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39280/0 (socket says 172.21.15.50:39280) 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff627400640 1 -- 172.21.15.50:0/1651136308 learned_addr learned my addr 172.21.15.50:0/1651136308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff627e00640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6280c5650 0x7ff6281536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.558+0000 7ff626a00640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c4760 0x7ff628150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff627400640 1 -- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c4760 msgr2=0x7ff628150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff627400640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c4760 0x7ff628150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff627400640 1 -- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6280c5650 msgr2=0x7ff6281536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff627400640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6280c5650 0x7ff6281536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff627400640 1 -- 172.21.15.50:0/1651136308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6100094d0 con 0x7ff6280c1840 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff627e00640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6280c5650 0x7ff6281536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff627400640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c1840 0x7ff628150c60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff61800d800 tx=0x7ff61800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff61f400640 1 -- 172.21.15.50:0/1651136308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800b6c0 con 0x7ff6280c1840 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff61f400640 1 -- 172.21.15.50:0/1651136308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800b860 con 0x7ff6280c1840 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff628155da0 con 0x7ff6280c1840 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff61f400640 1 -- 172.21.15.50:0/1651136308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800bc10 con 0x7ff6280c1840 2024-01-30T08:09:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff628150730 con 0x7ff6280c1840 2024-01-30T08:09:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff628074a20 con 0x7ff6280c1840 2024-01-30T08:09:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff61f400640 1 -- 172.21.15.50:0/1651136308 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff61801e460 con 0x7ff6280c1840 2024-01-30T08:09:39.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff61f400640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff600066530 0x7ff6000689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.562+0000 7ff61f400640 1 -- 172.21.15.50:0/1651136308 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff618084760 con 0x7ff6280c1840 2024-01-30T08:09:39.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.566+0000 7ff626a00640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff600066530 0x7ff6000689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.566+0000 7ff626a00640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff600066530 0x7ff6000689f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff6100af000 tx=0x7ff6100a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.566+0000 7ff61f400640 1 -- 172.21.15.50:0/1651136308 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff618051650 con 0x7ff6280c1840 2024-01-30T08:09:39.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.758+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6280c4540 con 0x7ff6280c1840 2024-01-30T08:09:39.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.758+0000 7ff61f400640 1 -- 172.21.15.50:0/1651136308 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7ff618054c70 con 0x7ff6280c1840 2024-01-30T08:09:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:39.760 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff600066530 msgr2=0x7ff6000689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff600066530 0x7ff6000689f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff6100af000 tx=0x7ff6100a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c1840 msgr2=0x7ff628150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c1840 0x7ff628150c60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff61800d800 tx=0x7ff61800dcc0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 shutdown_connections 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6280c5650 0x7ff6281536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff600066530 0x7ff6000689f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6280c4760 0x7ff628150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 --2- 172.21.15.50:0/1651136308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6280c1840 0x7ff628150c60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 >> 172.21.15.50:0/1651136308 conn(0x7ff6280c5b50 msgr2=0x7ff6280c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 shutdown_connections 2024-01-30T08:09:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.762+0000 7ff62e200640 1 -- 172.21.15.50:0/1651136308 wait complete. 2024-01-30T08:09:39.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.922+0000 7fe626e00640 1 Processor -- start 2024-01-30T08:09:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.922+0000 7fe626e00640 1 -- start start 2024-01-30T08:09:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe626e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe62014fbf0 0x7fe6201559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe626e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6200c1de0 0x7fe62006a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe626e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6200c3ed0 con 0x7fe6200c0ee0 2024-01-30T08:09:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe626e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6200a5520 con 0x7fe62014fbf0 2024-01-30T08:09:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe626e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62006bca0 con 0x7fe6200c1de0 2024-01-30T08:09:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe62014fbf0 0x7fe6201559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe62014fbf0 0x7fe6201559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39294/0 (socket says 172.21.15.50:39294) 2024-01-30T08:09:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 -- 172.21.15.50:0/1240031691 learned_addr learned my addr 172.21.15.50:0/1240031691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe624e00640 1 --2- 172.21.15.50:0/1240031691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6200c1de0 0x7fe62006a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 -- 172.21.15.50:0/1240031691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6200c1de0 msgr2=0x7fe62006a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 --2- 172.21.15.50:0/1240031691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6200c1de0 0x7fe62006a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 -- 172.21.15.50:0/1240031691 >> v1:172.21.15.125:6789/0 conn(0x7fe6200c0ee0 legacy=0x7fe6200a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 -- 172.21.15.50:0/1240031691 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62006bef0 con 0x7fe62014fbf0 2024-01-30T08:09:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe624e00640 1 --2- 172.21.15.50:0/1240031691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6200c1de0 0x7fe62006a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.926+0000 7fe61fe00640 1 --2- 172.21.15.50:0/1240031691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62014fbf0 0x7fe6201559c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce9c941dd924892 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe61ea00640 1 -- 172.21.15.50:0/1240031691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100ac620 con 0x7fe62014fbf0 2024-01-30T08:09:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe61ea00640 1 -- 172.21.15.50:0/1240031691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6100ac780 con 0x7fe62014fbf0 2024-01-30T08:09:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe61ea00640 1 -- 172.21.15.50:0/1240031691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100acb10 con 0x7fe62014fbf0 2024-01-30T08:09:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 -- 172.21.15.50:0/1240031691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62014fbf0 msgr2=0x7fe6201559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 --2- 172.21.15.50:0/1240031691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62014fbf0 0x7fe6201559c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61001c3e0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 -- 172.21.15.50:0/1240031691 shutdown_connections 2024-01-30T08:09:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 --2- 172.21.15.50:0/1240031691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6200c1de0 0x7fe62006a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 --2- 172.21.15.50:0/1240031691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe62014fbf0 0x7fe6201559c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 -- 172.21.15.50:0/1240031691 >> 172.21.15.50:0/1240031691 conn(0x7fe6200c5b50 msgr2=0x7fe6200c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 -- 172.21.15.50:0/1240031691 shutdown_connections 2024-01-30T08:09:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 -- 172.21.15.50:0/1240031691 wait complete. 2024-01-30T08:09:39.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 Processor -- start 2024-01-30T08:09:39.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 -- start start 2024-01-30T08:09:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6200c0ee0 0x7fe62014b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6200c1de0 0x7fe620149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.930+0000 7fe626e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe62014fbf0 0x7fe62014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe626e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6201eb050 con 0x7fe6200c0ee0 2024-01-30T08:09:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe626e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62014c840 con 0x7fe6200c1de0 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe626e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200aa8d0 con 0x7fe62014fbf0 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6200c0ee0 0x7fe62014b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6200c0ee0 0x7fe62014b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39306/0 (socket says 172.21.15.50:39306) 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 -- 172.21.15.50:0/3981549936 learned_addr learned my addr 172.21.15.50:0/3981549936 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe624e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe62014fbf0 0x7fe62014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61f400640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6200c1de0 0x7fe620149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 -- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe62014fbf0 msgr2=0x7fe62014c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe62014fbf0 0x7fe62014c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 -- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6200c1de0 msgr2=0x7fe620149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6200c1de0 0x7fe620149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 -- 172.21.15.50:0/3981549936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100094d0 con 0x7fe6200c0ee0 2024-01-30T08:09:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe61fe00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6200c0ee0 0x7fe62014b090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6100af040 tx=0x7fe610019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe617e00640 1 -- 172.21.15.50:0/3981549936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100ac620 con 0x7fe6200c0ee0 2024-01-30T08:09:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe617e00640 1 -- 172.21.15.50:0/3981549936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6100b7670 con 0x7fe6200c0ee0 2024-01-30T08:09:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe617e00640 1 -- 172.21.15.50:0/3981549936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100b7a20 con 0x7fe6200c0ee0 2024-01-30T08:09:39.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6200aabb0 con 0x7fe6200c0ee0 2024-01-30T08:09:39.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62014a440 con 0x7fe6200c0ee0 2024-01-30T08:09:39.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6200aa620 con 0x7fe6200c0ee0 2024-01-30T08:09:39.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.934+0000 7fe617e00640 1 -- 172.21.15.50:0/3981549936 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe6100b3070 con 0x7fe6200c0ee0 2024-01-30T08:09:39.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.938+0000 7fe617e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe5f8066500 0x7fe5f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:39.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.938+0000 7fe617e00640 1 -- 172.21.15.50:0/3981549936 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe61011e900 con 0x7fe6200c0ee0 2024-01-30T08:09:39.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.938+0000 7fe61f400640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe5f8066500 0x7fe5f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:39.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.938+0000 7fe61f400640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe5f8066500 0x7fe5f80689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe620153280 tx=0x7fe608009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:39.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:39.942+0000 7fe617e00640 1 -- 172.21.15.50:0/3981549936 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe6100eb920 con 0x7fe6200c0ee0 2024-01-30T08:09:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.098+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe620074a20 con 0x7fe6200c0ee0 2024-01-30T08:09:40.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe617e00640 1 -- 172.21.15.50:0/3981549936 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18735 (secure 0 0 0) 0x7fe6100b1090 con 0x7fe6200c0ee0 2024-01-30T08:09:40.102 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:40.102 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:30.858267+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe5f8066500 msgr2=0x7fe5f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe5f8066500 0x7fe5f80689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe620153280 tx=0x7fe608009060 comp rx=0 tx=0).stop 2024-01-30T08:09:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6200c0ee0 msgr2=0x7fe62014b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6200c0ee0 0x7fe62014b090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6100af040 tx=0x7fe610019180 comp rx=0 tx=0).stop 2024-01-30T08:09:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 shutdown_connections 2024-01-30T08:09:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6200c1de0 0x7fe620149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe5f8066500 0x7fe5f80689c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe62014fbf0 0x7fe62014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 --2- 172.21.15.50:0/3981549936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6200c0ee0 0x7fe62014b090 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 >> 172.21.15.50:0/3981549936 conn(0x7fe6200c5b50 msgr2=0x7fe620070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 shutdown_connections 2024-01-30T08:09:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.102+0000 7fe626e00640 1 -- 172.21.15.50:0/3981549936 wait complete. 2024-01-30T08:09:40.125 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-30T08:09:40.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b4000640 1 Processor -- start 2024-01-30T08:09:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b4000640 1 -- start start 2024-01-30T08:09:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b4000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6ac06de40 0x7fb6ac06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b4000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6ac0c4310 0x7fb6ac155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b4000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac152f00 con 0x7fb6ac153390 2024-01-30T08:09:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b4000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac1525f0 con 0x7fb6ac0c4310 2024-01-30T08:09:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b4000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac0a7680 con 0x7fb6ac06de40 2024-01-30T08:09:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b2000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6ac0c4310 0x7fb6ac155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b2000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6ac0c4310 0x7fb6ac155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39320/0 (socket says 172.21.15.50:39320) 2024-01-30T08:09:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b2000640 1 -- 172.21.15.50:0/788666237 learned_addr learned my addr 172.21.15.50:0/788666237 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b1600640 1 --2- 172.21.15.50:0/788666237 >> v2:172.21.15.125:3300/0 conn(0x7fb6ac06de40 0x7fb6ac06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b2000640 1 -- 172.21.15.50:0/788666237 >> v2:172.21.15.125:3300/0 conn(0x7fb6ac06de40 msgr2=0x7fb6ac06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b2000640 1 --2- 172.21.15.50:0/788666237 >> v2:172.21.15.125:3300/0 conn(0x7fb6ac06de40 0x7fb6ac06e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b2000640 1 -- 172.21.15.50:0/788666237 >> v1:172.21.15.125:6789/0 conn(0x7fb6ac153390 legacy=0x7fb6ac0a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.266+0000 7fb6b2000640 1 -- 172.21.15.50:0/788666237 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac1528b0 con 0x7fb6ac0c4310 2024-01-30T08:09:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b2000640 1 --2- 172.21.15.50:0/788666237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac0c4310 0x7fb6ac155be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac073f80 tx=0x7fb6a401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1809546bba54fd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6abe00640 1 -- 172.21.15.50:0/788666237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40a5650 con 0x7fb6ac0c4310 2024-01-30T08:09:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6abe00640 1 -- 172.21.15.50:0/788666237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a40a57b0 con 0x7fb6ac0c4310 2024-01-30T08:09:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6abe00640 1 -- 172.21.15.50:0/788666237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40a5b40 con 0x7fb6ac0c4310 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 -- 172.21.15.50:0/788666237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac0c4310 msgr2=0x7fb6ac155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 --2- 172.21.15.50:0/788666237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac0c4310 0x7fb6ac155be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac073f80 tx=0x7fb6a401c880 comp rx=0 tx=0).stop 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 -- 172.21.15.50:0/788666237 shutdown_connections 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 --2- 172.21.15.50:0/788666237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac0c4310 0x7fb6ac155be0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 --2- 172.21.15.50:0/788666237 >> v2:172.21.15.125:3300/0 conn(0x7fb6ac06de40 0x7fb6ac06e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 -- 172.21.15.50:0/788666237 >> 172.21.15.50:0/788666237 conn(0x7fb6ac0c4830 msgr2=0x7fb6ac0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 -- 172.21.15.50:0/788666237 shutdown_connections 2024-01-30T08:09:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.270+0000 7fb6b4000640 1 -- 172.21.15.50:0/788666237 wait complete. 2024-01-30T08:09:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 Processor -- start 2024-01-30T08:09:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 -- start start 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac06de40 0x7fb6ac0c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6ac0c4310 0x7fb6ac15c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6ac153390 0x7fb6ac1eb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0c1d10 con 0x7fb6ac06de40 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0c08c0 con 0x7fb6ac0c4310 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0c0b60 con 0x7fb6ac153390 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac06de40 0x7fb6ac0c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac06de40 0x7fb6ac0c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39336/0 (socket says 172.21.15.50:39336) 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 -- 172.21.15.50:0/1720286649 learned_addr learned my addr 172.21.15.50:0/1720286649 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b0c00640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6ac0c4310 0x7fb6ac15c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b2000640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6ac153390 0x7fb6ac1eb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 -- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6ac153390 msgr2=0x7fb6ac1eb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6ac153390 0x7fb6ac1eb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 -- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6ac0c4310 msgr2=0x7fb6ac15c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6ac0c4310 0x7fb6ac15c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 -- 172.21.15.50:0/1720286649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4009b30 con 0x7fb6ac06de40 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b1600640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac06de40 0x7fb6ac0c1730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00d800 tx=0x7fb69c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6a9600640 1 -- 172.21.15.50:0/1720286649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00b6c0 con 0x7fb6ac06de40 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6a9600640 1 -- 172.21.15.50:0/1720286649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00b820 con 0x7fb6ac06de40 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6a9600640 1 -- 172.21.15.50:0/1720286649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00bb90 con 0x7fb6ac06de40 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0c0e40 con 0x7fb6ac06de40 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.274+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac1eaf10 con 0x7fb6ac06de40 2024-01-30T08:09:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.278+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac074a20 con 0x7fb6ac06de40 2024-01-30T08:09:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.278+0000 7fb6a9600640 1 -- 172.21.15.50:0/1720286649 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb69c00bcf0 con 0x7fb6ac06de40 2024-01-30T08:09:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.278+0000 7fb6a9600640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb684066500 0x7fb6840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.278+0000 7fb6a9600640 1 -- 172.21.15.50:0/1720286649 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb69c0846d0 con 0x7fb6ac06de40 2024-01-30T08:09:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.278+0000 7fb6b0c00640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb684066500 0x7fb6840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.278+0000 7fb6b0c00640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb684066500 0x7fb6840689c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac072200 tx=0x7fb694009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.282+0000 7fb6a9600640 1 -- 172.21.15.50:0/1720286649 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb69c0515d0 con 0x7fb6ac06de40 2024-01-30T08:09:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.470+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6ac153a70 con 0x7fb6ac06de40 2024-01-30T08:09:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6a9600640 1 -- 172.21.15.50:0/1720286649 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7fb69c054bf0 con 0x7fb6ac06de40 2024-01-30T08:09:40.473 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:40.473 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:40.474 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:40.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb684066500 msgr2=0x7fb6840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb684066500 0x7fb6840689c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac072200 tx=0x7fb694009040 comp rx=0 tx=0).stop 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac06de40 msgr2=0x7fb6ac0c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac06de40 0x7fb6ac0c1730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00d800 tx=0x7fb69c00dcc0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 shutdown_connections 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6ac0c4310 0x7fb6ac15c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb684066500 0x7fb6840689c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6ac153390 0x7fb6ac1eb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 --2- 172.21.15.50:0/1720286649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6ac06de40 0x7fb6ac0c1730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 >> 172.21.15.50:0/1720286649 conn(0x7fb6ac0c4830 msgr2=0x7fb6ac0c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 shutdown_connections 2024-01-30T08:09:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.474+0000 7fb6b4000640 1 -- 172.21.15.50:0/1720286649 wait complete. 2024-01-30T08:09:40.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.638+0000 7fc00ca00640 1 Processor -- start 2024-01-30T08:09:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.638+0000 7fc00ca00640 1 -- start start 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.638+0000 7fc00ca00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc0040c1840 0x7fc0040a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.638+0000 7fc00ca00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0040c4760 0x7fc0040a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.638+0000 7fc00ca00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040a8cf0 con 0x7fc0040c5650 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.638+0000 7fc00ca00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc004072a30 con 0x7fc0040c4760 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.638+0000 7fc00ca00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0040a8f40 con 0x7fc0040c1840 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0040c4760 0x7fc0040a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc009600640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc0040c5650 0x7fc00406cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41028/0 (socket says 172.21.15.50:41028) 2024-01-30T08:09:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc009600640 1 -- 172.21.15.50:0/2610720219 learned_addr learned my addr 172.21.15.50:0/2610720219 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00a000640 1 --2- 172.21.15.50:0/2610720219 >> v2:172.21.15.125:3300/0 conn(0x7fc0040c1840 0x7fc0040a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00aa00640 1 -- 172.21.15.50:0/2610720219 >> v2:172.21.15.125:3300/0 conn(0x7fc0040c1840 msgr2=0x7fc0040a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00aa00640 1 --2- 172.21.15.50:0/2610720219 >> v2:172.21.15.125:3300/0 conn(0x7fc0040c1840 0x7fc0040a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00aa00640 1 -- 172.21.15.50:0/2610720219 >> v1:172.21.15.50:6789/0 conn(0x7fc0040c5650 legacy=0x7fc00406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc008c00640 1 -- 172.21.15.50:0/2610720219 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441931689 0 0) 0x7fc0040a8cf0 con 0x7fc0040c5650 2024-01-30T08:09:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00aa00640 1 -- 172.21.15.50:0/2610720219 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004072cd0 con 0x7fc0040c4760 2024-01-30T08:09:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00a000640 1 --2- 172.21.15.50:0/2610720219 >> v2:172.21.15.125:3300/0 conn(0x7fc0040c1840 0x7fc0040a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc00aa00640 1 --2- 172.21.15.50:0/2610720219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c4760 0x7fc0040a5290 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc00406b770 tx=0x7fbffc01ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ad334c3b536e13 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc008c00640 1 -- 172.21.15.50:0/2610720219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00b2d0 con 0x7fc0040c4760 2024-01-30T08:09:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc008c00640 1 -- 172.21.15.50:0/2610720219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc0a77f0 con 0x7fc0040c4760 2024-01-30T08:09:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.642+0000 7fc008c00640 1 -- 172.21.15.50:0/2610720219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a7b80 con 0x7fc0040c4760 2024-01-30T08:09:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- 172.21.15.50:0/2610720219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c4760 msgr2=0x7fc0040a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 --2- 172.21.15.50:0/2610720219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c4760 0x7fc0040a5290 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc00406b770 tx=0x7fbffc01ea80 comp rx=0 tx=0).stop 2024-01-30T08:09:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- 172.21.15.50:0/2610720219 shutdown_connections 2024-01-30T08:09:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 --2- 172.21.15.50:0/2610720219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c4760 0x7fc0040a5290 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 --2- 172.21.15.50:0/2610720219 >> v2:172.21.15.125:3300/0 conn(0x7fc0040c1840 0x7fc0040a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- 172.21.15.50:0/2610720219 >> 172.21.15.50:0/2610720219 conn(0x7fc0040c5b50 msgr2=0x7fc0040c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- 172.21.15.50:0/2610720219 shutdown_connections 2024-01-30T08:09:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- 172.21.15.50:0/2610720219 wait complete. 2024-01-30T08:09:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 Processor -- start 2024-01-30T08:09:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- start start 2024-01-30T08:09:40.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0040c1840 0x7fc0040705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0040c4760 0x7fc00414c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c5650 0x7fc00414c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0041550d0 con 0x7fc0040c5650 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00414cf40 con 0x7fc0040c4760 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00ca00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00414e460 con 0x7fc0040c1840 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c5650 0x7fc00414c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c5650 0x7fc00414c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39350/0 (socket says 172.21.15.50:39350) 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00aa00640 1 -- 172.21.15.50:0/1465720923 learned_addr learned my addr 172.21.15.50:0/1465720923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc009600640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0040c4760 0x7fc00414c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.646+0000 7fc00a000640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0040c1840 0x7fc0040705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00aa00640 1 -- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0040c1840 msgr2=0x7fc0040705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00aa00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0040c1840 0x7fc0040705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00aa00640 1 -- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0040c4760 msgr2=0x7fc00414c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00aa00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0040c4760 0x7fc00414c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00aa00640 1 -- 172.21.15.50:0/1465720923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc00bc80 con 0x7fc0040c5650 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc009600640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0040c4760 0x7fc00414c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00aa00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c5650 0x7fc00414c930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbffc01b690 tx=0x7fbffc01b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc002000640 1 -- 172.21.15.50:0/1465720923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc009740 con 0x7fc0040c5650 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc002000640 1 -- 172.21.15.50:0/1465720923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc0098c0 con 0x7fc0040c5650 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00414e740 con 0x7fc0040c5650 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc002000640 1 -- 172.21.15.50:0/1465720923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc009cb0 con 0x7fc0040c5650 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0041f1250 con 0x7fc0040c5650 2024-01-30T08:09:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0041f1440 con 0x7fc0040c5650 2024-01-30T08:09:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc002000640 1 -- 172.21.15.50:0/1465720923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbffc0c3460 con 0x7fc0040c5650 2024-01-30T08:09:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc002000640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfdc066500 0x7fbfdc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.650+0000 7fc002000640 1 -- 172.21.15.50:0/1465720923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbffc11f740 con 0x7fc0040c5650 2024-01-30T08:09:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.654+0000 7fc00a000640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfdc066500 0x7fbfdc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.654+0000 7fc00a000640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfdc066500 0x7fbfdc0689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:40.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.654+0000 7fc002000640 1 -- 172.21.15.50:0/1465720923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbffc0ec580 con 0x7fc0040c5650 2024-01-30T08:09:40.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.850+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc004074a20 con 0x7fc0040c5650 2024-01-30T08:09:40.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.850+0000 7fc002000640 1 -- 172.21.15.50:0/1465720923 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4934 (secure 0 0 0) 0x7fbffc0efba0 con 0x7fc0040c5650 2024-01-30T08:09:40.852 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:40.852 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3390820830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3390820830},{"type":"v1","addr":"172.21.15.50:6834","nonce":3390820830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1411556555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1411556555},{"type":"v1","addr":"172.21.15.50:6835","nonce":1411556555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/192942029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":192942029},{"type":"v1","addr":"172.21.15.125:6836","nonce":192942029}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:08:41.658963+0000","modified":"2024-01-30T08:09:05.561508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/987731246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":987731246},{"type":"v1","addr":"172.21.15.125:6837","nonce":987731246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-30T08:09:40.853 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-01-30T08:09:40.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfdc066500 msgr2=0x7fbfdc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfdc066500 0x7fbfdc0689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).stop 2024-01-30T08:09:40.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c5650 msgr2=0x7fc00414c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:40.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c5650 0x7fc00414c930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbffc01b690 tx=0x7fbffc01b820 comp rx=0 tx=0).stop 2024-01-30T08:09:40.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 shutdown_connections 2024-01-30T08:09:40.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0040c4760 0x7fc00414c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfdc066500 0x7fbfdc0689c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0040c5650 0x7fc00414c930 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 --2- 172.21.15.50:0/1465720923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0040c1840 0x7fc0040705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:40.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 >> 172.21.15.50:0/1465720923 conn(0x7fc0040c5b50 msgr2=0x7fc0040a4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:40.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 shutdown_connections 2024-01-30T08:09:40.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:40.854+0000 7fc00ca00640 1 -- 172.21.15.50:0/1465720923 wait complete. 2024-01-30T08:09:40.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f998f600640 1 Processor -- start 2024-01-30T08:09:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f998f600640 1 -- start start 2024-01-30T08:09:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f998f600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f998814fbf0 0x7f99881559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f998f600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880c3ed0 con 0x7f99880c0ee0 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f998f600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998806bca0 con 0x7f99880c1de0 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f998f600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880a5520 con 0x7f998814fbf0 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f998cc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f998814fbf0 0x7f99881559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.014+0000 7f9987e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99880c0ee0 0x7f99880a4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41038/0 (socket says 172.21.15.50:41038) 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f9987e00640 1 -- 172.21.15.50:0/776677832 learned_addr learned my addr 172.21.15.50:0/776677832 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f998cc00640 1 -- 172.21.15.50:0/776677832 >> v1:172.21.15.125:6789/0 conn(0x7f99880c1de0 legacy=0x7f998806a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f998cc00640 1 -- 172.21.15.50:0/776677832 >> v1:172.21.15.50:6789/0 conn(0x7f99880c0ee0 legacy=0x7f99880a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f998cc00640 1 -- 172.21.15.50:0/776677832 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998806bef0 con 0x7f998814fbf0 2024-01-30T08:09:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f998cc00640 1 --2- 172.21.15.50:0/776677832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f99881559c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99780097c0 tx=0x7f997801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb84fb85c15da64 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f9987400640 1 -- 172.21.15.50:0/776677832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780ad680 con 0x7f998814fbf0 2024-01-30T08:09:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f9987400640 1 -- 172.21.15.50:0/776677832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99780ad7e0 con 0x7f998814fbf0 2024-01-30T08:09:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.018+0000 7f9987400640 1 -- 172.21.15.50:0/776677832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780adb70 con 0x7f998814fbf0 2024-01-30T08:09:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- 172.21.15.50:0/776677832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 msgr2=0x7f99881559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 --2- 172.21.15.50:0/776677832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f99881559c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99780097c0 tx=0x7f997801c360 comp rx=0 tx=0).stop 2024-01-30T08:09:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- 172.21.15.50:0/776677832 shutdown_connections 2024-01-30T08:09:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 --2- 172.21.15.50:0/776677832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f99881559c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- 172.21.15.50:0/776677832 >> 172.21.15.50:0/776677832 conn(0x7f99880c5b50 msgr2=0x7f99880c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:41.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- 172.21.15.50:0/776677832 shutdown_connections 2024-01-30T08:09:41.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- 172.21.15.50:0/776677832 wait complete. 2024-01-30T08:09:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 Processor -- start 2024-01-30T08:09:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- start start 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99880c0ee0 0x7f99881ef130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99880c1de0 0x7f99881465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f9988153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99881514e0 con 0x7f998814fbf0 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99881ef670 con 0x7f99880c1de0 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998f600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9988150740 con 0x7f99880c0ee0 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f9988153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f9988153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39368/0 (socket says 172.21.15.50:39368) 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 -- 172.21.15.50:0/2005849952 learned_addr learned my addr 172.21.15.50:0/2005849952 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f9987e00640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99880c1de0 0x7f99881465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998cc00640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99880c0ee0 0x7f99881ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 -- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99880c0ee0 msgr2=0x7f99881ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99880c0ee0 0x7f99881ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 -- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99880c1de0 msgr2=0x7f99881465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99880c1de0 0x7f99881465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.022+0000 7f998d600640 1 -- 172.21.15.50:0/2005849952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009420 con 0x7f998814fbf0 2024-01-30T08:09:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f998d600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f9988153f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f998000c730 tx=0x7f998000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f9984c00640 1 -- 172.21.15.50:0/2005849952 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980003b80 con 0x7f998814fbf0 2024-01-30T08:09:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f9984c00640 1 -- 172.21.15.50:0/2005849952 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9980003ce0 con 0x7f998814fbf0 2024-01-30T08:09:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9988150460 con 0x7f998814fbf0 2024-01-30T08:09:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f9984c00640 1 -- 172.21.15.50:0/2005849952 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000aa30 con 0x7f998814fbf0 2024-01-30T08:09:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9988151100 con 0x7f998814fbf0 2024-01-30T08:09:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9988151620 con 0x7f998814fbf0 2024-01-30T08:09:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f9984c00640 1 -- 172.21.15.50:0/2005849952 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f998000ab90 con 0x7f998814fbf0 2024-01-30T08:09:41.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f9984c00640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9960066530 0x7f99600689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f9984c00640 1 -- 172.21.15.50:0/2005849952 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9980083e90 con 0x7f998814fbf0 2024-01-30T08:09:41.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.026+0000 7f998cc00640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9960066530 0x7f99600689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.030+0000 7f998cc00640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9960066530 0x7f99600689f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99780af000 tx=0x7f99780a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.030+0000 7f9984c00640 1 -- 172.21.15.50:0/2005849952 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9980050e10 con 0x7f998814fbf0 2024-01-30T08:09:41.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.194+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9988074a20 con 0x7f998814fbf0 2024-01-30T08:09:41.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.194+0000 7f9984c00640 1 -- 172.21.15.50:0/2005849952 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18735 (secure 0 0 0) 0x7f9980085090 con 0x7f998814fbf0 2024-01-30T08:09:41.195 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:41.195 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:30.858267+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:08:39.607431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-30T08:08:40.654969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-30T08:08:44.324249+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.194+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9960066530 msgr2=0x7f99600689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.194+0000 7f998f600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9960066530 0x7f99600689f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99780af000 tx=0x7f99780a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.194+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 msgr2=0x7f9988153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.194+0000 7f998f600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f9988153f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f998000c730 tx=0x7f998000cbf0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 shutdown_connections 2024-01-30T08:09:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99880c1de0 0x7f99881465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9960066530 0x7f99600689f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f998814fbf0 0x7f9988153f20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 --2- 172.21.15.50:0/2005849952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f99880c0ee0 0x7f99881ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 >> 172.21.15.50:0/2005849952 conn(0x7f99880c5b50 msgr2=0x7f99880a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:41.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 shutdown_connections 2024-01-30T08:09:41.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.198+0000 7f998f600640 1 -- 172.21.15.50:0/2005849952 wait complete. 2024-01-30T08:09:41.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-30T08:09:41.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b41e00640 1 Processor -- start 2024-01-30T08:09:41.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b41e00640 1 -- start start 2024-01-30T08:09:41.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b41e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c14f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b41e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0c7520 con 0x7f1b3c14fc40 2024-01-30T08:09:41.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b41e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0c6f10 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b41e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0c79b0 con 0x7f1b3c0a7000 2024-01-30T08:09:41.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b3b400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1b3c14fc40 0x7f1b3c155a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41050/0 (socket says 172.21.15.50:41050) 2024-01-30T08:09:41.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b3b400640 1 -- 172.21.15.50:0/2753017086 learned_addr learned my addr 172.21.15.50:0/2753017086 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:41.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b3a000640 1 --2- 172.21.15.50:0/2753017086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b39600640 1 -- 172.21.15.50:0/2753017086 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277052553 0 0) 0x7f1b3c0c7520 con 0x7f1b3c14fc40 2024-01-30T08:09:41.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b39600640 1 -- 172.21.15.50:0/2753017086 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b1c003530 con 0x7f1b3c14fc40 2024-01-30T08:09:41.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b39600640 1 -- 172.21.15.50:0/2753017086 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780324363 0 0) 0x7f1b3c0c6f10 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b39600640 1 -- 172.21.15.50:0/2753017086 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b3c0c7520 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b3a000640 1 -- 172.21.15.50:0/2753017086 >> v1:172.21.15.125:6789/0 conn(0x7f1b3c0c4a30 legacy=0x7f1b3c0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b3a000640 1 -- 172.21.15.50:0/2753017086 >> v1:172.21.15.50:6789/0 conn(0x7f1b3c14fc40 legacy=0x7f1b3c155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.362+0000 7f1b3a000640 1 -- 172.21.15.50:0/2753017086 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0adc60 con 0x7f1b3c0a7000 2024-01-30T08:09:41.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b3a000640 1 --2- 172.21.15.50:0/2753017086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c14f700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b240097f0 tx=0x7f1b2401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f98382446bcb32d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b39600640 1 -- 172.21.15.50:0/2753017086 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240ac630 con 0x7f1b3c0a7000 2024-01-30T08:09:41.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b39600640 1 -- 172.21.15.50:0/2753017086 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b240ac790 con 0x7f1b3c0a7000 2024-01-30T08:09:41.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b39600640 1 -- 172.21.15.50:0/2753017086 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240acb20 con 0x7f1b3c0a7000 2024-01-30T08:09:41.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b41e00640 1 -- 172.21.15.50:0/2753017086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 msgr2=0x7f1b3c14f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2753017086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c14f700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b240097f0 tx=0x7f1b2401c4c0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b41e00640 1 -- 172.21.15.50:0/2753017086 shutdown_connections 2024-01-30T08:09:41.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2753017086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c14f700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.366+0000 7f1b41e00640 1 -- 172.21.15.50:0/2753017086 >> 172.21.15.50:0/2753017086 conn(0x7f1b3c06ad40 msgr2=0x7f1b3c0c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:41.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 -- 172.21.15.50:0/2753017086 shutdown_connections 2024-01-30T08:09:41.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 -- 172.21.15.50:0/2753017086 wait complete. 2024-01-30T08:09:41.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 Processor -- start 2024-01-30T08:09:41.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 -- start start 2024-01-30T08:09:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c0a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b3c0c4a30 0x7f1b3c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b3c14fc40 0x7f1b3c0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c154570 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c14e5f0 con 0x7f1b3c14fc40 2024-01-30T08:09:41.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c14e8d0 con 0x7f1b3c0a7000 2024-01-30T08:09:41.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b3c0c4a30 0x7f1b3c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b3c0c4a30 0x7f1b3c0c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39372/0 (socket says 172.21.15.50:39372) 2024-01-30T08:09:41.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 -- 172.21.15.50:0/2642734012 learned_addr learned my addr 172.21.15.50:0/2642734012 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:41.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3b400640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b3c14fc40 0x7f1b3c0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3aa00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c0a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 -- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 msgr2=0x7f1b3c0a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c0a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 -- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b3c14fc40 msgr2=0x7f1b3c0a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b3c14fc40 0x7f1b3c0a5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 -- 172.21.15.50:0/2642734012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009420 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3aa00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c0a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3b400640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b3c14fc40 0x7f1b3c0a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b3a000640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b3c0c4a30 0x7f1b3c0c3e00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1b240190d0 tx=0x7f1b24019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b33400640 1 -- 172.21.15.50:0/2642734012 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240b5610 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b33400640 1 -- 172.21.15.50:0/2642734012 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b240b5790 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b33400640 1 -- 172.21.15.50:0/2642734012 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240b5b40 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.370+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c14ebb0 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.374+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c14f170 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.374+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c04ead0 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.374+0000 7f1b33400640 1 -- 172.21.15.50:0/2642734012 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1b240b3040 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.374+0000 7f1b33400640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1b14066500 0x7f1b140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.374+0000 7f1b33400640 1 -- 172.21.15.50:0/2642734012 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b2411e180 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.378+0000 7f1b3aa00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1b14066500 0x7f1b140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.378+0000 7f1b3aa00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1b14066500 0x7f1b140689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0011f0 tx=0x7f1b2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.378+0000 7f1b33400640 1 -- 172.21.15.50:0/2642734012 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1b240eafc0 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.574+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1b3c0a7ea0 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.577 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-01-30T08:09:41.578+0000 7f42f8600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-30T08:09:41.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.578+0000 7f1b33400640 1 -- 172.21.15.50:0/2642734012 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1b240ee5e0 con 0x7f1b3c0c4a30 2024-01-30T08:09:41.580 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-30T08:09:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1b14066500 msgr2=0x7f1b140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1b14066500 0x7f1b140689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0011f0 tx=0x7f1b2c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b3c0c4a30 msgr2=0x7f1b3c0c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b3c0c4a30 0x7f1b3c0c3e00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1b240190d0 tx=0x7f1b24019260 comp rx=0 tx=0).stop 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 shutdown_connections 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b3c14fc40 0x7f1b3c0a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1b14066500 0x7f1b140689c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b3c0c4a30 0x7f1b3c0c3e00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 --2- 172.21.15.50:0/2642734012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b3c0a7000 0x7f1b3c0a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 >> 172.21.15.50:0/2642734012 conn(0x7f1b3c06ad40 msgr2=0x7f1b3c0c61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 shutdown_connections 2024-01-30T08:09:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.582+0000 7f1b41e00640 1 -- 172.21.15.50:0/2642734012 wait complete. 2024-01-30T08:09:41.592 INFO:tasks.ceph.mds.d.smithi125.stderr: -3579> 2024-01-30T08:08:46.206+0000 7ffb18200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-30T08:09:41.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-30T08:09:41.642 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2024-01-30T08:09:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd854600640 1 Processor -- start 2024-01-30T08:09:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd854600640 1 -- start start 2024-01-30T08:09:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd854600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd84c072b60 0x7fd84c0a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd854600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd854600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c06c4c0 con 0x7fd84c06bfe0 2024-01-30T08:09:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd854600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0c0550 con 0x7fd84c072b60 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd854600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c07c0 con 0x7fd84c0a51e0 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd851c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd84c072b60 0x7fd84c0a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd851c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd84c072b60 0x7fd84c0a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39378/0 (socket says 172.21.15.50:39378) 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd851c00640 1 -- 172.21.15.50:0/1652542769 learned_addr learned my addr 172.21.15.50:0/1652542769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd852600640 1 --2- 172.21.15.50:0/1652542769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd851c00640 1 -- 172.21.15.50:0/1652542769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 msgr2=0x7fd84c0c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd851c00640 1 --2- 172.21.15.50:0/1652542769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c0c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd851c00640 1 -- 172.21.15.50:0/1652542769 >> v1:172.21.15.125:6789/0 conn(0x7fd84c06bfe0 legacy=0x7fd84c0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.746+0000 7fd851c00640 1 -- 172.21.15.50:0/1652542769 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0c0aa0 con 0x7fd84c072b60 2024-01-30T08:09:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd851c00640 1 --2- 172.21.15.50:0/1652542769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c072b60 0x7fd84c0a4ca0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009870 tx=0x7fd83c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155bd57faacc8e90 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd84be00640 1 -- 172.21.15.50:0/1652542769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0ab610 con 0x7fd84c072b60 2024-01-30T08:09:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd84be00640 1 -- 172.21.15.50:0/1652542769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c0ab770 con 0x7fd84c072b60 2024-01-30T08:09:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd84be00640 1 -- 172.21.15.50:0/1652542769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0abb00 con 0x7fd84c072b60 2024-01-30T08:09:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 -- 172.21.15.50:0/1652542769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c072b60 msgr2=0x7fd84c0a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 --2- 172.21.15.50:0/1652542769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c072b60 0x7fd84c0a4ca0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009870 tx=0x7fd83c01c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 -- 172.21.15.50:0/1652542769 shutdown_connections 2024-01-30T08:09:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 --2- 172.21.15.50:0/1652542769 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c0c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 --2- 172.21.15.50:0/1652542769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c072b60 0x7fd84c0a4ca0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 -- 172.21.15.50:0/1652542769 >> 172.21.15.50:0/1652542769 conn(0x7fd84c0c5b30 msgr2=0x7fd84c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 -- 172.21.15.50:0/1652542769 shutdown_connections 2024-01-30T08:09:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.750+0000 7fd854600640 1 -- 172.21.15.50:0/1652542769 wait complete. 2024-01-30T08:09:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 Processor -- start 2024-01-30T08:09:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 -- start start 2024-01-30T08:09:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c06bfe0 0x7fd84c14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd84c072b60 0x7fd84c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1eea70 con 0x7fd84c06bfe0 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1ee160 con 0x7fd84c072b60 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c14c000 con 0x7fd84c0a51e0 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c06bfe0 0x7fd84c14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c06bfe0 0x7fd84c14ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39382/0 (socket says 172.21.15.50:39382) 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 -- 172.21.15.50:0/1900838510 learned_addr learned my addr 172.21.15.50:0/1900838510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851200640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd84c072b60 0x7fd84c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd852600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 -- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 msgr2=0x7fd84c145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 -- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd84c072b60 msgr2=0x7fd84c0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd84c072b60 0x7fd84c0c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 -- 172.21.15.50:0/1900838510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0094d0 con 0x7fd84c06bfe0 2024-01-30T08:09:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851200640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd84c072b60 0x7fd84c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd852600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd851c00640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c06bfe0 0x7fd84c14ba20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0ad040 tx=0x7fd83c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd849600640 1 -- 172.21.15.50:0/1900838510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0b4800 con 0x7fd84c06bfe0 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd849600640 1 -- 172.21.15.50:0/1900838510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c0b4980 con 0x7fd84c06bfe0 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd849600640 1 -- 172.21.15.50:0/1900838510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0b4d30 con 0x7fd84c06bfe0 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c1ee420 con 0x7fd84c06bfe0 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.754+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c0a6e00 con 0x7fd84c06bfe0 2024-01-30T08:09:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.758+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c15b340 con 0x7fd84c06bfe0 2024-01-30T08:09:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.758+0000 7fd849600640 1 -- 172.21.15.50:0/1900838510 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd83c0c83a0 con 0x7fd84c06bfe0 2024-01-30T08:09:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.758+0000 7fd849600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd824066500 0x7fd8240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.758+0000 7fd849600640 1 -- 172.21.15.50:0/1900838510 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fd83c11ee50 con 0x7fd84c06bfe0 2024-01-30T08:09:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.758+0000 7fd851200640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd824066500 0x7fd8240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.758+0000 7fd851200640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd824066500 0x7fd8240689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd84c1ee0c0 tx=0x7fd834009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.762+0000 7fd849600640 1 -- 172.21.15.50:0/1900838510 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd83c0ebcf0 con 0x7fd84c06bfe0 2024-01-30T08:09:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:41.970+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd84c074a20 con 0x7fd84c06bfe0 2024-01-30T08:09:42.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd849600640 1 -- 172.21.15.50:0/1900838510 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd83c0c40a0 con 0x7fd84c06bfe0 2024-01-30T08:09:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd824066500 msgr2=0x7fd8240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd824066500 0x7fd8240689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd84c1ee0c0 tx=0x7fd834009040 comp rx=0 tx=0).stop 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c06bfe0 msgr2=0x7fd84c14ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c06bfe0 0x7fd84c14ba20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0ad040 tx=0x7fd83c01ac30 comp rx=0 tx=0).stop 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 shutdown_connections 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd84c072b60 0x7fd84c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd824066500 0x7fd8240689c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84c0a51e0 0x7fd84c145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 --2- 172.21.15.50:0/1900838510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c06bfe0 0x7fd84c14ba20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 >> 172.21.15.50:0/1900838510 conn(0x7fd84c0c5b30 msgr2=0x7fd84c0c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 shutdown_connections 2024-01-30T08:09:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.582+0000 7fd854600640 1 -- 172.21.15.50:0/1900838510 wait complete. 2024-01-30T08:09:42.609 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-30T08:09:42.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.754+0000 7f499d000640 1 Processor -- start 2024-01-30T08:09:42.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f499d000640 1 -- start start 2024-01-30T08:09:42.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f499d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49980c4960 0x7f49980c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:42.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f499d000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f499806ca80 0x7f49980c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:42.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f499d000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49980c6410 0x7f49981551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f499d000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49980c3a20 con 0x7f49980c4960 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f499d000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49980c3670 con 0x7f49980c6410 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f499d000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499806c5f0 con 0x7f499806ca80 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49980c4960 0x7f49980c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4996800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49980c6410 0x7f49981551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f499806ca80 0x7f49980c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49980c4960 0x7f49980c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39388/0 (socket says 172.21.15.50:39388) 2024-01-30T08:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 -- 172.21.15.50:0/532444479 learned_addr learned my addr 172.21.15.50:0/532444479 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:42.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 -- 172.21.15.50:0/532444479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f499806ca80 msgr2=0x7f49980c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:42.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 --2- 172.21.15.50:0/532444479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f499806ca80 0x7f49980c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 -- 172.21.15.50:0/532444479 >> v2:172.21.15.125:3300/0 conn(0x7f49980c6410 msgr2=0x7f49981551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:42.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 --2- 172.21.15.50:0/532444479 >> v2:172.21.15.125:3300/0 conn(0x7f49980c6410 0x7f49981551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.758+0000 7f4995e00640 1 -- 172.21.15.50:0/532444479 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998158d80 con 0x7f49980c4960 2024-01-30T08:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f4995e00640 1 --2- 172.21.15.50:0/532444479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980c3130 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f499806d960 tx=0x7f498801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9e790eb3c52d83 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f4994a00640 1 -- 172.21.15.50:0/532444479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880aa5f0 con 0x7f49980c4960 2024-01-30T08:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f4994a00640 1 -- 172.21.15.50:0/532444479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49880aa750 con 0x7f49980c4960 2024-01-30T08:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f4994a00640 1 -- 172.21.15.50:0/532444479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880aaae0 con 0x7f49980c4960 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 -- 172.21.15.50:0/532444479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 msgr2=0x7f49980c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 --2- 172.21.15.50:0/532444479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980c3130 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f499806d960 tx=0x7f498801c4d0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 -- 172.21.15.50:0/532444479 shutdown_connections 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 --2- 172.21.15.50:0/532444479 >> v2:172.21.15.125:3300/0 conn(0x7f49980c6410 0x7f49981551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 --2- 172.21.15.50:0/532444479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f499806ca80 0x7f49980c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 --2- 172.21.15.50:0/532444479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980c3130 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 -- 172.21.15.50:0/532444479 >> 172.21.15.50:0/532444479 conn(0x7f49980a9a80 msgr2=0x7f49980a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 -- 172.21.15.50:0/532444479 shutdown_connections 2024-01-30T08:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 -- 172.21.15.50:0/532444479 wait complete. 2024-01-30T08:09:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.762+0000 7f499d000640 1 Processor -- start 2024-01-30T08:09:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 -- start start 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f499806ca80 0x7f49981520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980a6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49980c6410 0x7f499815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49981f0a00 con 0x7f49980c4960 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49981efdf0 con 0x7f499806ca80 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49981f00d0 con 0x7f49980c6410 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980a6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39398/0 (socket says 172.21.15.50:39398) 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 -- 172.21.15.50:0/1705323339 learned_addr learned my addr 172.21.15.50:0/1705323339 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4996800640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49980c6410 0x7f499815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995e00640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f499806ca80 0x7f49981520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 -- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49980c6410 msgr2=0x7f499815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49980c6410 0x7f499815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 -- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f499806ca80 msgr2=0x7f49981520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f499806ca80 0x7f49981520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 -- 172.21.15.50:0/1705323339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880094d0 con 0x7f49980c4960 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f4995400640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980a6220 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f498000e870 tx=0x7f498000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f498e000640 1 -- 172.21.15.50:0/1705323339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800094b0 con 0x7f49980c4960 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f498e000640 1 -- 172.21.15.50:0/1705323339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000ee60 con 0x7f49980c4960 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49981f03b0 con 0x7f49980c4960 2024-01-30T08:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f498e000640 1 -- 172.21.15.50:0/1705323339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000cb60 con 0x7f49980c4960 2024-01-30T08:09:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4998152610 con 0x7f49980c4960 2024-01-30T08:09:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.766+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4998074a20 con 0x7f49980c4960 2024-01-30T08:09:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.770+0000 7f498e000640 1 -- 172.21.15.50:0/1705323339 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f498000ccc0 con 0x7f49980c4960 2024-01-30T08:09:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.770+0000 7f498e000640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4970066500 0x7f49700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.770+0000 7f498e000640 1 -- 172.21.15.50:0/1705323339 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4980084430 con 0x7f49980c4960 2024-01-30T08:09:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.770+0000 7f4995e00640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4970066500 0x7f49700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.770+0000 7f4995e00640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4970066500 0x7f49700689c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49880ae000 tx=0x7f49880b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.774+0000 7f498e000640 1 -- 172.21.15.50:0/1705323339 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4980051250 con 0x7f49980c4960 2024-01-30T08:09:42.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:42.934+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f49980c5cb0 con 0x7f49980c4960 2024-01-30T08:09:43.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.586+0000 7f498e000640 1 -- 172.21.15.50:0/1705323339 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4980054870 con 0x7f49980c4960 2024-01-30T08:09:43.587 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4970066500 msgr2=0x7f49700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4970066500 0x7f49700689c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49880ae000 tx=0x7f49880b5040 comp rx=0 tx=0).stop 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 msgr2=0x7f49980a6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980a6220 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f498000e870 tx=0x7f498000ed30 comp rx=0 tx=0).stop 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 shutdown_connections 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4970066500 0x7f49700689c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49980c6410 0x7f499815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49980c4960 0x7f49980a6220 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 --2- 172.21.15.50:0/1705323339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f499806ca80 0x7f49981520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 >> 172.21.15.50:0/1705323339 conn(0x7f49980a9a80 msgr2=0x7f4998157e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:43.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 shutdown_connections 2024-01-30T08:09:43.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.590+0000 7f499d000640 1 -- 172.21.15.50:0/1705323339 wait complete. 2024-01-30T08:09:43.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-30T08:09:43.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2ca00640 1 Processor -- start 2024-01-30T08:09:43.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2ca00640 1 -- start start 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2ca00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb2406ca80 0x7fcb240c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2ca00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb241551d0 0x7fcb24155620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2ca00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb240c3670 con 0x7fcb240c4960 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2ca00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb240c3a20 con 0x7fcb2406ca80 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2ca00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2406c5f0 con 0x7fcb241551d0 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb29600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb2406ca80 0x7fcb240c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb29600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb2406ca80 0x7fcb240c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39408/0 (socket says 172.21.15.50:39408) 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb29600640 1 -- 172.21.15.50:0/465843346 learned_addr learned my addr 172.21.15.50:0/465843346 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:43.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb2aa00640 1 --2- 172.21.15.50:0/465843346 >> v2:172.21.15.125:3300/0 conn(0x7fcb241551d0 0x7fcb24155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:43.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb29600640 1 -- 172.21.15.50:0/465843346 >> v2:172.21.15.125:3300/0 conn(0x7fcb241551d0 msgr2=0x7fcb24155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:43.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb29600640 1 --2- 172.21.15.50:0/465843346 >> v2:172.21.15.125:3300/0 conn(0x7fcb241551d0 0x7fcb24155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb29600640 1 -- 172.21.15.50:0/465843346 >> v1:172.21.15.125:6789/0 conn(0x7fcb240c4960 legacy=0x7fcb240c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:43.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.766+0000 7fcb29600640 1 -- 172.21.15.50:0/465843346 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24158d80 con 0x7fcb2406ca80 2024-01-30T08:09:43.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb29600640 1 --2- 172.21.15.50:0/465843346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2406ca80 0x7fcb240c3130 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb240c51a0 tx=0x7fcb0c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6bd35a4253d023 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:43.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb28c00640 1 -- 172.21.15.50:0/465843346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0ab640 con 0x7fcb2406ca80 2024-01-30T08:09:43.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb28c00640 1 -- 172.21.15.50:0/465843346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c0a7070 con 0x7fcb2406ca80 2024-01-30T08:09:43.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb28c00640 1 -- 172.21.15.50:0/465843346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0ab9c0 con 0x7fcb2406ca80 2024-01-30T08:09:43.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 -- 172.21.15.50:0/465843346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2406ca80 msgr2=0x7fcb240c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:43.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/465843346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2406ca80 0x7fcb240c3130 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb240c51a0 tx=0x7fcb0c01c440 comp rx=0 tx=0).stop 2024-01-30T08:09:43.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 -- 172.21.15.50:0/465843346 shutdown_connections 2024-01-30T08:09:43.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/465843346 >> v2:172.21.15.125:3300/0 conn(0x7fcb241551d0 0x7fcb24155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/465843346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2406ca80 0x7fcb240c3130 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 -- 172.21.15.50:0/465843346 >> 172.21.15.50:0/465843346 conn(0x7fcb240a9a80 msgr2=0x7fcb240a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:43.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 -- 172.21.15.50:0/465843346 shutdown_connections 2024-01-30T08:09:43.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.770+0000 7fcb2ca00640 1 -- 172.21.15.50:0/465843346 wait complete. 2024-01-30T08:09:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 Processor -- start 2024-01-30T08:09:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 -- start start 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2406ca80 0x7fcb240ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb240c4960 0x7fcb240ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb241551d0 0x7fcb240ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24151ad0 con 0x7fcb240c4960 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb241ed550 con 0x7fcb2406ca80 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb241ed830 con 0x7fcb241551d0 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb240c4960 0x7fcb240ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb240c4960 0x7fcb240ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39410/0 (socket says 172.21.15.50:39410) 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 -- 172.21.15.50:0/4274972349 learned_addr learned my addr 172.21.15.50:0/4274972349 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2aa00640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb241551d0 0x7fcb240ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2a000640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2406ca80 0x7fcb240ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 -- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb241551d0 msgr2=0x7fcb240ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:43.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb241551d0 0x7fcb240ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 -- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2406ca80 msgr2=0x7fcb240ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2406ca80 0x7fcb240ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 -- 172.21.15.50:0/4274972349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0094d0 con 0x7fcb240c4960 2024-01-30T08:09:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb29600640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb240c4960 0x7fcb240ac470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c019050 tx=0x7fcb0c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb22000640 1 -- 172.21.15.50:0/4274972349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0be3f0 con 0x7fcb240c4960 2024-01-30T08:09:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb22000640 1 -- 172.21.15.50:0/4274972349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c0be550 con 0x7fcb240c4960 2024-01-30T08:09:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb22000640 1 -- 172.21.15.50:0/4274972349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0be900 con 0x7fcb240c4960 2024-01-30T08:09:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb240ad680 con 0x7fcb240c4960 2024-01-30T08:09:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2406fc90 con 0x7fcb240c4960 2024-01-30T08:09:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.774+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb24074a20 con 0x7fcb240c4960 2024-01-30T08:09:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.778+0000 7fcb22000640 1 -- 172.21.15.50:0/4274972349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcb0c0c7440 con 0x7fcb240c4960 2024-01-30T08:09:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.778+0000 7fcb22000640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcafc066530 0x7fcafc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.778+0000 7fcb22000640 1 -- 172.21.15.50:0/4274972349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fcb0c11e9e0 con 0x7fcb240c4960 2024-01-30T08:09:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.778+0000 7fcb2a000640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcafc066530 0x7fcafc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.778+0000 7fcb2a000640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcafc066530 0x7fcafc0689f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb240a7590 tx=0x7fcb14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.782+0000 7fcb22000640 1 -- 172.21.15.50:0/4274972349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcb0c0ebac0 con 0x7fcb240c4960 2024-01-30T08:09:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:43.946+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb240c5cb0 con 0x7fcb240c4960 2024-01-30T08:09:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.857+0000 7fcb22000640 1 -- 172.21.15.50:0/4274972349 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcb0c0ef0e0 con 0x7fcb240c4960 2024-01-30T08:09:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-01-30T08:09:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcafc066530 msgr2=0x7fcafc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcafc066530 0x7fcafc0689f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb240a7590 tx=0x7fcb14009040 comp rx=0 tx=0).stop 2024-01-30T08:09:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb240c4960 msgr2=0x7fcb240ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb240c4960 0x7fcb240ac470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c019050 tx=0x7fcb0c01ac80 comp rx=0 tx=0).stop 2024-01-30T08:09:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 shutdown_connections 2024-01-30T08:09:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcafc066530 0x7fcafc0689f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb241551d0 0x7fcb240ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb240c4960 0x7fcb240ac470 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 --2- 172.21.15.50:0/4274972349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb2406ca80 0x7fcb240ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 >> 172.21.15.50:0/4274972349 conn(0x7fcb240a9a80 msgr2=0x7fcb2406ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 shutdown_connections 2024-01-30T08:09:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:44.861+0000 7fcb2ca00640 1 -- 172.21.15.50:0/4274972349 wait complete. 2024-01-30T08:09:44.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-30T08:09:45.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.053+0000 7f3762400640 1 Processor -- start 2024-01-30T08:09:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.053+0000 7f3762400640 1 -- start start 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f3762400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f375c0a8f80 0x7f375c0c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f3762400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0a9b50 con 0x7f375c0c24a0 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f3762400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0aa640 con 0x7f375c0c4e20 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f3762400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0c17a0 con 0x7f375c0a8f80 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f375c0a8f80 0x7f375c0c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f375c0a8f80 0x7f375c0c1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39412/0 (socket says 172.21.15.50:39412) 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375be00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f375c0c24a0 0x7f375c0c2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41064/0 (socket says 172.21.15.50:41064) 2024-01-30T08:09:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375aa00640 1 -- 172.21.15.50:0/1799810508 learned_addr learned my addr 172.21.15.50:0/1799810508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375aa00640 1 -- 172.21.15.50:0/1799810508 >> v1:172.21.15.125:6789/0 conn(0x7f375c0c4e20 legacy=0x7f375c072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375aa00640 1 -- 172.21.15.50:0/1799810508 >> v1:172.21.15.50:6789/0 conn(0x7f375c0c24a0 legacy=0x7f375c0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375aa00640 1 -- 172.21.15.50:0/1799810508 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0a9da0 con 0x7f375c0a8f80 2024-01-30T08:09:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.057+0000 7f375a000640 1 -- 172.21.15.50:0/1799810508 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997451674 0 0) 0x7f375c0a9b50 con 0x7f375c0c24a0 2024-01-30T08:09:45.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f375aa00640 1 --2- 172.21.15.50:0/1799810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0a8f80 0x7f375c0c1260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3744009870 tx=0x7f374401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb127fdd6acb11ca server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:45.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f375a000640 1 -- 172.21.15.50:0/1799810508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440ab5f0 con 0x7f375c0a8f80 2024-01-30T08:09:45.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f375a000640 1 -- 172.21.15.50:0/1799810508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37440ab750 con 0x7f375c0a8f80 2024-01-30T08:09:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f375a000640 1 -- 172.21.15.50:0/1799810508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440abae0 con 0x7f375c0a8f80 2024-01-30T08:09:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 -- 172.21.15.50:0/1799810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0a8f80 msgr2=0x7f375c0c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 --2- 172.21.15.50:0/1799810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0a8f80 0x7f375c0c1260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3744009870 tx=0x7f374401c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 -- 172.21.15.50:0/1799810508 shutdown_connections 2024-01-30T08:09:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 --2- 172.21.15.50:0/1799810508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0a8f80 0x7f375c0c1260 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 -- 172.21.15.50:0/1799810508 >> 172.21.15.50:0/1799810508 conn(0x7f375c0c5bb0 msgr2=0x7f375c0c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 -- 172.21.15.50:0/1799810508 shutdown_connections 2024-01-30T08:09:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 -- 172.21.15.50:0/1799810508 wait complete. 2024-01-30T08:09:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 Processor -- start 2024-01-30T08:09:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.061+0000 7f3762400640 1 -- start start 2024-01-30T08:09:45.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f375c0a8f80 0x7f375c1ea890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:45.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375c0c24a0 0x7f375c152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:45.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0c4e20 0x7f375c0bb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:45.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0bf1a0 con 0x7f375c0c4e20 2024-01-30T08:09:45.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0babb0 con 0x7f375c0a8f80 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c1eaea0 con 0x7f375c0c24a0 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0c4e20 0x7f375c0bb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0c4e20 0x7f375c0bb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39422/0 (socket says 172.21.15.50:39422) 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 -- 172.21.15.50:0/2181734879 learned_addr learned my addr 172.21.15.50:0/2181734879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375b400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f375c0a8f80 0x7f375c1ea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375aa00640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375c0c24a0 0x7f375c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 -- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375c0c24a0 msgr2=0x7f375c152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375c0c24a0 0x7f375c152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 -- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f375c0a8f80 msgr2=0x7f375c1ea890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f375c0a8f80 0x7f375c1ea890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 -- 172.21.15.50:0/2181734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440094d0 con 0x7f375c0c4e20 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375aa00640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375c0c24a0 0x7f375c152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:45.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f375be00640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0c4e20 0x7f375c0bb040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f375400c7a0 tx=0x7f375400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3753400640 1 -- 172.21.15.50:0/2181734879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400a640 con 0x7f375c0c4e20 2024-01-30T08:09:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3753400640 1 -- 172.21.15.50:0/2181734879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400a7a0 con 0x7f375c0c4e20 2024-01-30T08:09:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c1eb180 con 0x7f375c0c4e20 2024-01-30T08:09:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3753400640 1 -- 172.21.15.50:0/2181734879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400abd0 con 0x7f375c0c4e20 2024-01-30T08:09:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c0678d0 con 0x7f375c0c4e20 2024-01-30T08:09:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.065+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c0bad20 con 0x7f375c0c4e20 2024-01-30T08:09:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.069+0000 7f3753400640 1 -- 172.21.15.50:0/2181734879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f375400ad30 con 0x7f375c0c4e20 2024-01-30T08:09:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.069+0000 7f3753400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3734066500 0x7f37340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.069+0000 7f3753400640 1 -- 172.21.15.50:0/2181734879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f3754083780 con 0x7f375c0c4e20 2024-01-30T08:09:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.069+0000 7f375b400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3734066500 0x7f37340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.069+0000 7f375b400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3734066500 0x7f37340689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f374c000f70 tx=0x7f374c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.073+0000 7f3753400640 1 -- 172.21.15.50:0/2181734879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3754050930 con 0x7f375c0c4e20 2024-01-30T08:09:45.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.233+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f375c074a20 con 0x7f375c0c4e20 2024-01-30T08:09:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.865+0000 7f3753400640 1 -- 172.21.15.50:0/2181734879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3754053f50 con 0x7f375c0c4e20 2024-01-30T08:09:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' removed 2024-01-30T08:09:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3734066500 msgr2=0x7f37340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3734066500 0x7f37340689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f374c000f70 tx=0x7f374c009040 comp rx=0 tx=0).stop 2024-01-30T08:09:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0c4e20 msgr2=0x7f375c0bb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0c4e20 0x7f375c0bb040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f375400c7a0 tx=0x7f375400cc60 comp rx=0 tx=0).stop 2024-01-30T08:09:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 shutdown_connections 2024-01-30T08:09:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3734066500 0x7f37340689c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f375c0c4e20 0x7f375c0bb040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f375c0c24a0 0x7f375c152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 --2- 172.21.15.50:0/2181734879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f375c0a8f80 0x7f375c1ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 >> 172.21.15.50:0/2181734879 conn(0x7f375c0c5bb0 msgr2=0x7f375c0c3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 shutdown_connections 2024-01-30T08:09:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:45.869+0000 7f3762400640 1 -- 172.21.15.50:0/2181734879 wait complete. 2024-01-30T08:09:45.895 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-30T08:09:45.895 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-30T08:09:45.896 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-30T08:09:45.896 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:09:45.896 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-30T08:09:45.897 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-30T08:09:45.897 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-30T08:09:45.897 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:09:45.897 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-30T08:09:45.897 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-30T08:09:45.898 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-30T08:09:45.898 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:09:45.898 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-30T08:09:45.898 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-30T08:09:45.899 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-30T08:09:45.899 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:09:45.910 INFO:tasks.ceph.mds.c:Stopped 2024-01-30T08:09:45.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-30T08:09:45.911 INFO:tasks.ceph.mds.a:Stopped 2024-01-30T08:09:45.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-30T08:09:45.915 INFO:tasks.ceph.mds.b:Stopped 2024-01-30T08:09:45.915 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-30T08:09:45.916 INFO:tasks.ceph.mds.d:Stopped 2024-01-30T08:09:45.916 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-30T08:09:45.955 INFO:tasks.ceph.mds.c:Started 2024-01-30T08:09:45.955 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:45.957 INFO:tasks.ceph.mds.a:Started 2024-01-30T08:09:45.957 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:45.962 INFO:tasks.ceph.mds.b:Started 2024-01-30T08:09:45.962 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:45.963 INFO:tasks.ceph.mds.d:Started 2024-01-30T08:09:45.964 DEBUG:teuthology.parallel:result is None 2024-01-30T08:09:45.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-30T08:09:46.045 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-01-30T08:09:46.047 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2024-01-30T08:09:46.048 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-01-30T08:09:46.048 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2024-01-30T08:09:46.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effae400640 1 Processor -- start 2024-01-30T08:09:46.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effae400640 1 -- start start 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effae400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa8151dc0 0x7effa80c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effae400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effa8157c40 0x7effa80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effae400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa8154c10 con 0x7effa80c5c40 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effae400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa806d890 con 0x7effa8157c40 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effae400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa8154690 con 0x7effa8151dc0 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effa8157c40 0x7effa80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa6a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7effa80c5c40 0x7effa81550a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41096/0 (socket says 172.21.15.50:41096) 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa6a00640 1 -- 172.21.15.50:0/3248134592 learned_addr learned my addr 172.21.15.50:0/3248134592 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effa8157c40 0x7effa80c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39454/0 (socket says 172.21.15.50:39454) 2024-01-30T08:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7400640 1 --2- 172.21.15.50:0/3248134592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa8151dc0 0x7effa80c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7400640 1 -- 172.21.15.50:0/3248134592 >> v2:172.21.15.50:3300/0 conn(0x7effa8157c40 msgr2=0x7effa80c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7400640 1 --2- 172.21.15.50:0/3248134592 >> v2:172.21.15.50:3300/0 conn(0x7effa8157c40 0x7effa80c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7400640 1 -- 172.21.15.50:0/3248134592 >> v1:172.21.15.50:6789/0 conn(0x7effa80c5c40 legacy=0x7effa81550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7400640 1 -- 172.21.15.50:0/3248134592 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80c3490 con 0x7effa8151dc0 2024-01-30T08:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa6000640 1 -- 172.21.15.50:0/3248134592 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354138948 0 0) 0x7effa8154c10 con 0x7effa80c5c40 2024-01-30T08:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.117+0000 7effa7e00640 1 --2- 172.21.15.50:0/3248134592 >> v2:172.21.15.50:3300/0 conn(0x7effa8157c40 0x7effa80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:46.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effa7400640 1 --2- 172.21.15.50:0/3248134592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa8151dc0 0x7effa80c6e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff980097c0 tx=0x7eff9801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc4b1732dacd7ce server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:46.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effa6000640 1 -- 172.21.15.50:0/3248134592 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980ab5f0 con 0x7effa8151dc0 2024-01-30T08:09:46.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effa6000640 1 -- 172.21.15.50:0/3248134592 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff980ab750 con 0x7effa8151dc0 2024-01-30T08:09:46.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effa6000640 1 -- 172.21.15.50:0/3248134592 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980abae0 con 0x7effa8151dc0 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 -- 172.21.15.50:0/3248134592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa8151dc0 msgr2=0x7effa80c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 --2- 172.21.15.50:0/3248134592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa8151dc0 0x7effa80c6e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff980097c0 tx=0x7eff9801c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 -- 172.21.15.50:0/3248134592 shutdown_connections 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 --2- 172.21.15.50:0/3248134592 >> v2:172.21.15.50:3300/0 conn(0x7effa8157c40 0x7effa80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 --2- 172.21.15.50:0/3248134592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa8151dc0 0x7effa80c6e60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 -- 172.21.15.50:0/3248134592 >> 172.21.15.50:0/3248134592 conn(0x7effa806ad40 msgr2=0x7effa80c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 -- 172.21.15.50:0/3248134592 shutdown_connections 2024-01-30T08:09:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.121+0000 7effae400640 1 -- 172.21.15.50:0/3248134592 wait complete. 2024-01-30T08:09:46.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 Processor -- start 2024-01-30T08:09:46.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 -- start start 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa80c5c40 0x7effa8148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effa8151dc0 0x7effa806f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effa8157c40 0x7effa81f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80a7bd0 con 0x7effa8151dc0 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81f0380 con 0x7effa8157c40 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa81f0600 con 0x7effa80c5c40 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effa8151dc0 0x7effa806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effa8151dc0 0x7effa806f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39464/0 (socket says 172.21.15.50:39464) 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa6a00640 1 -- 172.21.15.50:0/1881518280 learned_addr learned my addr 172.21.15.50:0/1881518280 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa80c5c40 0x7effa8148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7e00640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effa8157c40 0x7effa81f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:46.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7400640 1 -- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effa8157c40 msgr2=0x7effa81f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:46.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effa8157c40 0x7effa81f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7400640 1 -- 172.21.15.50:0/1881518280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effa8151dc0 msgr2=0x7effa806f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:46.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effa8151dc0 0x7effa806f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7400640 1 -- 172.21.15.50:0/1881518280 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009a70 con 0x7effa80c5c40 2024-01-30T08:09:46.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa6a00640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effa8151dc0 0x7effa806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effa7400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa80c5c40 0x7effa8148460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff980ac000 tx=0x7eff9801ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7eff9f400640 1 -- 172.21.15.50:0/1881518280 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980bf610 con 0x7effa80c5c40 2024-01-30T08:09:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7eff9f400640 1 -- 172.21.15.50:0/1881518280 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff980bf7b0 con 0x7effa80c5c40 2024-01-30T08:09:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7eff9f400640 1 -- 172.21.15.50:0/1881518280 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980bfb60 con 0x7effa80c5c40 2024-01-30T08:09:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff98009420 con 0x7effa80c5c40 2024-01-30T08:09:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa806fe70 con 0x7effa80c5c40 2024-01-30T08:09:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.125+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa80c4b10 con 0x7effa80c5c40 2024-01-30T08:09:46.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.129+0000 7eff9f400640 1 -- 172.21.15.50:0/1881518280 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7eff980b5400 con 0x7effa80c5c40 2024-01-30T08:09:46.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.129+0000 7eff9f400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7eff80066530 0x7eff800689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:46.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.129+0000 7eff9f400640 1 -- 172.21.15.50:0/1881518280 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5263+0+0 (secure 0 0 0) 0x7eff980a8050 con 0x7effa80c5c40 2024-01-30T08:09:46.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.129+0000 7effa6a00640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7eff80066530 0x7eff800689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:46.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.129+0000 7effa6a00640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7eff80066530 0x7eff800689f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effa81545a0 tx=0x7eff90007e20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.133+0000 7eff9f400640 1 -- 172.21.15.50:0/1881518280 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7eff980ebb00 con 0x7effa80c5c40 2024-01-30T08:09:46.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.305+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7effa804ead0 con 0x7effa80c5c40 2024-01-30T08:09:46.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7eff9f400640 1 -- 172.21.15.50:0/1881518280 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7eff980ef120 con 0x7effa80c5c40 2024-01-30T08:09:46.890 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7eff80066530 msgr2=0x7eff800689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7eff80066530 0x7eff800689f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effa81545a0 tx=0x7eff90007e20 comp rx=0 tx=0).stop 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa80c5c40 msgr2=0x7effa8148460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa80c5c40 0x7effa8148460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff980ac000 tx=0x7eff9801ac30 comp rx=0 tx=0).stop 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 shutdown_connections 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7effa8157c40 0x7effa81f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7eff80066530 0x7eff800689f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effa8151dc0 0x7effa806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.889+0000 7effae400640 1 --2- 172.21.15.50:0/1881518280 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7effa80c5c40 0x7effa8148460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.893+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 >> 172.21.15.50:0/1881518280 conn(0x7effa806ad40 msgr2=0x7effa80c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:46.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.893+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 shutdown_connections 2024-01-30T08:09:46.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:46.893+0000 7effae400640 1 -- 172.21.15.50:0/1881518280 wait complete. 2024-01-30T08:09:46.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-30T08:09:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 Processor -- start 2024-01-30T08:09:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 -- start start 2024-01-30T08:09:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f988c151d80 0x7f988c0c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f988c0c05c0 0x7f988c158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c0c4bb0 0x7f988c158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c152160 con 0x7f988c0c05c0 2024-01-30T08:09:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0c35f0 con 0x7f988c151d80 2024-01-30T08:09:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.061+0000 7f9891000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c157c60 con 0x7f988c0c4bb0 2024-01-30T08:09:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f988c0c05c0 0x7f988c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f988c0c05c0 0x7f988c158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39474/0 (socket says 172.21.15.50:39474) 2024-01-30T08:09:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 -- 172.21.15.50:0/2652567931 learned_addr learned my addr 172.21.15.50:0/2652567931 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f988a800640 1 --2- 172.21.15.50:0/2652567931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c0c4bb0 0x7f988c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889e00640 1 --2- 172.21.15.50:0/2652567931 >> v2:172.21.15.125:3300/0 conn(0x7f988c151d80 0x7f988c0c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 -- 172.21.15.50:0/2652567931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c0c4bb0 msgr2=0x7f988c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 --2- 172.21.15.50:0/2652567931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c0c4bb0 0x7f988c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 -- 172.21.15.50:0/2652567931 >> v2:172.21.15.125:3300/0 conn(0x7f988c151d80 msgr2=0x7f988c0c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 --2- 172.21.15.50:0/2652567931 >> v2:172.21.15.125:3300/0 conn(0x7f988c151d80 0x7f988c0c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 -- 172.21.15.50:0/2652567931 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0c6a30 con 0x7f988c0c05c0 2024-01-30T08:09:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f988a800640 1 --2- 172.21.15.50:0/2652567931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c0c4bb0 0x7f988c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9889400640 1 --2- 172.21.15.50:0/2652567931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c158140 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f988c0c78d0 tx=0x7f987401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966dda2a326735a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9888a00640 1 -- 172.21.15.50:0/2652567931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740aa5f0 con 0x7f988c0c05c0 2024-01-30T08:09:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9888a00640 1 -- 172.21.15.50:0/2652567931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98740aa750 con 0x7f988c0c05c0 2024-01-30T08:09:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.065+0000 7f9888a00640 1 -- 172.21.15.50:0/2652567931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740aaae0 con 0x7f988c0c05c0 2024-01-30T08:09:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- 172.21.15.50:0/2652567931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 msgr2=0x7f988c158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 --2- 172.21.15.50:0/2652567931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c158140 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f988c0c78d0 tx=0x7f987401c4d0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- 172.21.15.50:0/2652567931 shutdown_connections 2024-01-30T08:09:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 --2- 172.21.15.50:0/2652567931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c158140 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 --2- 172.21.15.50:0/2652567931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c0c4bb0 0x7f988c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 --2- 172.21.15.50:0/2652567931 >> v2:172.21.15.125:3300/0 conn(0x7f988c151d80 0x7f988c0c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- 172.21.15.50:0/2652567931 >> 172.21.15.50:0/2652567931 conn(0x7f988c0a9590 msgr2=0x7f988c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- 172.21.15.50:0/2652567931 shutdown_connections 2024-01-30T08:09:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- 172.21.15.50:0/2652567931 wait complete. 2024-01-30T08:09:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 Processor -- start 2024-01-30T08:09:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- start start 2024-01-30T08:09:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c1f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f988c0c4bb0 0x7f988c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c151d80 0x7f988c0a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c158f00 con 0x7f988c0c05c0 2024-01-30T08:09:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0a9ec0 con 0x7f988c0c4bb0 2024-01-30T08:09:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9891000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c15d7e0 con 0x7f988c151d80 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9889e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c1f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9889e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c1f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39484/0 (socket says 172.21.15.50:39484) 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.069+0000 7f9889e00640 1 -- 172.21.15.50:0/172236354 learned_addr learned my addr 172.21.15.50:0/172236354 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f988a800640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c151d80 0x7f988c0a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9889400640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f988c0c4bb0 0x7f988c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9889e00640 1 -- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c151d80 msgr2=0x7f988c0a79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9889e00640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c151d80 0x7f988c0a79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9889e00640 1 -- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f988c0c4bb0 msgr2=0x7f988c14ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9889e00640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f988c0c4bb0 0x7f988c14ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9889e00640 1 -- 172.21.15.50:0/172236354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884009a70 con 0x7f988c0c05c0 2024-01-30T08:09:47.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9889e00640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c1f1280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f987c00e960 tx=0x7f987c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9882000640 1 -- 172.21.15.50:0/172236354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c009690 con 0x7f988c0c05c0 2024-01-30T08:09:47.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9882000640 1 -- 172.21.15.50:0/172236354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c00c940 con 0x7f988c0c05c0 2024-01-30T08:09:47.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98740094d0 con 0x7f988c0c05c0 2024-01-30T08:09:47.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9882000640 1 -- 172.21.15.50:0/172236354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00ccb0 con 0x7f988c0c05c0 2024-01-30T08:09:47.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c159110 con 0x7f988c0c05c0 2024-01-30T08:09:47.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c074a20 con 0x7f988c0c05c0 2024-01-30T08:09:47.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9882000640 1 -- 172.21.15.50:0/172236354 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f987c013470 con 0x7f988c0c05c0 2024-01-30T08:09:47.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.073+0000 7f9882000640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9864066500 0x7f98640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.077+0000 7f9882000640 1 -- 172.21.15.50:0/172236354 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f987c083de0 con 0x7f988c0c05c0 2024-01-30T08:09:47.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.077+0000 7f9889400640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9864066500 0x7f98640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.077+0000 7f9889400640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9864066500 0x7f98640689c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98740ae000 tx=0x7f98740b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.077+0000 7f9882000640 1 -- 172.21.15.50:0/172236354 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f987c051330 con 0x7f988c0c05c0 2024-01-30T08:09:47.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.293+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f988c1508f0 con 0x7f988c0c05c0 2024-01-30T08:09:47.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.293+0000 7f9882000640 1 -- 172.21.15.50:0/172236354 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f987c054950 con 0x7f988c0c05c0 2024-01-30T08:09:47.295 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:47.295 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:09:47.295 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBXrrhlkD2hNhAAXYjZ0QTFYxTp9mLj1em8xw==", 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYrrhlkO1ABxAAed/OWn44FKEIdesiCI4rrg==", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYrrhltxaIAhAAtqFHdt4nNxZanICnrpJsgg==", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-01-30T08:09:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYrrhlyltVDhAA7WyzABIZFBpChkvMguYCvQ==", 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBZrrhlBRfTIxAAhoX4TrCAMjM38ixfwCQU9g==", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcrrhlNGfAKBAA+6sIKe698qA8lpC8moXgig==", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBfrrhlcRSaLhAAZubT5hOgmX63JCH35fbe/Q==", 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-01-30T08:09:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBirrhl+PTdNBAAaWMvlhD8RGUud1klkK6Crg==", 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBprrhlbU6bARAAcl/ip+3EywM/iZQ5kkZSIA==", 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBsrrhlriiwBxAAe9zGIoOijrys4oBRqhFUhA==", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBvrrhlEdRsDhAAjz108AFZ63EPh0xntikGcg==", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQByrrhlIAbWExAAa9qGiE5/A7ryFoK1ipPySA==", 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYrrhlySttEhAA25eE5QwNAjdOZsKcoh9Fhw==", 2024-01-30T08:09:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYrrhlwkDyFRAAgm1JuVaCD1chL8w929N1hQ==", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-01-30T08:09:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBXrrhljabyGhAAHdW3ej66ZtB4IvOp4jRJvw==", 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQB4rrhlTvRZAxAAh763qw6bJm39btK7C4RLOg==", 2024-01-30T08:09:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQB4rrhlXf5ZAxAAb3LIFgQaAqR1I4oYcp37cg==", 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQB4rrhlnAZaAxAAvJBCG7F5yRhbz6xulz3ttA==", 2024-01-30T08:09:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQB4rrhlpw5aAxAAbiS5kIQurvh1gqk0KUxEPA==", 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQB4rrhlHRdaAxAADqDRS+Av8w8nvMsiSGF4Ew==", 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQB4rrhlrh9aAxAAdMa3ttdQQkA7R/d/0ib+vw==", 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBXrrhljUoUMhAAVP+4udwrDtDiiXGasLeH6Q==", 2024-01-30T08:09:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBXrrhlaYB7LhAAtEmx+7QKPUsk/+5vCS9Rlg==", 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-01-30T08:09:47.310 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:09:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9864066500 msgr2=0x7f98640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9864066500 0x7f98640689c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98740ae000 tx=0x7f98740b5040 comp rx=0 tx=0).stop 2024-01-30T08:09:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 msgr2=0x7f988c1f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c1f1280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f987c00e960 tx=0x7f987c00ed60 comp rx=0 tx=0).stop 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 shutdown_connections 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f988c0c4bb0 0x7f988c14ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9864066500 0x7f98640689c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f988c151d80 0x7f988c0a79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 --2- 172.21.15.50:0/172236354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c0c05c0 0x7f988c1f1280 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 >> 172.21.15.50:0/172236354 conn(0x7f988c0a9590 msgr2=0x7f988c158040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 shutdown_connections 2024-01-30T08:09:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.297+0000 7f9891000640 1 -- 172.21.15.50:0/172236354 wait complete. 2024-01-30T08:09:47.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-30T08:09:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.457+0000 7f28f3800640 1 Processor -- start 2024-01-30T08:09:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.457+0000 7f28f3800640 1 -- start start 2024-01-30T08:09:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.457+0000 7f28f3800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f28ec0c4280 0x7f28ec0bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.457+0000 7f28f3800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec154aa0 con 0x7f28ec0c5540 2024-01-30T08:09:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.457+0000 7f28f3800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec154870 con 0x7f28ec154490 2024-01-30T08:09:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.457+0000 7f28f3800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec0bc470 con 0x7f28ec0c4280 2024-01-30T08:09:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28f1800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28ec0c5540 0x7f28ec0bbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41110/0 (socket says 172.21.15.50:41110) 2024-01-30T08:09:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28f1800640 1 -- 172.21.15.50:0/1591651339 learned_addr learned my addr 172.21.15.50:0/1591651339 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28ebe00640 1 --2- 172.21.15.50:0/1591651339 >> v2:172.21.15.125:3300/0 conn(0x7f28ec0c4280 0x7f28ec0bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28eb400640 1 -- 172.21.15.50:0/1591651339 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518123491 0 0) 0x7f28ec154aa0 con 0x7f28ec0c5540 2024-01-30T08:09:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28eb400640 1 -- 172.21.15.50:0/1591651339 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28cc003530 con 0x7f28ec0c5540 2024-01-30T08:09:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28eb400640 1 -- 172.21.15.50:0/1591651339 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695024520 0 0) 0x7f28ec154870 con 0x7f28ec154490 2024-01-30T08:09:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28eb400640 1 -- 172.21.15.50:0/1591651339 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28ec154aa0 con 0x7f28ec154490 2024-01-30T08:09:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28ebe00640 1 -- 172.21.15.50:0/1591651339 >> v1:172.21.15.125:6789/0 conn(0x7f28ec154490 legacy=0x7f28ec06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28ebe00640 1 -- 172.21.15.50:0/1591651339 >> v1:172.21.15.50:6789/0 conn(0x7f28ec0c5540 legacy=0x7f28ec0bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.461+0000 7f28ebe00640 1 -- 172.21.15.50:0/1591651339 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec154cf0 con 0x7f28ec0c4280 2024-01-30T08:09:47.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28ebe00640 1 --2- 172.21.15.50:0/1591651339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec0bb820 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f28d40097c0 tx=0x7f28d401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=522575c1ea17aaf0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28eb400640 1 -- 172.21.15.50:0/1591651339 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40ab650 con 0x7f28ec0c4280 2024-01-30T08:09:47.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28eb400640 1 -- 172.21.15.50:0/1591651339 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d40ab7b0 con 0x7f28ec0c4280 2024-01-30T08:09:47.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28eb400640 1 -- 172.21.15.50:0/1591651339 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40abb20 con 0x7f28ec0c4280 2024-01-30T08:09:47.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 -- 172.21.15.50:0/1591651339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 msgr2=0x7f28ec0bb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 --2- 172.21.15.50:0/1591651339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec0bb820 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f28d40097c0 tx=0x7f28d401c450 comp rx=0 tx=0).stop 2024-01-30T08:09:47.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 -- 172.21.15.50:0/1591651339 shutdown_connections 2024-01-30T08:09:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 --2- 172.21.15.50:0/1591651339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec0bb820 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 -- 172.21.15.50:0/1591651339 >> 172.21.15.50:0/1591651339 conn(0x7f28ec0c5f10 msgr2=0x7f28ec0c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 -- 172.21.15.50:0/1591651339 shutdown_connections 2024-01-30T08:09:47.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 -- 172.21.15.50:0/1591651339 wait complete. 2024-01-30T08:09:47.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 Processor -- start 2024-01-30T08:09:47.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.465+0000 7f28f3800640 1 -- start start 2024-01-30T08:09:47.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec1ead40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28ec0c5540 0x7f28ec0a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28ec154490 0x7f28ec0aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0aa270 con 0x7f28ec154490 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c3920 con 0x7f28ec0c4280 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0a8c90 con 0x7f28ec0c5540 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28ec154490 0x7f28ec0aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28ec154490 0x7f28ec0aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39494/0 (socket says 172.21.15.50:39494) 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 -- 172.21.15.50:0/630542268 learned_addr learned my addr 172.21.15.50:0/630542268 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28ebe00640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28ec0c5540 0x7f28ec0a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f0e00640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec1ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 -- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28ec0c5540 msgr2=0x7f28ec0a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28ec0c5540 0x7f28ec0a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 -- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 msgr2=0x7f28ec1ead40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec1ead40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 -- 172.21.15.50:0/630542268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d4009420 con 0x7f28ec154490 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f0e00640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec1ead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f1800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28ec154490 0x7f28ec0aae90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f28e400cb90 tx=0x7f28e400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28e8c00640 1 -- 172.21.15.50:0/630542268 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400ace0 con 0x7f28ec154490 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28e8c00640 1 -- 172.21.15.50:0/630542268 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400ae40 con 0x7f28ec154490 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec0a8f70 con 0x7f28ec154490 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28e8c00640 1 -- 172.21.15.50:0/630542268 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4012600 con 0x7f28ec154490 2024-01-30T08:09:47.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec0a9530 con 0x7f28ec154490 2024-01-30T08:09:47.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec04ead0 con 0x7f28ec154490 2024-01-30T08:09:47.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.469+0000 7f28e8c00640 1 -- 172.21.15.50:0/630542268 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f28e4007070 con 0x7f28ec154490 2024-01-30T08:09:47.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.473+0000 7f28e8c00640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f28c4066530 0x7f28c40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.473+0000 7f28e8c00640 1 -- 172.21.15.50:0/630542268 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f28e4083b20 con 0x7f28ec154490 2024-01-30T08:09:47.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.473+0000 7f28f0e00640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f28c4066530 0x7f28c40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.473+0000 7f28f0e00640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f28c4066530 0x7f28c40689f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0011f0 tx=0x7f28dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.477+0000 7f28e8c00640 1 -- 172.21.15.50:0/630542268 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f28e4051070 con 0x7f28ec154490 2024-01-30T08:09:47.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.689+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f28ec0c4690 con 0x7f28ec154490 2024-01-30T08:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28e8c00640 1 -- 172.21.15.50:0/630542268 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f28e4017020 con 0x7f28ec154490 2024-01-30T08:09:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f28c4066530 msgr2=0x7f28c40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f28c4066530 0x7f28c40689f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0011f0 tx=0x7f28dc009040 comp rx=0 tx=0).stop 2024-01-30T08:09:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28ec154490 msgr2=0x7f28ec0aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28ec154490 0x7f28ec0aae90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f28e400cb90 tx=0x7f28e400a430 comp rx=0 tx=0).stop 2024-01-30T08:09:47.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 shutdown_connections 2024-01-30T08:09:47.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f28c4066530 0x7f28c40689f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28ec154490 0x7f28ec0aae90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28ec0c5540 0x7f28ec0a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 --2- 172.21.15.50:0/630542268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28ec0c4280 0x7f28ec1ead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 >> 172.21.15.50:0/630542268 conn(0x7f28ec0c5f10 msgr2=0x7f28ec1536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:47.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 shutdown_connections 2024-01-30T08:09:47.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.693+0000 7f28f3800640 1 -- 172.21.15.50:0/630542268 wait complete. 2024-01-30T08:09:47.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-30T08:09:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12e1600640 1 Processor -- start 2024-01-30T08:09:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12e1600640 1 -- start start 2024-01-30T08:09:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12e1600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 0x7f12dc0c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12e1600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f12dc156880 0x7f12dc0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12e1600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc06ea50 con 0x7f12dc0c3950 2024-01-30T08:09:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12e1600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc06ed30 con 0x7f12dc156880 2024-01-30T08:09:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12e1600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc06f010 con 0x7f12dc1564a0 2024-01-30T08:09:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12db400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f12dc0c3950 0x7f12dc0c42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41120/0 (socket says 172.21.15.50:41120) 2024-01-30T08:09:47.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12db400640 1 -- 172.21.15.50:0/1170105948 learned_addr learned my addr 172.21.15.50:0/1170105948 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12daa00640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 0x7f12dc0c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12da000640 1 --2- 172.21.15.50:0/1170105948 >> v2:172.21.15.125:3300/0 conn(0x7f12dc156880 0x7f12dc0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987127587 0 0) 0x7f12dc06ea50 con 0x7f12dc0c3950 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12bc003530 con 0x7f12dc0c3950 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3102830280 0 0) 0x7f12bc003530 con 0x7f12dc0c3950 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 msgr2=0x7f12dc0c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 0x7f12dc0c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 >> v2:172.21.15.125:3300/0 conn(0x7f12dc156880 msgr2=0x7f12dc0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 --2- 172.21.15.50:0/1170105948 >> v2:172.21.15.125:3300/0 conn(0x7f12dc156880 0x7f12dc0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc06f2f0 con 0x7f12dc0c3950 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f12d4001a00 con 0x7f12dc0c3950 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12daa00640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 0x7f12dc0c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 >> v1:172.21.15.50:6789/0 conn(0x7f12dc0c3950 legacy=0x7f12dc0c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 0x7f12bc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12bc003f10 0x7f12bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc004d10 0x7f12bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc06ed30 con 0x7f12bc004d10 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc06f010 con 0x7f12bc003f10 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc00b9e0 con 0x7f12dc1564a0 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12db400640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc004d10 0x7f12bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12da000640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12bc003f10 0x7f12bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12daa00640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 0x7f12bc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12da000640 1 -- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 msgr2=0x7f12bc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12da000640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc1564a0 0x7f12bc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12da000640 1 -- 172.21.15.50:0/1170105948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc004d10 msgr2=0x7f12bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12da000640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc004d10 0x7f12bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12da000640 1 -- 172.21.15.50:0/1170105948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc009420 con 0x7f12bc003f10 2024-01-30T08:09:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.857+0000 7f12db400640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc004d10 0x7f12bc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:47.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12da000640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12bc003f10 0x7f12bc0047d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0c8480 tx=0x7f12c401ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d86192e87a64df26 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40a5620 con 0x7f12bc003f10 2024-01-30T08:09:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c40a5780 con 0x7f12bc003f10 2024-01-30T08:09:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12d9600640 1 -- 172.21.15.50:0/1170105948 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40a5b30 con 0x7f12bc003f10 2024-01-30T08:09:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12e1600640 1 -- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12bc003f10 msgr2=0x7f12bc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12e1600640 1 --2- 172.21.15.50:0/1170105948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12bc003f10 0x7f12bc0047d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0c8480 tx=0x7f12c401ca30 comp rx=0 tx=0).stop 2024-01-30T08:09:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12db400640 1 -- 172.21.15.50:0/1170105948 reap_dead start 2024-01-30T08:09:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12e1600640 1 -- 172.21.15.50:0/1170105948 shutdown_connections 2024-01-30T08:09:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12e1600640 1 -- 172.21.15.50:0/1170105948 >> 172.21.15.50:0/1170105948 conn(0x7f12dc072870 msgr2=0x7f12dc06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12e1600640 1 -- 172.21.15.50:0/1170105948 shutdown_connections 2024-01-30T08:09:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.861+0000 7f12e1600640 1 -- 172.21.15.50:0/1170105948 wait complete. 2024-01-30T08:09:47.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 Processor -- start 2024-01-30T08:09:47.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 -- start start 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc003f10 0x7f12dc06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12dc06d320 0x7f12dc0a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc141d20 0x7f12dc1421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc1e78d0 con 0x7f12bc003f10 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0a96a0 con 0x7f12dc06d320 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0a9980 con 0x7f12dc141d20 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc003f10 0x7f12dc06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc003f10 0x7f12dc06cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39508/0 (socket says 172.21.15.50:39508) 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 -- 172.21.15.50:0/183093325 learned_addr learned my addr 172.21.15.50:0/183093325 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12da000640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12dc06d320 0x7f12dc0a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12db400640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc141d20 0x7f12dc1421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 -- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc141d20 msgr2=0x7f12dc1421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc141d20 0x7f12dc1421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 -- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12dc06d320 msgr2=0x7f12dc0a8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12dc06d320 0x7f12dc0a8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 -- 172.21.15.50:0/183093325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0a9c60 con 0x7f12bc003f10 2024-01-30T08:09:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12daa00640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc003f10 0x7f12dc06cb00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12cc011cd0 tx=0x7f12cc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12d2a00640 1 -- 172.21.15.50:0/183093325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00fd20 con 0x7f12bc003f10 2024-01-30T08:09:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12d2a00640 1 -- 172.21.15.50:0/183093325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00fe80 con 0x7f12bc003f10 2024-01-30T08:09:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12d2a00640 1 -- 172.21.15.50:0/183093325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc004240 con 0x7f12bc003f10 2024-01-30T08:09:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.865+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc14afe0 con 0x7f12bc003f10 2024-01-30T08:09:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.869+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc06d040 con 0x7f12bc003f10 2024-01-30T08:09:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.869+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc04ead0 con 0x7f12bc003f10 2024-01-30T08:09:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.873+0000 7f12d2a00640 1 -- 172.21.15.50:0/183093325 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f12cc0043a0 con 0x7f12bc003f10 2024-01-30T08:09:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.873+0000 7f12d2a00640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f12b4066500 0x7f12b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.873+0000 7f12d2a00640 1 -- 172.21.15.50:0/183093325 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f12cc084830 con 0x7f12bc003f10 2024-01-30T08:09:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.873+0000 7f12da000640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f12b4066500 0x7f12b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.873+0000 7f12da000640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f12b4066500 0x7f12b40689c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f12c40af000 tx=0x7f12c40046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:47.873+0000 7f12d2a00640 1 -- 172.21.15.50:0/183093325 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f12cc051d70 con 0x7f12bc003f10 2024-01-30T08:09:48.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.093+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f12dc0a6ce0 con 0x7f12bc003f10 2024-01-30T08:09:48.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12d2a00640 1 -- 172.21.15.50:0/183093325 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f12cc022020 con 0x7f12bc003f10 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f12b4066500 msgr2=0x7f12b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f12b4066500 0x7f12b40689c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f12c40af000 tx=0x7f12c40046d0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc003f10 msgr2=0x7f12dc06cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc003f10 0x7f12dc06cb00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12cc011cd0 tx=0x7f12cc00f610 comp rx=0 tx=0).stop 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 shutdown_connections 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12dc06d320 0x7f12dc0a8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f12b4066500 0x7f12b40689c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12dc141d20 0x7f12dc1421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 --2- 172.21.15.50:0/183093325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12bc003f10 0x7f12dc06cb00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 >> 172.21.15.50:0/183093325 conn(0x7f12dc072870 msgr2=0x7f12dc0c4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 shutdown_connections 2024-01-30T08:09:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.097+0000 7f12e1600640 1 -- 172.21.15.50:0/183093325 wait complete. 2024-01-30T08:09:48.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-30T08:09:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3604400640 1 Processor -- start 2024-01-30T08:09:48.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3604400640 1 -- start start 2024-01-30T08:09:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3604400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f35fc0c4a30 0x7f35fc0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3604400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35fc0a7000 0x7f35fc14f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3604400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc0c7520 con 0x7f35fc14fc40 2024-01-30T08:09:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3604400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0c79b0 con 0x7f35fc0a7000 2024-01-30T08:09:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3604400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0adf40 con 0x7f35fc0c4a30 2024-01-30T08:09:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3601000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35fc0a7000 0x7f35fc14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3602400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f35fc14fc40 0x7f35fc155a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41136/0 (socket says 172.21.15.50:41136) 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3601000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35fc0a7000 0x7f35fc14f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39510/0 (socket says 172.21.15.50:39510) 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3602400640 1 -- 172.21.15.50:0/3380362032 learned_addr learned my addr 172.21.15.50:0/3380362032 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3601a00640 1 --2- 172.21.15.50:0/3380362032 >> v2:172.21.15.125:3300/0 conn(0x7f35fc0c4a30 0x7f35fc0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3601000640 1 -- 172.21.15.50:0/3380362032 >> v2:172.21.15.125:3300/0 conn(0x7f35fc0c4a30 msgr2=0x7f35fc0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3601000640 1 --2- 172.21.15.50:0/3380362032 >> v2:172.21.15.125:3300/0 conn(0x7f35fc0c4a30 0x7f35fc0ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3601000640 1 -- 172.21.15.50:0/3380362032 >> v1:172.21.15.50:6789/0 conn(0x7f35fc14fc40 legacy=0x7f35fc155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f35fbe00640 1 -- 172.21.15.50:0/3380362032 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450244436 0 0) 0x7f35fc0c7520 con 0x7f35fc14fc40 2024-01-30T08:09:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.261+0000 7f3601000640 1 -- 172.21.15.50:0/3380362032 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0c6f10 con 0x7f35fc0a7000 2024-01-30T08:09:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3601000640 1 --2- 172.21.15.50:0/3380362032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc14f700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0c47a0 tx=0x7f35e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91961b4fe5603601 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f35fbe00640 1 -- 172.21.15.50:0/3380362032 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40ab660 con 0x7f35fc0a7000 2024-01-30T08:09:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f35fbe00640 1 -- 172.21.15.50:0/3380362032 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e40ab7c0 con 0x7f35fc0a7000 2024-01-30T08:09:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f35fbe00640 1 -- 172.21.15.50:0/3380362032 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40abb50 con 0x7f35fc0a7000 2024-01-30T08:09:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 -- 172.21.15.50:0/3380362032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 msgr2=0x7f35fc14f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 --2- 172.21.15.50:0/3380362032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc14f700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0c47a0 tx=0x7f35e401c440 comp rx=0 tx=0).stop 2024-01-30T08:09:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 -- 172.21.15.50:0/3380362032 shutdown_connections 2024-01-30T08:09:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 --2- 172.21.15.50:0/3380362032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc14f700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 --2- 172.21.15.50:0/3380362032 >> v2:172.21.15.125:3300/0 conn(0x7f35fc0c4a30 0x7f35fc0ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 -- 172.21.15.50:0/3380362032 >> 172.21.15.50:0/3380362032 conn(0x7f35fc06ad40 msgr2=0x7f35fc0c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 -- 172.21.15.50:0/3380362032 shutdown_connections 2024-01-30T08:09:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.265+0000 7f3604400640 1 -- 172.21.15.50:0/3380362032 wait complete. 2024-01-30T08:09:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 Processor -- start 2024-01-30T08:09:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 -- start start 2024-01-30T08:09:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc13c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35fc0c4a30 0x7f35fc0a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35fc14fc40 0x7f35fc0a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1433c0 con 0x7f35fc0a7000 2024-01-30T08:09:48.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc13e040 con 0x7f35fc14fc40 2024-01-30T08:09:48.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc13e2e0 con 0x7f35fc0c4a30 2024-01-30T08:09:48.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc13c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39526/0 (socket says 172.21.15.50:39526) 2024-01-30T08:09:48.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 -- 172.21.15.50:0/3529013698 learned_addr learned my addr 172.21.15.50:0/3529013698 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3602400640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35fc14fc40 0x7f35fc0a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601000640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35fc0c4a30 0x7f35fc0a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 -- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35fc0c4a30 msgr2=0x7f35fc0a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35fc0c4a30 0x7f35fc0a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 -- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35fc14fc40 msgr2=0x7f35fc0a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35fc14fc40 0x7f35fc0a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 -- 172.21.15.50:0/3529013698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4009420 con 0x7f35fc0a7000 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3601a00640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc13c510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00d800 tx=0x7f35ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f35f9600640 1 -- 172.21.15.50:0/3529013698 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00b6c0 con 0x7f35fc0a7000 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f35f9600640 1 -- 172.21.15.50:0/3529013698 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec00b820 con 0x7f35fc0a7000 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc143610 con 0x7f35fc0a7000 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f35f9600640 1 -- 172.21.15.50:0/3529013698 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00bb90 con 0x7f35fc0a7000 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.269+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc0a6c30 con 0x7f35fc0a7000 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.273+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc0a6e20 con 0x7f35fc0a7000 2024-01-30T08:09:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.273+0000 7f35f9600640 1 -- 172.21.15.50:0/3529013698 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f35ec00bcf0 con 0x7f35fc0a7000 2024-01-30T08:09:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.273+0000 7f35f9600640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35d4066500 0x7f35d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.273+0000 7f35f9600640 1 -- 172.21.15.50:0/3529013698 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f35ec084240 con 0x7f35fc0a7000 2024-01-30T08:09:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.273+0000 7f3601000640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35d4066500 0x7f35d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.273+0000 7f3601000640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35d4066500 0x7f35d40689c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f35e40af000 tx=0x7f35e40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.277+0000 7f35f9600640 1 -- 172.21.15.50:0/3529013698 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f35ec0516e0 con 0x7f35fc0a7000 2024-01-30T08:09:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.493+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f35fc04ead0 con 0x7f35fc0a7000 2024-01-30T08:09:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.493+0000 7f35f9600640 1 -- 172.21.15.50:0/3529013698 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f35ec011340 con 0x7f35fc0a7000 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35d4066500 msgr2=0x7f35d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35d4066500 0x7f35d40689c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f35e40af000 tx=0x7f35e40a7000 comp rx=0 tx=0).stop 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 msgr2=0x7f35fc13c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc13c510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00d800 tx=0x7f35ec00dcc0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 shutdown_connections 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35fc14fc40 0x7f35fc0a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f35d4066500 0x7f35d40689c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35fc0c4a30 0x7f35fc0a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 --2- 172.21.15.50:0/3529013698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35fc0a7000 0x7f35fc13c510 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 >> 172.21.15.50:0/3529013698 conn(0x7f35fc06ad40 msgr2=0x7f35fc0c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 shutdown_connections 2024-01-30T08:09:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.497+0000 7f3604400640 1 -- 172.21.15.50:0/3529013698 wait complete. 2024-01-30T08:09:48.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-30T08:09:48.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.657+0000 7f1560a00640 1 Processor -- start 2024-01-30T08:09:48.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.657+0000 7f1560a00640 1 -- start start 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f1560a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1558154490 0x7f155806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f1560a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 0x7f15580bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f1560a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1558154aa0 con 0x7f15580c5540 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f1560a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1558154870 con 0x7f1558154490 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f1560a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15580bc470 con 0x7f15580c4280 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155ea00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f15580c5540 0x7f15580bbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41138/0 (socket says 172.21.15.50:41138) 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155ea00640 1 -- 172.21.15.50:0/3086183600 learned_addr learned my addr 172.21.15.50:0/3086183600 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:48.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155e000640 1 --2- 172.21.15.50:0/3086183600 >> v2:172.21.15.125:3300/0 conn(0x7f1558154490 0x7f155806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155d600640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 0x7f15580bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332437992 0 0) 0x7f1558154aa0 con 0x7f15580c5540 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1538003530 con 0x7f15580c5540 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723017265 0 0) 0x7f1538003530 con 0x7f15580c5540 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 msgr2=0x7f15580bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 0x7f15580bb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 >> v2:172.21.15.125:3300/0 conn(0x7f1558154490 msgr2=0x7f155806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 --2- 172.21.15.50:0/3086183600 >> v2:172.21.15.125:3300/0 conn(0x7f1558154490 0x7f155806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558154cf0 con 0x7f15580c5540 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f1550001a00 con 0x7f15580c5540 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155e000640 1 --2- 172.21.15.50:0/3086183600 >> v2:172.21.15.125:3300/0 conn(0x7f1558154490 0x7f155806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 >> v1:172.21.15.50:6789/0 conn(0x7f15580c5540 legacy=0x7f15580bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 0x7f1538003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f15380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1538004d10 0x7f1538005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1558154870 con 0x7f1538003f00 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15580bc470 con 0x7f1538004d10 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153800b990 con 0x7f15580c4280 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155d600640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f15380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155e000640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 0x7f1538003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155ea00640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1538004d10 0x7f1538005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155d600640 1 -- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 msgr2=0x7f1538003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155d600640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f15580c4280 0x7f1538003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155d600640 1 -- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1538004d10 msgr2=0x7f1538005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:48.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155d600640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1538004d10 0x7f1538005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.661+0000 7f155d600640 1 -- 172.21.15.50:0/3086183600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538003530 con 0x7f1538003f00 2024-01-30T08:09:48.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f155d600640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f15380047d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1540009ae0 tx=0x7f154001ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc7127df0029410 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:48.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15400a79d0 con 0x7f1538003f00 2024-01-30T08:09:48.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15400a7b30 con 0x7f1538003f00 2024-01-30T08:09:48.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f155cc00640 1 -- 172.21.15.50:0/3086183600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15400af440 con 0x7f1538003f00 2024-01-30T08:09:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f1560a00640 1 -- 172.21.15.50:0/3086183600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 msgr2=0x7f15380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f1560a00640 1 --2- 172.21.15.50:0/3086183600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f15380047d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1540009ae0 tx=0x7f154001ec80 comp rx=0 tx=0).stop 2024-01-30T08:09:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f155ea00640 1 -- 172.21.15.50:0/3086183600 reap_dead start 2024-01-30T08:09:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f1560a00640 1 -- 172.21.15.50:0/3086183600 shutdown_connections 2024-01-30T08:09:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f1560a00640 1 -- 172.21.15.50:0/3086183600 >> 172.21.15.50:0/3086183600 conn(0x7f15580c5f10 msgr2=0x7f15580c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f1560a00640 1 -- 172.21.15.50:0/3086183600 shutdown_connections 2024-01-30T08:09:48.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.665+0000 7f1560a00640 1 -- 172.21.15.50:0/3086183600 wait complete. 2024-01-30T08:09:48.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 Processor -- start 2024-01-30T08:09:48.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 -- start start 2024-01-30T08:09:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f155814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15580a8a10 0x7f155814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f155814e370 0x7f15581e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15580a9250 con 0x7f1538003f00 2024-01-30T08:09:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581e6220 con 0x7f15580a8a10 2024-01-30T08:09:48.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155814e7f0 con 0x7f155814e370 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f155814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f155814ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39536/0 (socket says 172.21.15.50:39536) 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 -- 172.21.15.50:0/4122775412 learned_addr learned my addr 172.21.15.50:0/4122775412 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155ea00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f155814e370 0x7f15581e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155d600640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15580a8a10 0x7f155814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 -- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f155814e370 msgr2=0x7f15581e8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f155814e370 0x7f15581e8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 -- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15580a8a10 msgr2=0x7f155814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15580a8a10 0x7f155814de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 -- 172.21.15.50:0/4122775412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15581e64c0 con 0x7f1538003f00 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155ea00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f155814e370 0x7f15581e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f155e000640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f155814ee60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1548011cd0 tx=0x7f154800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1556000640 1 -- 172.21.15.50:0/4122775412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548011e80 con 0x7f1538003f00 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1556000640 1 -- 172.21.15.50:0/4122775412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1548004020 con 0x7f1538003f00 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1556000640 1 -- 172.21.15.50:0/4122775412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15480043b0 con 0x7f1538003f00 2024-01-30T08:09:48.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15580a94a0 con 0x7f1538003f00 2024-01-30T08:09:48.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.669+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15580bdb50 con 0x7f1538003f00 2024-01-30T08:09:48.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.673+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155804ead0 con 0x7f1538003f00 2024-01-30T08:09:48.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.673+0000 7f1556000640 1 -- 172.21.15.50:0/4122775412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1548003620 con 0x7f1538003f00 2024-01-30T08:09:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.673+0000 7f1556000640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1530066500 0x7f15300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.673+0000 7f1556000640 1 -- 172.21.15.50:0/4122775412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f15480844d0 con 0x7f1538003f00 2024-01-30T08:09:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.673+0000 7f155d600640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1530066500 0x7f15300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:48.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.673+0000 7f155d600640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1530066500 0x7f15300689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15400b1000 tx=0x7f15400046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:48.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.677+0000 7f1556000640 1 -- 172.21.15.50:0/4122775412 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1548051ac0 con 0x7f1538003f00 2024-01-30T08:09:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.889+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f15580c4690 con 0x7f1538003f00 2024-01-30T08:09:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1556000640 1 -- 172.21.15.50:0/4122775412 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1548022020 con 0x7f1538003f00 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1530066500 msgr2=0x7f15300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1530066500 0x7f15300689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15400b1000 tx=0x7f15400046d0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 msgr2=0x7f155814ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f155814ee60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1548011cd0 tx=0x7f154800f610 comp rx=0 tx=0).stop 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 shutdown_connections 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15580a8a10 0x7f155814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1530066500 0x7f15300689c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f155814e370 0x7f15581e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 --2- 172.21.15.50:0/4122775412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1538003f00 0x7f155814ee60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.893+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 >> 172.21.15.50:0/4122775412 conn(0x7f15580c5f10 msgr2=0x7f15580c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.897+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 shutdown_connections 2024-01-30T08:09:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:48.897+0000 7f1560a00640 1 -- 172.21.15.50:0/4122775412 wait complete. 2024-01-30T08:09:48.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-30T08:09:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f7800640 1 Processor -- start 2024-01-30T08:09:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f7800640 1 -- start start 2024-01-30T08:09:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f7800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9f01564a0 0x7fa9f00c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f7800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9f0156880 0x7fa9f00c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f7800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f006ea50 con 0x7fa9f00c3950 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f7800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f006ed30 con 0x7fa9f01564a0 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f7800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f006f010 con 0x7fa9f0156880 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f4e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9f01564a0 0x7fa9f00c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f4e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9f01564a0 0x7fa9f00c7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44666/0 (socket says 172.21.15.50:44666) 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f4e00640 1 -- 172.21.15.50:0/574750171 learned_addr learned my addr 172.21.15.50:0/574750171 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9efe00640 1 --2- 172.21.15.50:0/574750171 >> v2:172.21.15.125:3300/0 conn(0x7fa9f0156880 0x7fa9f00c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f4e00640 1 -- 172.21.15.50:0/574750171 >> v2:172.21.15.125:3300/0 conn(0x7fa9f0156880 msgr2=0x7fa9f00c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:49.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f4e00640 1 --2- 172.21.15.50:0/574750171 >> v2:172.21.15.125:3300/0 conn(0x7fa9f0156880 0x7fa9f00c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f4e00640 1 -- 172.21.15.50:0/574750171 >> v1:172.21.15.125:6789/0 conn(0x7fa9f00c3950 legacy=0x7fa9f00c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.057+0000 7fa9f4e00640 1 -- 172.21.15.50:0/574750171 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f006f2f0 con 0x7fa9f01564a0 2024-01-30T08:09:49.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9f4e00640 1 --2- 172.21.15.50:0/574750171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f00c7a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00c58b0 tx=0x7fa9e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01977b8efa3084d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9ef400640 1 -- 172.21.15.50:0/574750171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00701d0 con 0x7fa9f01564a0 2024-01-30T08:09:49.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9ef400640 1 -- 172.21.15.50:0/574750171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e00aa5f0 con 0x7fa9f01564a0 2024-01-30T08:09:49.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9ef400640 1 -- 172.21.15.50:0/574750171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00aa980 con 0x7fa9f01564a0 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9f7800640 1 -- 172.21.15.50:0/574750171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 msgr2=0x7fa9f00c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9f7800640 1 --2- 172.21.15.50:0/574750171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f00c7a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00c58b0 tx=0x7fa9e001c470 comp rx=0 tx=0).stop 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9f7800640 1 -- 172.21.15.50:0/574750171 shutdown_connections 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9f7800640 1 --2- 172.21.15.50:0/574750171 >> v2:172.21.15.125:3300/0 conn(0x7fa9f0156880 0x7fa9f00c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9f7800640 1 --2- 172.21.15.50:0/574750171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f00c7a00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.061+0000 7fa9f7800640 1 -- 172.21.15.50:0/574750171 >> 172.21.15.50:0/574750171 conn(0x7fa9f0072870 msgr2=0x7fa9f006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 -- 172.21.15.50:0/574750171 shutdown_connections 2024-01-30T08:09:49.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 -- 172.21.15.50:0/574750171 wait complete. 2024-01-30T08:09:49.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 Processor -- start 2024-01-30T08:09:49.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 -- start start 2024-01-30T08:09:49.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f00c3950 0x7fa9f01eb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9f0156880 0x7fa9f01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01514f0 con 0x7fa9f01564a0 2024-01-30T08:09:49.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01ebe90 con 0x7fa9f00c3950 2024-01-30T08:09:49.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f7800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0157520 con 0x7fa9f0156880 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f015ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44682/0 (socket says 172.21.15.50:44682) 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 -- 172.21.15.50:0/1206093249 learned_addr learned my addr 172.21.15.50:0/1206093249 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f4e00640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f00c3950 0x7fa9f01eb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9f5800640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9f0156880 0x7fa9f01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 -- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9f0156880 msgr2=0x7fa9f01597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9f0156880 0x7fa9f01597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 -- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f00c3950 msgr2=0x7fa9f01eb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f00c3950 0x7fa9f01eb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 -- 172.21.15.50:0/1206093249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00094d0 con 0x7fa9f01564a0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.065+0000 7fa9efe00640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f015ba20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800e8e0 tx=0x7fa9d800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9ecc00640 1 -- 172.21.15.50:0/1206093249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004020 con 0x7fa9f01564a0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9ecc00640 1 -- 172.21.15.50:0/1206093249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8004180 con 0x7fa9f01564a0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9ecc00640 1 -- 172.21.15.50:0/1206093249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800c8e0 con 0x7fa9f01564a0 2024-01-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f0157800 con 0x7fa9f01564a0 2024-01-30T08:09:49.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01516d0 con 0x7fa9f01564a0 2024-01-30T08:09:49.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0157d20 con 0x7fa9f01564a0 2024-01-30T08:09:49.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9ecc00640 1 -- 172.21.15.50:0/1206093249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa9d800ca40 con 0x7fa9f01564a0 2024-01-30T08:09:49.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9ecc00640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9c8066500 0x7fa9c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9ecc00640 1 -- 172.21.15.50:0/1206093249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa9d8083ec0 con 0x7fa9f01564a0 2024-01-30T08:09:49.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.069+0000 7fa9f4e00640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9c8066500 0x7fa9c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.073+0000 7fa9f4e00640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9c8066500 0x7fa9c80689c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00ae000 tx=0x7fa9e00b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.073+0000 7fa9ecc00640 1 -- 172.21.15.50:0/1206093249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa9d8051410 con 0x7fa9f01564a0 2024-01-30T08:09:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.289+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa9f01518f0 con 0x7fa9f01564a0 2024-01-30T08:09:49.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9ecc00640 1 -- 172.21.15.50:0/1206093249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa9d800ccf0 con 0x7fa9f01564a0 2024-01-30T08:09:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9c8066500 msgr2=0x7fa9c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9c8066500 0x7fa9c80689c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00ae000 tx=0x7fa9e00b5040 comp rx=0 tx=0).stop 2024-01-30T08:09:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 msgr2=0x7fa9f015ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f015ba20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800e8e0 tx=0x7fa9d800eda0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 shutdown_connections 2024-01-30T08:09:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9c8066500 0x7fa9c80689c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9f0156880 0x7fa9f01597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f01564a0 0x7fa9f015ba20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 --2- 172.21.15.50:0/1206093249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f00c3950 0x7fa9f01eb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.293+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 >> 172.21.15.50:0/1206093249 conn(0x7fa9f0072870 msgr2=0x7fa9f00ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.297+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 shutdown_connections 2024-01-30T08:09:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.297+0000 7fa9f7800640 1 -- 172.21.15.50:0/1206093249 wait complete. 2024-01-30T08:09:49.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-30T08:09:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.457+0000 7f9b0e200640 1 Processor -- start 2024-01-30T08:09:49.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.457+0000 7f9b0e200640 1 -- start start 2024-01-30T08:09:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b0e200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b080c4280 0x7f9b080bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b0e200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b08154aa0 con 0x7f9b08154490 2024-01-30T08:09:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b0e200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b08154870 con 0x7f9b080c5540 2024-01-30T08:09:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b0e200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b080bc470 con 0x7f9b080c4280 2024-01-30T08:09:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9b08154490 0x7f9b0806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50368/0 (socket says 172.21.15.50:50368) 2024-01-30T08:09:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 -- 172.21.15.50:0/1696035855 learned_addr learned my addr 172.21.15.50:0/1696035855 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06a00640 1 --2- 172.21.15.50:0/1696035855 >> v2:172.21.15.125:3300/0 conn(0x7f9b080c4280 0x7f9b080bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056881052 0 0) 0x7f9b08154aa0 con 0x7f9b08154490 2024-01-30T08:09:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae8003530 con 0x7f9b08154490 2024-01-30T08:09:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938424520 0 0) 0x7f9ae8003530 con 0x7f9b08154490 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 >> v2:172.21.15.125:3300/0 conn(0x7f9b080c4280 msgr2=0x7f9b080bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 --2- 172.21.15.50:0/1696035855 >> v2:172.21.15.125:3300/0 conn(0x7f9b080c4280 0x7f9b080bb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 >> v1:172.21.15.125:6789/0 conn(0x7f9b080c5540 legacy=0x7f9b080bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08154cf0 con 0x7f9b08154490 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f9af8001680 con 0x7f9b08154490 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 >> v1:172.21.15.50:6789/0 conn(0x7f9b08154490 legacy=0x7f9b0806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003980 0x7f9ae8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8004380 0x7f9ae8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ae8005050 0x7f9ae800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080bc470 con 0x7f9ae8003980 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae800bfb0 con 0x7f9ae8004380 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae800c170 con 0x7f9ae8005050 2024-01-30T08:09:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003980 0x7f9ae8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b06a00640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8004380 0x7f9ae8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07e00640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ae8005050 0x7f9ae800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 -- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ae8005050 msgr2=0x7f9ae800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ae8005050 0x7f9ae800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 -- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8004380 msgr2=0x7f9ae8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8004380 0x7f9ae8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07400640 1 -- 172.21.15.50:0/1696035855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8003530 con 0x7f9ae8003980 2024-01-30T08:09:49.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.461+0000 7f9b07e00640 1 -- 172.21.15.50:0/1696035855 reap_dead start 2024-01-30T08:09:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b07400640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003980 0x7f9ae8003d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9af8007fa0 tx=0x7f9af801ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d06c90bfcd8f98c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80a7d40 con 0x7f9ae8003980 2024-01-30T08:09:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af80058e0 con 0x7f9ae8003980 2024-01-30T08:09:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b06000640 1 -- 172.21.15.50:0/1696035855 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8005d10 con 0x7f9ae8003980 2024-01-30T08:09:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 -- 172.21.15.50:0/1696035855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003980 msgr2=0x7f9ae8003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003980 0x7f9ae8003d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9af8007fa0 tx=0x7f9af801ee40 comp rx=0 tx=0).stop 2024-01-30T08:09:49.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 -- 172.21.15.50:0/1696035855 shutdown_connections 2024-01-30T08:09:49.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 --2- 172.21.15.50:0/1696035855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003980 0x7f9ae8003d60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 -- 172.21.15.50:0/1696035855 >> 172.21.15.50:0/1696035855 conn(0x7f9b080c5f10 msgr2=0x7f9b080c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:49.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 -- 172.21.15.50:0/1696035855 shutdown_connections 2024-01-30T08:09:49.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 -- 172.21.15.50:0/1696035855 wait complete. 2024-01-30T08:09:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 Processor -- start 2024-01-30T08:09:49.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.465+0000 7f9b0e200640 1 -- start start 2024-01-30T08:09:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8003980 0x7f9b080a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b08150af0 0x7f9b080a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b080a2970 0x7f9b080bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081edc60 con 0x7f9b08150af0 2024-01-30T08:09:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081ed050 con 0x7f9ae8003980 2024-01-30T08:09:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081ed330 con 0x7f9b080a2970 2024-01-30T08:09:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b08150af0 0x7f9b080a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b08150af0 0x7f9b080a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44700/0 (socket says 172.21.15.50:44700) 2024-01-30T08:09:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 -- 172.21.15.50:0/2491925023 learned_addr learned my addr 172.21.15.50:0/2491925023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b07400640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8003980 0x7f9b080a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b07e00640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b080a2970 0x7f9b080bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 -- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b080a2970 msgr2=0x7f9b080bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b080a2970 0x7f9b080bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 -- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8003980 msgr2=0x7f9b080a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8003980 0x7f9b080a3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 -- 172.21.15.50:0/2491925023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b081ed610 con 0x7f9b08150af0 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b06a00640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b08150af0 0x7f9b080a2430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9af0011aa0 tx=0x7f9af0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9aff400640 1 -- 172.21.15.50:0/2491925023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000fb00 con 0x7f9b08150af0 2024-01-30T08:09:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9aff400640 1 -- 172.21.15.50:0/2491925023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000fc60 con 0x7f9b08150af0 2024-01-30T08:09:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9aff400640 1 -- 172.21.15.50:0/2491925023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0014440 con 0x7f9b08150af0 2024-01-30T08:09:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b081ed8f0 con 0x7f9b08150af0 2024-01-30T08:09:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b080a3b60 con 0x7f9b08150af0 2024-01-30T08:09:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.469+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b080a2d50 con 0x7f9b08150af0 2024-01-30T08:09:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.473+0000 7f9aff400640 1 -- 172.21.15.50:0/2491925023 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9af00145a0 con 0x7f9b08150af0 2024-01-30T08:09:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.473+0000 7f9aff400640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9ae0066530 0x7f9ae00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.473+0000 7f9aff400640 1 -- 172.21.15.50:0/2491925023 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9af0084290 con 0x7f9b08150af0 2024-01-30T08:09:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.473+0000 7f9b07400640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9ae0066530 0x7f9ae00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.473+0000 7f9b07400640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9ae0066530 0x7f9ae00689f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ad000 tx=0x7f9af80b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.477+0000 7f9aff400640 1 -- 172.21.15.50:0/2491925023 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9af0051880 con 0x7f9b08150af0 2024-01-30T08:09:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.689+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f9b0804ead0 con 0x7f9b08150af0 2024-01-30T08:09:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9aff400640 1 -- 172.21.15.50:0/2491925023 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9af0054ea0 con 0x7f9b08150af0 2024-01-30T08:09:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9ae0066530 msgr2=0x7f9ae00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9ae0066530 0x7f9ae00689f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ad000 tx=0x7f9af80b3040 comp rx=0 tx=0).stop 2024-01-30T08:09:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b08150af0 msgr2=0x7f9b080a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b08150af0 0x7f9b080a2430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9af0011aa0 tx=0x7f9af0011f60 comp rx=0 tx=0).stop 2024-01-30T08:09:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 shutdown_connections 2024-01-30T08:09:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9ae0066530 0x7f9ae00689f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b080a2970 0x7f9b080bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b08150af0 0x7f9b080a2430 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 --2- 172.21.15.50:0/2491925023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae8003980 0x7f9b080a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 >> 172.21.15.50:0/2491925023 conn(0x7f9b080c5f10 msgr2=0x7f9b08153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 shutdown_connections 2024-01-30T08:09:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.693+0000 7f9b0e200640 1 -- 172.21.15.50:0/2491925023 wait complete. 2024-01-30T08:09:49.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:49.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:09:49.856 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:09:49.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.853+0000 7fa37a200640 1 Processor -- start 2024-01-30T08:09:49.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.853+0000 7fa37a200640 1 -- start start 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa37a200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa37406de40 0x7fa37406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa37a200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa374153390 0x7fa3740a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa37a200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa374152f00 con 0x7fa3740c4310 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa37a200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3741525f0 con 0x7fa374153390 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa37a200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740a7680 con 0x7fa37406de40 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa374153390 0x7fa3740a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa374153390 0x7fa3740a6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44710/0 (socket says 172.21.15.50:44710) 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372a00640 1 -- 172.21.15.50:0/249465884 learned_addr learned my addr 172.21.15.50:0/249465884 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa373e00640 1 --1- 172.21.15.50:0/249465884 >> v1:172.21.15.50:6789/0 conn(0x7fa3740c4310 0x7fa374155be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50370/0 (socket says 172.21.15.50:50370) 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa373400640 1 --2- 172.21.15.50:0/249465884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa37406de40 0x7fa37406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372a00640 1 -- 172.21.15.50:0/249465884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa37406de40 msgr2=0x7fa37406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:49.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372a00640 1 --2- 172.21.15.50:0/249465884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa37406de40 0x7fa37406e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372a00640 1 -- 172.21.15.50:0/249465884 >> v1:172.21.15.50:6789/0 conn(0x7fa3740c4310 legacy=0x7fa374155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372000640 1 -- 172.21.15.50:0/249465884 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581344307 0 0) 0x7fa374152f00 con 0x7fa3740c4310 2024-01-30T08:09:49.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.857+0000 7fa372a00640 1 -- 172.21.15.50:0/249465884 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3741528b0 con 0x7fa374153390 2024-01-30T08:09:49.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa372a00640 1 --2- 172.21.15.50:0/249465884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa374153390 0x7fa3740a6de0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009870 tx=0x7fa35c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f9b45beb7ca398 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa372000640 1 -- 172.21.15.50:0/249465884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0ab610 con 0x7fa374153390 2024-01-30T08:09:49.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa372000640 1 -- 172.21.15.50:0/249465884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c0ab770 con 0x7fa374153390 2024-01-30T08:09:49.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa372000640 1 -- 172.21.15.50:0/249465884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0abb00 con 0x7fa374153390 2024-01-30T08:09:49.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 -- 172.21.15.50:0/249465884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa374153390 msgr2=0x7fa3740a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 --2- 172.21.15.50:0/249465884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa374153390 0x7fa3740a6de0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009870 tx=0x7fa35c01c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 -- 172.21.15.50:0/249465884 shutdown_connections 2024-01-30T08:09:49.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 --2- 172.21.15.50:0/249465884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa374153390 0x7fa3740a6de0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 --2- 172.21.15.50:0/249465884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa37406de40 0x7fa37406e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 -- 172.21.15.50:0/249465884 >> 172.21.15.50:0/249465884 conn(0x7fa3740c4830 msgr2=0x7fa3740c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:49.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 -- 172.21.15.50:0/249465884 shutdown_connections 2024-01-30T08:09:49.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 -- 172.21.15.50:0/249465884 wait complete. 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 Processor -- start 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.861+0000 7fa37a200640 1 -- start start 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa37406de40 0x7fa3741f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3740c4310 0x7fa37406cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa374153390 0x7fa374147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740a7eb0 con 0x7fa3740c4310 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa374155460 con 0x7fa37406de40 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3741f16c0 con 0x7fa374153390 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3740c4310 0x7fa37406cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3740c4310 0x7fa37406cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44716/0 (socket says 172.21.15.50:44716) 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 -- 172.21.15.50:0/675378089 learned_addr learned my addr 172.21.15.50:0/675378089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa373e00640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa374153390 0x7fa374147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa373400640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa37406de40 0x7fa3741f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 -- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa374153390 msgr2=0x7fa374147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa374153390 0x7fa374147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 -- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa37406de40 msgr2=0x7fa3741f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa37406de40 0x7fa3741f1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 -- 172.21.15.50:0/675378089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0094d0 con 0x7fa3740c4310 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa372a00640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3740c4310 0x7fa37406cf60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0ad040 tx=0x7fa35c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa36b400640 1 -- 172.21.15.50:0/675378089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0b4800 con 0x7fa3740c4310 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa36b400640 1 -- 172.21.15.50:0/675378089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c0b4960 con 0x7fa3740c4310 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa374154bc0 con 0x7fa3740c4310 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa36b400640 1 -- 172.21.15.50:0/675378089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0b4d10 con 0x7fa3740c4310 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa374155180 con 0x7fa3740c4310 2024-01-30T08:09:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.865+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3740a8020 con 0x7fa3740c4310 2024-01-30T08:09:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.869+0000 7fa36b400640 1 -- 172.21.15.50:0/675378089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa35c0c7390 con 0x7fa3740c4310 2024-01-30T08:09:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.869+0000 7fa36b400640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa34c066500 0x7fa34c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.869+0000 7fa36b400640 1 -- 172.21.15.50:0/675378089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa35c11e730 con 0x7fa3740c4310 2024-01-30T08:09:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.869+0000 7fa373400640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa34c066500 0x7fa34c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:49.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.869+0000 7fa373400640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa34c066500 0x7fa34c0689c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa364009b60 tx=0x7fa364009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:49.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:49.873+0000 7fa36b400640 1 -- 172.21.15.50:0/675378089 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa3740a8020 con 0x7fa3740c4310 2024-01-30T08:09:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.033+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3740a7ff0 con 0x7fa3740c4310 2024-01-30T08:09:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa36b400640 1 -- 172.21.15.50:0/675378089 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13063 (secure 0 0 0) 0x7fa35c0ebbf0 con 0x7fa3740c4310 2024-01-30T08:09:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:50.038 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:46.895171+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa34c066500 msgr2=0x7fa34c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa34c066500 0x7fa34c0689c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa364009b60 tx=0x7fa364009190 comp rx=0 tx=0).stop 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3740c4310 msgr2=0x7fa37406cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3740c4310 0x7fa37406cf60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0ad040 tx=0x7fa35c01ac30 comp rx=0 tx=0).stop 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 shutdown_connections 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa34c066500 0x7fa34c0689c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa374153390 0x7fa374147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3740c4310 0x7fa37406cf60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 --2- 172.21.15.50:0/675378089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa37406de40 0x7fa3741f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 >> 172.21.15.50:0/675378089 conn(0x7fa3740c4830 msgr2=0x7fa374151250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 shutdown_connections 2024-01-30T08:09:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.037+0000 7fa37a200640 1 -- 172.21.15.50:0/675378089 wait complete. 2024-01-30T08:09:50.061 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:09:50.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:09:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff760e00640 1 Processor -- start 2024-01-30T08:09:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff760e00640 1 -- start start 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff760e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff75c0c50d0 0x7ff75c156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff760e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c7ae0 0x7ff75c1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff760e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c0c8a50 con 0x7ff75c0c5c90 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff760e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75c0c7070 con 0x7ff75c0c50d0 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff760e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0c8d30 con 0x7ff75c0c7ae0 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff75c0c50d0 0x7ff75c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff75c0c50d0 0x7ff75c156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44720/0 (socket says 172.21.15.50:44720) 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759e00640 1 -- 172.21.15.50:0/3892417663 learned_addr learned my addr 172.21.15.50:0/3892417663 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759400640 1 --2- 172.21.15.50:0/3892417663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c7ae0 0x7ff75c1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759e00640 1 -- 172.21.15.50:0/3892417663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c7ae0 msgr2=0x7ff75c1566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759e00640 1 --2- 172.21.15.50:0/3892417663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c7ae0 0x7ff75c1566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759e00640 1 -- 172.21.15.50:0/3892417663 >> v1:172.21.15.125:6789/0 conn(0x7ff75c0c5c90 legacy=0x7ff75c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff759e00640 1 -- 172.21.15.50:0/3892417663 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0c66d0 con 0x7ff75c0c50d0 2024-01-30T08:09:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.205+0000 7ff758a00640 1 -- 172.21.15.50:0/3892417663 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156811622 0 0) 0x7ff75c0c8a50 con 0x7ff75c0c5c90 2024-01-30T08:09:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff759e00640 1 --2- 172.21.15.50:0/3892417663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c156190 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009870 tx=0x7ff74c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d2f24916f60d2c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff758a00640 1 -- 172.21.15.50:0/3892417663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0ab680 con 0x7ff75c0c50d0 2024-01-30T08:09:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff758a00640 1 -- 172.21.15.50:0/3892417663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c0ab7e0 con 0x7ff75c0c50d0 2024-01-30T08:09:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff758a00640 1 -- 172.21.15.50:0/3892417663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0abb70 con 0x7ff75c0c50d0 2024-01-30T08:09:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 -- 172.21.15.50:0/3892417663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 msgr2=0x7ff75c156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 --2- 172.21.15.50:0/3892417663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c156190 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009870 tx=0x7ff74c01c480 comp rx=0 tx=0).stop 2024-01-30T08:09:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 -- 172.21.15.50:0/3892417663 shutdown_connections 2024-01-30T08:09:50.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 --2- 172.21.15.50:0/3892417663 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c7ae0 0x7ff75c1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 --2- 172.21.15.50:0/3892417663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c156190 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 -- 172.21.15.50:0/3892417663 >> 172.21.15.50:0/3892417663 conn(0x7ff75c0727c0 msgr2=0x7ff75c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:50.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 -- 172.21.15.50:0/3892417663 shutdown_connections 2024-01-30T08:09:50.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.209+0000 7ff760e00640 1 -- 172.21.15.50:0/3892417663 wait complete. 2024-01-30T08:09:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 Processor -- start 2024-01-30T08:09:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 -- start start 2024-01-30T08:09:50.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c0abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c5c90 0x7ff75c1ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff75c0c7ae0 0x7ff75c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c151330 con 0x7ff75c0c50d0 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c1ed4f0 con 0x7ff75c0c7ae0 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c150600 con 0x7ff75c0c5c90 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c0abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c0abac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44730/0 (socket says 172.21.15.50:44730) 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 -- 172.21.15.50:0/2318242986 learned_addr learned my addr 172.21.15.50:0/2318242986 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759400640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c5c90 0x7ff75c1ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff75a800640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff75c0c7ae0 0x7ff75c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 -- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c5c90 msgr2=0x7ff75c1ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c5c90 0x7ff75c1ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 -- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff75c0c7ae0 msgr2=0x7ff75c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff75c0c7ae0 0x7ff75c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 -- 172.21.15.50:0/2318242986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0094d0 con 0x7ff75c0c50d0 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759400640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c5c90 0x7ff75c1ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff759e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c0abac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff74c01a0b0 tx=0x7ff74c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff752000640 1 -- 172.21.15.50:0/2318242986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0abd60 con 0x7ff75c0c50d0 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c0acfb0 con 0x7ff75c0c50d0 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff752000640 1 -- 172.21.15.50:0/2318242986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c0b8070 con 0x7ff75c0c50d0 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff752000640 1 -- 172.21.15.50:0/2318242986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c004220 con 0x7ff75c0c50d0 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c0accd0 con 0x7ff75c0c50d0 2024-01-30T08:09:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.213+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75c074a20 con 0x7ff75c0c50d0 2024-01-30T08:09:50.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.217+0000 7ff752000640 1 -- 172.21.15.50:0/2318242986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff74c004380 con 0x7ff75c0c50d0 2024-01-30T08:09:50.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.217+0000 7ff752000640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff734066500 0x7ff7340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.217+0000 7ff752000640 1 -- 172.21.15.50:0/2318242986 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff74c11e2c0 con 0x7ff75c0c50d0 2024-01-30T08:09:50.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.217+0000 7ff759400640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff734066500 0x7ff7340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.217+0000 7ff759400640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff734066500 0x7ff7340689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff75c15bd70 tx=0x7ff744008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.221+0000 7ff752000640 1 -- 172.21.15.50:0/2318242986 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff74c0eb780 con 0x7ff75c0c50d0 2024-01-30T08:09:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.381+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff75c070210 con 0x7ff75c0c50d0 2024-01-30T08:09:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.381+0000 7ff752000640 1 -- 172.21.15.50:0/2318242986 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff74c0eeda0 con 0x7ff75c0c50d0 2024-01-30T08:09:50.383 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:09:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.381+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff734066500 msgr2=0x7ff7340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.381+0000 7ff760e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff734066500 0x7ff7340689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff75c15bd70 tx=0x7ff744008040 comp rx=0 tx=0).stop 2024-01-30T08:09:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.381+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 msgr2=0x7ff75c0abac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.381+0000 7ff760e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c0abac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff74c01a0b0 tx=0x7ff74c01acc0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 shutdown_connections 2024-01-30T08:09:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff75c0c7ae0 0x7ff75c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff734066500 0x7ff7340689c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff75c0c5c90 0x7ff75c1ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 --2- 172.21.15.50:0/2318242986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75c0c50d0 0x7ff75c0abac0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 >> 172.21.15.50:0/2318242986 conn(0x7ff75c0727c0 msgr2=0x7ff75c06f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 shutdown_connections 2024-01-30T08:09:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.385+0000 7ff760e00640 1 -- 172.21.15.50:0/2318242986 wait complete. 2024-01-30T08:09:50.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-30T08:09:50.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6ca5e00640 1 Processor -- start 2024-01-30T08:09:50.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6ca5e00640 1 -- start start 2024-01-30T08:09:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6ca5e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ca0153390 0x7f6ca006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6ca5e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca0155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6ca5e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca0152f00 con 0x7f6ca006de40 2024-01-30T08:09:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6ca5e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca01525f0 con 0x7f6ca0153390 2024-01-30T08:09:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6ca5e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00a7680 con 0x7f6ca00c4310 2024-01-30T08:09:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9ea00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ca006de40 0x7f6ca00a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50382/0 (socket says 172.21.15.50:50382) 2024-01-30T08:09:50.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9ea00640 1 -- 172.21.15.50:0/3895836866 learned_addr learned my addr 172.21.15.50:0/3895836866 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:50.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9e000640 1 --2- 172.21.15.50:0/3895836866 >> v2:172.21.15.125:3300/0 conn(0x7f6ca0153390 0x7f6ca006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9f400640 1 --2- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca0155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9d600640 1 -- 172.21.15.50:0/3895836866 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146085265 0 0) 0x7f6ca0152f00 con 0x7f6ca006de40 2024-01-30T08:09:50.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9d600640 1 -- 172.21.15.50:0/3895836866 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c80003530 con 0x7f6ca006de40 2024-01-30T08:09:50.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9e000640 1 -- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 msgr2=0x7f6ca0155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:50.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9e000640 1 --2- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca0155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9e000640 1 -- 172.21.15.50:0/3895836866 >> v1:172.21.15.50:6789/0 conn(0x7f6ca006de40 legacy=0x7f6ca00a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9e000640 1 -- 172.21.15.50:0/3895836866 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca01528b0 con 0x7f6ca0153390 2024-01-30T08:09:50.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.545+0000 7f6c9f400640 1 --2- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca0155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6c9e000640 1 --2- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca0153390 0x7f6ca006e220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c880097c0 tx=0x7f6c8801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be09abfc61d0bc9c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6c9d600640 1 -- 172.21.15.50:0/3895836866 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880ab600 con 0x7f6ca0153390 2024-01-30T08:09:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6c9d600640 1 -- 172.21.15.50:0/3895836866 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c880a7050 con 0x7f6ca0153390 2024-01-30T08:09:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6c9d600640 1 -- 172.21.15.50:0/3895836866 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880ab980 con 0x7f6ca0153390 2024-01-30T08:09:50.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6ca5e00640 1 -- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca0153390 msgr2=0x7f6ca006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca0153390 0x7f6ca006e220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c880097c0 tx=0x7f6c8801c330 comp rx=0 tx=0).stop 2024-01-30T08:09:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6ca5e00640 1 -- 172.21.15.50:0/3895836866 shutdown_connections 2024-01-30T08:09:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca0155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/3895836866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca0153390 0x7f6ca006e220 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.549+0000 7f6ca5e00640 1 -- 172.21.15.50:0/3895836866 >> 172.21.15.50:0/3895836866 conn(0x7f6ca00c4830 msgr2=0x7f6ca00c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 -- 172.21.15.50:0/3895836866 shutdown_connections 2024-01-30T08:09:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 -- 172.21.15.50:0/3895836866 wait complete. 2024-01-30T08:09:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 Processor -- start 2024-01-30T08:09:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 -- start start 2024-01-30T08:09:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca006de40 0x7f6ca00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca0153390 0x7f6ca014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00c10c0 con 0x7f6ca0153390 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00adb90 con 0x7f6ca006de40 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6ca5e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01eba00 con 0x7f6ca00c4310 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca0153390 0x7f6ca014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca0153390 0x7f6ca014c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44742/0 (socket says 172.21.15.50:44742) 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 -- 172.21.15.50:0/2857865226 learned_addr learned my addr 172.21.15.50:0/2857865226 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9e000640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9ea00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca006de40 0x7f6ca00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 -- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 msgr2=0x7f6ca014bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca014bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 -- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca006de40 msgr2=0x7f6ca00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca006de40 0x7f6ca00c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 -- 172.21.15.50:0/2857865226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98009a70 con 0x7f6ca0153390 2024-01-30T08:09:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.553+0000 7f6c9f400640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca0153390 0x7f6ca014c0f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009eb0 tx=0x7f6c9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6c97400640 1 -- 172.21.15.50:0/2857865226 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98009d50 con 0x7f6ca0153390 2024-01-30T08:09:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6c97400640 1 -- 172.21.15.50:0/2857865226 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9800f040 con 0x7f6ca0153390 2024-01-30T08:09:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c88009420 con 0x7f6ca0153390 2024-01-30T08:09:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6c97400640 1 -- 172.21.15.50:0/2857865226 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980146a0 con 0x7f6ca0153390 2024-01-30T08:09:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca01ebf30 con 0x7f6ca0153390 2024-01-30T08:09:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca00befa0 con 0x7f6ca0153390 2024-01-30T08:09:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6c97400640 1 -- 172.21.15.50:0/2857865226 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6c98014800 con 0x7f6ca0153390 2024-01-30T08:09:50.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6c97400640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6c78066500 0x7f6c780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6c97400640 1 -- 172.21.15.50:0/2857865226 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6c98084b00 con 0x7f6ca0153390 2024-01-30T08:09:50.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.557+0000 7f6c9ea00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6c78066500 0x7f6c780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.561+0000 7f6c9ea00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6c78066500 0x7f6c780689c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6c90007fd0 tx=0x7f6c90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.561+0000 7f6c97400640 1 -- 172.21.15.50:0/2857865226 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6ca00befa0 con 0x7f6ca0153390 2024-01-30T08:09:50.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.721+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6ca00befa0 con 0x7f6ca0153390 2024-01-30T08:09:50.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6c97400640 1 -- 172.21.15.50:0/2857865226 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6ca00befa0 con 0x7f6ca0153390 2024-01-30T08:09:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:50.726 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-01-30T08:09:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:09:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-01-30T08:09:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-01-30T08:09:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:09:50.726 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6c78066500 msgr2=0x7f6c780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6c78066500 0x7f6c780689c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6c90007fd0 tx=0x7f6c90009040 comp rx=0 tx=0).stop 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca0153390 msgr2=0x7f6ca014c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca0153390 0x7f6ca014c0f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009eb0 tx=0x7f6c9800c490 comp rx=0 tx=0).stop 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 shutdown_connections 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6c78066500 0x7f6c780689c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca0153390 0x7f6ca014c0f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ca00c4310 0x7f6ca014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 --2- 172.21.15.50:0/2857865226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ca006de40 0x7f6ca00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 >> 172.21.15.50:0/2857865226 conn(0x7f6ca00c4830 msgr2=0x7f6ca006e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:50.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 shutdown_connections 2024-01-30T08:09:50.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.725+0000 7f6ca5e00640 1 -- 172.21.15.50:0/2857865226 wait complete. 2024-01-30T08:09:50.747 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-30T08:09:50.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-30T08:09:50.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.889+0000 7fa96fe00640 1 Processor -- start 2024-01-30T08:09:50.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.889+0000 7fa96fe00640 1 -- start start 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96fe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9680c4960 0x7fa9680c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96fe00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9681551d0 0x7fa968155620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96fe00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680c3670 con 0x7fa96806ca80 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96fe00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9680c3a20 con 0x7fa9680c4960 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96fe00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96806c5f0 con 0x7fa9681551d0 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96d400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9680c4960 0x7fa9680c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96d400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9680c4960 0x7fa9680c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44758/0 (socket says 172.21.15.50:44758) 2024-01-30T08:09:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96d400640 1 -- 172.21.15.50:0/4152578869 learned_addr learned my addr 172.21.15.50:0/4152578869 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96d400640 1 -- 172.21.15.50:0/4152578869 >> v2:172.21.15.125:3300/0 conn(0x7fa9681551d0 msgr2=0x7fa968155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96d400640 1 --2- 172.21.15.50:0/4152578869 >> v2:172.21.15.125:3300/0 conn(0x7fa9681551d0 0x7fa968155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96d400640 1 -- 172.21.15.50:0/4152578869 >> v1:172.21.15.125:6789/0 conn(0x7fa96806ca80 legacy=0x7fa9680c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.893+0000 7fa96d400640 1 -- 172.21.15.50:0/4152578869 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968158d80 con 0x7fa9680c4960 2024-01-30T08:09:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96d400640 1 --2- 172.21.15.50:0/4152578869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9680c4960 0x7fa9680c3130 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9680c51a0 tx=0x7fa95801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd44e5bcf792fcc server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa967e00640 1 -- 172.21.15.50:0/4152578869 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580ab600 con 0x7fa9680c4960 2024-01-30T08:09:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa967e00640 1 -- 172.21.15.50:0/4152578869 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9580ab760 con 0x7fa9680c4960 2024-01-30T08:09:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa967e00640 1 -- 172.21.15.50:0/4152578869 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580abaf0 con 0x7fa9680c4960 2024-01-30T08:09:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 -- 172.21.15.50:0/4152578869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9680c4960 msgr2=0x7fa9680c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 --2- 172.21.15.50:0/4152578869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9680c4960 0x7fa9680c3130 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9680c51a0 tx=0x7fa95801c400 comp rx=0 tx=0).stop 2024-01-30T08:09:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 -- 172.21.15.50:0/4152578869 shutdown_connections 2024-01-30T08:09:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 --2- 172.21.15.50:0/4152578869 >> v2:172.21.15.125:3300/0 conn(0x7fa9681551d0 0x7fa968155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 --2- 172.21.15.50:0/4152578869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9680c4960 0x7fa9680c3130 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 -- 172.21.15.50:0/4152578869 >> 172.21.15.50:0/4152578869 conn(0x7fa9680a9a80 msgr2=0x7fa9680a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 -- 172.21.15.50:0/4152578869 shutdown_connections 2024-01-30T08:09:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.897+0000 7fa96fe00640 1 -- 172.21.15.50:0/4152578869 wait complete. 2024-01-30T08:09:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 Processor -- start 2024-01-30T08:09:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 -- start start 2024-01-30T08:09:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96806ca80 0x7fa9681f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9680c4960 0x7fa968154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9681551d0 0x7fa96814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806ff10 con 0x7fa96806ca80 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806ea40 con 0x7fa9680c4960 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa968070330 con 0x7fa9681551d0 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96806ca80 0x7fa9681f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96806ca80 0x7fa9681f0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44774/0 (socket says 172.21.15.50:44774) 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 -- 172.21.15.50:0/346489024 learned_addr learned my addr 172.21.15.50:0/346489024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96de00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9681551d0 0x7fa96814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96ca00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9680c4960 0x7fa968154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 -- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9681551d0 msgr2=0x7fa96814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9681551d0 0x7fa96814de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 -- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9680c4960 msgr2=0x7fa968154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9680c4960 0x7fa968154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 -- 172.21.15.50:0/346489024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580094d0 con 0x7fa96806ca80 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96d400640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96806ca80 0x7fa9681f0be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa95801aab0 tx=0x7fa95801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa965600640 1 -- 172.21.15.50:0/346489024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580b4800 con 0x7fa96806ca80 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa965600640 1 -- 172.21.15.50:0/346489024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9580b4980 con 0x7fa96806ca80 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96806e150 con 0x7fa96806ca80 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa965600640 1 -- 172.21.15.50:0/346489024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580b4d30 con 0x7fa96806ca80 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.901+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96806fb30 con 0x7fa96806ca80 2024-01-30T08:09:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.905+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968070180 con 0x7fa96806ca80 2024-01-30T08:09:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.905+0000 7fa965600640 1 -- 172.21.15.50:0/346489024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa9580c7440 con 0x7fa96806ca80 2024-01-30T08:09:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.905+0000 7fa965600640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa940066530 0x7fa9400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.905+0000 7fa965600640 1 -- 172.21.15.50:0/346489024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa95811e710 con 0x7fa96806ca80 2024-01-30T08:09:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.905+0000 7fa96ca00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa940066530 0x7fa9400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.905+0000 7fa96ca00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa940066530 0x7fa9400689f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa968154b60 tx=0x7fa950009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:50.909+0000 7fa965600640 1 -- 172.21.15.50:0/346489024 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa9580ebd80 con 0x7fa96806ca80 2024-01-30T08:09:51.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.073+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa9680c3670 con 0x7fa96806ca80 2024-01-30T08:09:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa965600640 1 -- 172.21.15.50:0/346489024 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa9680c3670 con 0x7fa96806ca80 2024-01-30T08:09:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-01-30T08:09:51.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa940066530 msgr2=0x7fa9400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:51.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa940066530 0x7fa9400689f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa968154b60 tx=0x7fa950009040 comp rx=0 tx=0).stop 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96806ca80 msgr2=0x7fa9681f0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96806ca80 0x7fa9681f0be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa95801aab0 tx=0x7fa95801ac40 comp rx=0 tx=0).stop 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 shutdown_connections 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9680c4960 0x7fa968154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa940066530 0x7fa9400689f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9681551d0 0x7fa96814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 --2- 172.21.15.50:0/346489024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96806ca80 0x7fa9681f0be0 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa95801aab0 tx=0x7fa95801ac40 comp rx=0 tx=0).stop 2024-01-30T08:09:51.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.905+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 >> 172.21.15.50:0/346489024 conn(0x7fa9680a9a80 msgr2=0x7fa96806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:51.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.909+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 shutdown_connections 2024-01-30T08:09:51.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:51.909+0000 7fa96fe00640 1 -- 172.21.15.50:0/346489024 wait complete. 2024-01-30T08:09:51.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-30T08:09:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d53000640 1 Processor -- start 2024-01-30T08:09:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d53000640 1 -- start start 2024-01-30T08:09:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d53000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4d4c0c50d0 0x7f4d4c156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d53000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d4c0c7ae0 0x7f4d4c1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d53000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0c8a50 con 0x7f4d4c0c5c90 2024-01-30T08:09:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d53000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0c7070 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d53000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0c8d30 con 0x7f4d4c0c50d0 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4b400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d4c0c7ae0 0x7f4d4c1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4b400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d4c0c7ae0 0x7f4d4c1566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44784/0 (socket says 172.21.15.50:44784) 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4b400640 1 -- 172.21.15.50:0/1663195798 learned_addr learned my addr 172.21.15.50:0/1663195798 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d51000640 1 --1- 172.21.15.50:0/1663195798 >> v1:172.21.15.50:6789/0 conn(0x7f4d4c0c5c90 0x7f4d4c0c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50396/0 (socket says 172.21.15.50:50396) 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4be00640 1 --2- 172.21.15.50:0/1663195798 >> v2:172.21.15.125:3300/0 conn(0x7f4d4c0c50d0 0x7f4d4c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4b400640 1 -- 172.21.15.50:0/1663195798 >> v2:172.21.15.125:3300/0 conn(0x7f4d4c0c50d0 msgr2=0x7f4d4c156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:52.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4b400640 1 --2- 172.21.15.50:0/1663195798 >> v2:172.21.15.125:3300/0 conn(0x7f4d4c0c50d0 0x7f4d4c156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4b400640 1 -- 172.21.15.50:0/1663195798 >> v1:172.21.15.50:6789/0 conn(0x7f4d4c0c5c90 legacy=0x7f4d4c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4aa00640 1 -- 172.21.15.50:0/1663195798 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410036605 0 0) 0x7f4d4c0c8a50 con 0x7f4d4c0c5c90 2024-01-30T08:09:52.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.089+0000 7f4d4b400640 1 -- 172.21.15.50:0/1663195798 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0c66d0 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d4b400640 1 --2- 172.21.15.50:0/1663195798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c1566d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0aab20 tx=0x7f4d3401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e4f49ba95c0692 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d4aa00640 1 -- 172.21.15.50:0/1663195798 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340ab640 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d4aa00640 1 -- 172.21.15.50:0/1663195798 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d340a7070 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d4aa00640 1 -- 172.21.15.50:0/1663195798 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340ab9c0 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 -- 172.21.15.50:0/1663195798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 msgr2=0x7f4d4c1566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 --2- 172.21.15.50:0/1663195798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c1566d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0aab20 tx=0x7f4d3401c440 comp rx=0 tx=0).stop 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 -- 172.21.15.50:0/1663195798 shutdown_connections 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 --2- 172.21.15.50:0/1663195798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c1566d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 --2- 172.21.15.50:0/1663195798 >> v2:172.21.15.125:3300/0 conn(0x7f4d4c0c50d0 0x7f4d4c156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 -- 172.21.15.50:0/1663195798 >> 172.21.15.50:0/1663195798 conn(0x7f4d4c0727c0 msgr2=0x7f4d4c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 -- 172.21.15.50:0/1663195798 shutdown_connections 2024-01-30T08:09:52.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.093+0000 7f4d53000640 1 -- 172.21.15.50:0/1663195798 wait complete. 2024-01-30T08:09:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 Processor -- start 2024-01-30T08:09:52.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 -- start start 2024-01-30T08:09:52.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d4c0c50d0 0x7f4d4c0aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d4c0c5c90 0x7f4d4c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c150fa0 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c152b30 con 0x7f4d4c0c5c90 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c152820 con 0x7f4d4c0c50d0 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44800/0 (socket says 172.21.15.50:44800) 2024-01-30T08:09:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 -- 172.21.15.50:0/140896583 learned_addr learned my addr 172.21.15.50:0/140896583 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d4b400640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d4c0c5c90 0x7f4d4c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d4be00640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d4c0c50d0 0x7f4d4c0aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 -- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d4c0c50d0 msgr2=0x7f4d4c0aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d4c0c50d0 0x7f4d4c0aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 -- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d4c0c5c90 msgr2=0x7f4d4c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d4c0c5c90 0x7f4d4c152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 -- 172.21.15.50:0/140896583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340094d0 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d51000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c148030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c7d0 tx=0x7f4d4400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d43e00640 1 -- 172.21.15.50:0/140896583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400a5e0 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d43e00640 1 -- 172.21.15.50:0/140896583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400a740 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c0a7c70 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d43e00640 1 -- 172.21.15.50:0/140896583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400ab30 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.097+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c0a8230 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.101+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c074a20 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.101+0000 7f4d43e00640 1 -- 172.21.15.50:0/140896583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4d4400ac90 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.101+0000 7f4d43e00640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d24066500 0x7f4d240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.101+0000 7f4d43e00640 1 -- 172.21.15.50:0/140896583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f4d44083630 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.105+0000 7f4d4be00640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d24066500 0x7f4d240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.105+0000 7f4d4be00640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d24066500 0x7f4d240689c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00b9d0 tx=0x7f4d3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.109+0000 7f4d43e00640 1 -- 172.21.15.50:0/140896583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4d44050960 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.265+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4d4c152c70 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.905+0000 7f4d43e00640 1 -- 172.21.15.50:0/140896583 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4d44053f80 con 0x7f4d4c0c7ae0 2024-01-30T08:09:52.910 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-01-30T08:09:52.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d24066500 msgr2=0x7f4d240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d24066500 0x7f4d240689c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00b9d0 tx=0x7f4d3c008040 comp rx=0 tx=0).stop 2024-01-30T08:09:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 msgr2=0x7f4d4c148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c148030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c7d0 tx=0x7f4d4400cc90 comp rx=0 tx=0).stop 2024-01-30T08:09:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 shutdown_connections 2024-01-30T08:09:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d4c0c5c90 0x7f4d4c152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4d24066500 0x7f4d240689c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d4c0c7ae0 0x7f4d4c148030 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 --2- 172.21.15.50:0/140896583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4d4c0c50d0 0x7f4d4c0aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 >> 172.21.15.50:0/140896583 conn(0x7f4d4c0727c0 msgr2=0x7f4d4c14b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 shutdown_connections 2024-01-30T08:09:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:52.909+0000 7f4d53000640 1 -- 172.21.15.50:0/140896583 wait complete. 2024-01-30T08:09:52.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-30T08:09:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f9586000640 1 Processor -- start 2024-01-30T08:09:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f9586000640 1 -- start start 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f9586000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9580155500 0x7f95800c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f9586000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f958006f240 0x7f958006f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f9586000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9580158b70 con 0x7f95800c1200 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f9586000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9580157f60 con 0x7f958006f240 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f9586000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9580158240 con 0x7f9580155500 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f958006f240 0x7f958006f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f958006f240 0x7f958006f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44810/0 (socket says 172.21.15.50:44810) 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957fe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95800c1200 0x7f95800c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50404/0 (socket says 172.21.15.50:50404) 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957ea00640 1 -- 172.21.15.50:0/1706115900 learned_addr learned my addr 172.21.15.50:0/1706115900 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957f400640 1 --2- 172.21.15.50:0/1706115900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9580155500 0x7f95800c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957ea00640 1 -- 172.21.15.50:0/1706115900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9580155500 msgr2=0x7f95800c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957ea00640 1 --2- 172.21.15.50:0/1706115900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9580155500 0x7f95800c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957ea00640 1 -- 172.21.15.50:0/1706115900 >> v1:172.21.15.50:6789/0 conn(0x7f95800c1200 legacy=0x7f95800c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957ea00640 1 -- 172.21.15.50:0/1706115900 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580158520 con 0x7f958006f240 2024-01-30T08:09:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.101+0000 7f957e000640 1 -- 172.21.15.50:0/1706115900 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463296267 0 0) 0x7f9580158b70 con 0x7f95800c1200 2024-01-30T08:09:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f957ea00640 1 --2- 172.21.15.50:0/1706115900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f958006f240 0x7f958006f6a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9568009870 tx=0x7f956801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545c609728228dc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f957e000640 1 -- 172.21.15.50:0/1706115900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680ab610 con 0x7f958006f240 2024-01-30T08:09:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f957e000640 1 -- 172.21.15.50:0/1706115900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95680ab770 con 0x7f958006f240 2024-01-30T08:09:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f957e000640 1 -- 172.21.15.50:0/1706115900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680abb00 con 0x7f958006f240 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 -- 172.21.15.50:0/1706115900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f958006f240 msgr2=0x7f958006f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 --2- 172.21.15.50:0/1706115900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f958006f240 0x7f958006f6a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9568009870 tx=0x7f956801c3f0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 -- 172.21.15.50:0/1706115900 shutdown_connections 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 --2- 172.21.15.50:0/1706115900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f958006f240 0x7f958006f6a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 --2- 172.21.15.50:0/1706115900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9580155500 0x7f95800c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 -- 172.21.15.50:0/1706115900 >> 172.21.15.50:0/1706115900 conn(0x7f95800727c0 msgr2=0x7f958006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 -- 172.21.15.50:0/1706115900 shutdown_connections 2024-01-30T08:09:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.105+0000 7f9586000640 1 -- 172.21.15.50:0/1706115900 wait complete. 2024-01-30T08:09:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 Processor -- start 2024-01-30T08:09:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 -- start start 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f958006f240 0x7f958014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95800c1200 0x7f95801ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580155500 0x7f95801ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800acb00 con 0x7f9580155500 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800a7140 con 0x7f958006f240 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95801ec990 con 0x7f95800c1200 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580155500 0x7f95801ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580155500 0x7f95801ed3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44814/0 (socket says 172.21.15.50:44814) 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 -- 172.21.15.50:0/1692082173 learned_addr learned my addr 172.21.15.50:0/1692082173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957ea00640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95800c1200 0x7f95801ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957f400640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f958006f240 0x7f958014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 -- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95800c1200 msgr2=0x7f95801ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95800c1200 0x7f95801ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 -- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f958006f240 msgr2=0x7f958014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f958006f240 0x7f958014f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 -- 172.21.15.50:0/1692082173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094d0 con 0x7f9580155500 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957f400640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f958006f240 0x7f958014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f957fe00640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580155500 0x7f95801ed3b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f957800c700 tx=0x7f957800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9577400640 1 -- 172.21.15.50:0/1692082173 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800ce10 con 0x7f9580155500 2024-01-30T08:09:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9577400640 1 -- 172.21.15.50:0/1692082173 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957800a640 con 0x7f9580155500 2024-01-30T08:09:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9577400640 1 -- 172.21.15.50:0/1692082173 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800aa30 con 0x7f9580155500 2024-01-30T08:09:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95800ac820 con 0x7f9580155500 2024-01-30T08:09:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.109+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9580148c60 con 0x7f9580155500 2024-01-30T08:09:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.113+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95800a6cc0 con 0x7f9580155500 2024-01-30T08:09:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.113+0000 7f9577400640 1 -- 172.21.15.50:0/1692082173 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f957800ab90 con 0x7f9580155500 2024-01-30T08:09:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.113+0000 7f9577400640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9558066500 0x7f95580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.113+0000 7f9577400640 1 -- 172.21.15.50:0/1692082173 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f95780836b0 con 0x7f9580155500 2024-01-30T08:09:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.113+0000 7f957f400640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9558066500 0x7f95580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.113+0000 7f957f400640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9558066500 0x7f95580689c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9570007a70 tx=0x7f9570008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.117+0000 7f9577400640 1 -- 172.21.15.50:0/1692082173 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9578050910 con 0x7f9580155500 2024-01-30T08:09:53.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.313+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f95801ec7f0 con 0x7f9580155500 2024-01-30T08:09:53.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.921+0000 7f9577400640 1 -- 172.21.15.50:0/1692082173 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f95801ec7f0 con 0x7f9580155500 2024-01-30T08:09:53.925 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 5 and data pool 6 2024-01-30T08:09:53.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9558066500 msgr2=0x7f95580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:53.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9558066500 0x7f95580689c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9570007a70 tx=0x7f9570008040 comp rx=0 tx=0).stop 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580155500 msgr2=0x7f95801ed3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580155500 0x7f95801ed3b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f957800c700 tx=0x7f957800cbc0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 shutdown_connections 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9558066500 0x7f95580689c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580155500 0x7f95801ed3b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95800c1200 0x7f95801ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 --2- 172.21.15.50:0/1692082173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f958006f240 0x7f958014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:53.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 >> 172.21.15.50:0/1692082173 conn(0x7f95800727c0 msgr2=0x7f958006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:53.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 shutdown_connections 2024-01-30T08:09:53.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:53.925+0000 7f9586000640 1 -- 172.21.15.50:0/1692082173 wait complete. 2024-01-30T08:09:53.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.097+0000 7fbe05600640 1 Processor -- start 2024-01-30T08:09:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.097+0000 7fbe05600640 1 -- start start 2024-01-30T08:09:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbe05600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe000c1de0 0x7fbe001559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbe05600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe000c3ed0 con 0x7fbe000c0ee0 2024-01-30T08:09:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbe05600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0006bca0 con 0x7fbe0014fbf0 2024-01-30T08:09:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbe05600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000a5520 con 0x7fbe000c1de0 2024-01-30T08:09:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdfe000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe000c0ee0 0x7fbe0006a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50412/0 (socket says 172.21.15.50:50412) 2024-01-30T08:09:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdfe000640 1 -- 172.21.15.50:0/3992600145 learned_addr learned my addr 172.21.15.50:0/3992600145 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdff400640 1 --2- 172.21.15.50:0/3992600145 >> v2:172.21.15.125:3300/0 conn(0x7fbe000c1de0 0x7fbe001559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636718783 0 0) 0x7fbe000c3ed0 con 0x7fbe000c0ee0 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde0003530 con 0x7fbe000c0ee0 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538165575 0 0) 0x7fbe0006bca0 con 0x7fbe0014fbf0 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe000c3ed0 con 0x7fbe0014fbf0 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2868956056 0 0) 0x7fbde0003530 con 0x7fbe000c0ee0 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdff400640 1 -- 172.21.15.50:0/3992600145 >> v1:172.21.15.125:6789/0 conn(0x7fbe0014fbf0 legacy=0x7fbe000a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdff400640 1 -- 172.21.15.50:0/3992600145 >> v1:172.21.15.50:6789/0 conn(0x7fbe000c0ee0 legacy=0x7fbe0006a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.101+0000 7fbdff400640 1 -- 172.21.15.50:0/3992600145 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0006bef0 con 0x7fbe000c1de0 2024-01-30T08:09:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbdff400640 1 --2- 172.21.15.50:0/3992600145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe001559c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009d90 tx=0x7fbdf801c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f057d12069762cb server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8001680 con 0x7fbe000c1de0 2024-01-30T08:09:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf80a55b0 con 0x7fbe000c1de0 2024-01-30T08:09:54.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbdfd600640 1 -- 172.21.15.50:0/3992600145 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80a5940 con 0x7fbe000c1de0 2024-01-30T08:09:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 -- 172.21.15.50:0/3992600145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 msgr2=0x7fbe001559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 --2- 172.21.15.50:0/3992600145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe001559c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009d90 tx=0x7fbdf801c750 comp rx=0 tx=0).stop 2024-01-30T08:09:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 -- 172.21.15.50:0/3992600145 shutdown_connections 2024-01-30T08:09:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 --2- 172.21.15.50:0/3992600145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe001559c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 -- 172.21.15.50:0/3992600145 >> 172.21.15.50:0/3992600145 conn(0x7fbe000c5b50 msgr2=0x7fbe000c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 -- 172.21.15.50:0/3992600145 shutdown_connections 2024-01-30T08:09:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 -- 172.21.15.50:0/3992600145 wait complete. 2024-01-30T08:09:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 Processor -- start 2024-01-30T08:09:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.105+0000 7fbe05600640 1 -- start start 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe000c0ee0 0x7fbe00148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe00150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0014fbf0 0x7fbe00142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe001502c0 con 0x7fbe0014fbf0 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000a7370 con 0x7fbe000c1de0 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000a5cd0 con 0x7fbe000c0ee0 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0014fbf0 0x7fbe00142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdfea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe000c0ee0 0x7fbe00148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdfe000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe00150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0014fbf0 0x7fbe00142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44830/0 (socket says 172.21.15.50:44830) 2024-01-30T08:09:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdfe000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe00150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:52230/0 (socket says 172.21.15.50:52230) 2024-01-30T08:09:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 -- 172.21.15.50:0/1485726724 learned_addr learned my addr 172.21.15.50:0/1485726724 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 -- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe000c0ee0 msgr2=0x7fbe00148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe000c0ee0 0x7fbe00148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 -- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 msgr2=0x7fbe00150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe00150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 -- 172.21.15.50:0/1485726724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009a70 con 0x7fbe0014fbf0 2024-01-30T08:09:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdfe000640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe00150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdff400640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0014fbf0 0x7fbe00142da0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009d90 tx=0x7fbdf80194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdf6a00640 1 -- 172.21.15.50:0/1485726724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8003ba0 con 0x7fbe0014fbf0 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdf6a00640 1 -- 172.21.15.50:0/1485726724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8003d00 con 0x7fbe0014fbf0 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe000a5fb0 con 0x7fbe0014fbf0 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbdf6a00640 1 -- 172.21.15.50:0/1485726724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8004220 con 0x7fbe0014fbf0 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe00148c50 con 0x7fbe0014fbf0 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.109+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe00150470 con 0x7fbe0014fbf0 2024-01-30T08:09:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.113+0000 7fbdf6a00640 1 -- 172.21.15.50:0/1485726724 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbdf8004380 con 0x7fbe0014fbf0 2024-01-30T08:09:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.113+0000 7fbdf6a00640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbdd8066500 0x7fbdd80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.113+0000 7fbdf6a00640 1 -- 172.21.15.50:0/1485726724 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbdf811ec50 con 0x7fbe0014fbf0 2024-01-30T08:09:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.113+0000 7fbdfea00640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbdd8066500 0x7fbdd80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.113+0000 7fbdfea00640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbdd8066500 0x7fbdd80689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00011f0 tx=0x7fbdf0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.117+0000 7fbdf6a00640 1 -- 172.21.15.50:0/1485726724 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbe00150470 con 0x7fbe0014fbf0 2024-01-30T08:09:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.277+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe00150470 con 0x7fbe0014fbf0 2024-01-30T08:09:54.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.277+0000 7fbdf6a00640 1 -- 172.21.15.50:0/1485726724 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16788 (secure 0 0 0) 0x7fbe00150470 con 0x7fbe0014fbf0 2024-01-30T08:09:54.281 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:54.281 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:53.316016+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbdd8066500 msgr2=0x7fbdd80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbdd8066500 0x7fbdd80689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00011f0 tx=0x7fbdf0009040 comp rx=0 tx=0).stop 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0014fbf0 msgr2=0x7fbe00142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0014fbf0 0x7fbe00142da0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009d90 tx=0x7fbdf80194f0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 shutdown_connections 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe000c1de0 0x7fbe00150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbdd8066500 0x7fbdd80689c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0014fbf0 0x7fbe00142da0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 --2- 172.21.15.50:0/1485726724 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe000c0ee0 0x7fbe00148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 >> 172.21.15.50:0/1485726724 conn(0x7fbe000c5b50 msgr2=0x7fbe000a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:54.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 shutdown_connections 2024-01-30T08:09:54.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.281+0000 7fbe05600640 1 -- 172.21.15.50:0/1485726724 wait complete. 2024-01-30T08:09:54.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22fa00640 1 Processor -- start 2024-01-30T08:09:54.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22fa00640 1 -- start start 2024-01-30T08:09:54.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22fa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2280c4e00 0x7fa2280729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa22815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22fa00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280c3e40 con 0x7fa2280a4e50 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22fa00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280c42d0 con 0x7fa2280c4e00 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280a8c20 con 0x7fa228158a00 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.441+0000 7fa22d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2280c4e00 0x7fa2280729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2280c4e00 0x7fa2280729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44838/0 (socket says 172.21.15.50:44838) 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22d000640 1 -- 172.21.15.50:0/4113380053 learned_addr learned my addr 172.21.15.50:0/4113380053 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22da00640 1 --2- 172.21.15.50:0/4113380053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa22815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22d000640 1 -- 172.21.15.50:0/4113380053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 msgr2=0x7fa22815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22d000640 1 --2- 172.21.15.50:0/4113380053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa22815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22d000640 1 -- 172.21.15.50:0/4113380053 >> v1:172.21.15.125:6789/0 conn(0x7fa2280a4e50 legacy=0x7fa2280a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22d000640 1 -- 172.21.15.50:0/4113380053 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280c3b10 con 0x7fa2280c4e00 2024-01-30T08:09:54.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa22d000640 1 --2- 172.21.15.50:0/4113380053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280c4e00 0x7fa2280729a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa218009870 tx=0x7fa21801e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db967d4b7bbcbc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa227400640 1 -- 172.21.15.50:0/4113380053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a8630 con 0x7fa2280c4e00 2024-01-30T08:09:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa227400640 1 -- 172.21.15.50:0/4113380053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180a8790 con 0x7fa2280c4e00 2024-01-30T08:09:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.445+0000 7fa227400640 1 -- 172.21.15.50:0/4113380053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a8b20 con 0x7fa2280c4e00 2024-01-30T08:09:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- 172.21.15.50:0/4113380053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280c4e00 msgr2=0x7fa2280729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 --2- 172.21.15.50:0/4113380053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280c4e00 0x7fa2280729a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa218009870 tx=0x7fa21801e720 comp rx=0 tx=0).stop 2024-01-30T08:09:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- 172.21.15.50:0/4113380053 shutdown_connections 2024-01-30T08:09:54.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 --2- 172.21.15.50:0/4113380053 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa22815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 --2- 172.21.15.50:0/4113380053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280c4e00 0x7fa2280729a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- 172.21.15.50:0/4113380053 >> 172.21.15.50:0/4113380053 conn(0x7fa2280c5b50 msgr2=0x7fa2280c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:54.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- 172.21.15.50:0/4113380053 shutdown_connections 2024-01-30T08:09:54.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- 172.21.15.50:0/4113380053 wait complete. 2024-01-30T08:09:54.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 Processor -- start 2024-01-30T08:09:54.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- start start 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280a4e50 0x7fa22814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2280c4e00 0x7fa2281ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa2281ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228159f60 con 0x7fa2280a4e50 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281efe20 con 0x7fa2280c4e00 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22fa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22806bca0 con 0x7fa228158a00 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280a4e50 0x7fa22814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280a4e50 0x7fa22814f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44854/0 (socket says 172.21.15.50:44854) 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 -- 172.21.15.50:0/1603047611 learned_addr learned my addr 172.21.15.50:0/1603047611 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa227e00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2280c4e00 0x7fa2281ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22da00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa2281ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 -- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 msgr2=0x7fa2281ef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa2281ef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 -- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2280c4e00 msgr2=0x7fa2281ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2280c4e00 0x7fa2281ecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22d000640 1 -- 172.21.15.50:0/1603047611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180094d0 con 0x7fa2280a4e50 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.449+0000 7fa22da00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa2281ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa22d000640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280a4e50 0x7fa22814f750 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa218024d30 tx=0x7fa21801b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa224c00640 1 -- 172.21.15.50:0/1603047611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a8630 con 0x7fa2280a4e50 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa224c00640 1 -- 172.21.15.50:0/1603047611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180b3860 con 0x7fa2280a4e50 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22806bf80 con 0x7fa2280a4e50 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa224c00640 1 -- 172.21.15.50:0/1603047611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180b3bf0 con 0x7fa2280a4e50 2024-01-30T08:09:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22806dee0 con 0x7fa2280a4e50 2024-01-30T08:09:54.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22806c170 con 0x7fa2280a4e50 2024-01-30T08:09:54.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa224c00640 1 -- 172.21.15.50:0/1603047611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa2180b3d50 con 0x7fa2280a4e50 2024-01-30T08:09:54.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa224c00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa200066530 0x7fa2000689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.453+0000 7fa224c00640 1 -- 172.21.15.50:0/1603047611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa21811d5b0 con 0x7fa2280a4e50 2024-01-30T08:09:54.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.457+0000 7fa227e00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa200066530 0x7fa2000689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.457+0000 7fa227e00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa200066530 0x7fa2000689f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa228073860 tx=0x7fa210009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.457+0000 7fa224c00640 1 -- 172.21.15.50:0/1603047611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa2180ea7b0 con 0x7fa2280a4e50 2024-01-30T08:09:54.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.617+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa228074a20 con 0x7fa2280a4e50 2024-01-30T08:09:54.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa224c00640 1 -- 172.21.15.50:0/1603047611 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16788 (secure 0 0 0) 0x7fa2180eddd0 con 0x7fa2280a4e50 2024-01-30T08:09:54.622 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:54.622 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:53.316016+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa200066530 msgr2=0x7fa2000689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa200066530 0x7fa2000689f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa228073860 tx=0x7fa210009040 comp rx=0 tx=0).stop 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280a4e50 msgr2=0x7fa22814f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280a4e50 0x7fa22814f750 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa218024d30 tx=0x7fa21801b4c0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 shutdown_connections 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2280c4e00 0x7fa2281ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa200066530 0x7fa2000689f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa228158a00 0x7fa2281ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 --2- 172.21.15.50:0/1603047611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2280a4e50 0x7fa22814f750 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 >> 172.21.15.50:0/1603047611 conn(0x7fa2280c5b50 msgr2=0x7fa2281570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:54.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 shutdown_connections 2024-01-30T08:09:54.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.621+0000 7fa22fa00640 1 -- 172.21.15.50:0/1603047611 wait complete. 2024-01-30T08:09:54.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-30T08:09:54.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9e2800640 1 Processor -- start 2024-01-30T08:09:54.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9e2800640 1 -- start start 2024-01-30T08:09:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9e2800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa9dc0c3c50 0x7fa9dc0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9e2800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc06c4c0 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9e2800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0c0550 con 0x7fa9dc072b60 2024-01-30T08:09:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9e2800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c07c0 con 0x7fa9dc0c3c50 2024-01-30T08:09:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9daa00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa9dc06bfe0 0x7fa9dc0c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50426/0 (socket says 172.21.15.50:50426) 2024-01-30T08:09:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.785+0000 7fa9daa00640 1 -- 172.21.15.50:0/2111311422 learned_addr learned my addr 172.21.15.50:0/2111311422 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9dbe00640 1 --2- 172.21.15.50:0/2111311422 >> v2:172.21.15.125:3300/0 conn(0x7fa9dc0c3c50 0x7fa9dc0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9da000640 1 -- 172.21.15.50:0/2111311422 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839339068 0 0) 0x7fa9dc06c4c0 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9da000640 1 -- 172.21.15.50:0/2111311422 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9bc003530 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9da000640 1 -- 172.21.15.50:0/2111311422 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171121736 0 0) 0x7fa9dc0c0550 con 0x7fa9dc072b60 2024-01-30T08:09:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9da000640 1 -- 172.21.15.50:0/2111311422 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9dc06c4c0 con 0x7fa9dc072b60 2024-01-30T08:09:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9dbe00640 1 -- 172.21.15.50:0/2111311422 >> v1:172.21.15.125:6789/0 conn(0x7fa9dc072b60 legacy=0x7fa9dc0a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9dbe00640 1 -- 172.21.15.50:0/2111311422 >> v1:172.21.15.50:6789/0 conn(0x7fa9dc06bfe0 legacy=0x7fa9dc0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9dbe00640 1 -- 172.21.15.50:0/2111311422 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0c0aa0 con 0x7fa9dc0c3c50 2024-01-30T08:09:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9dbe00640 1 --2- 172.21.15.50:0/2111311422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 0x7fa9dc0c19b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009d90 tx=0x7fa9d401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3907e3d185dcccdb server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9da000640 1 -- 172.21.15.50:0/2111311422 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40a5870 con 0x7fa9dc0c3c50 2024-01-30T08:09:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9da000640 1 -- 172.21.15.50:0/2111311422 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d40a59d0 con 0x7fa9dc0c3c50 2024-01-30T08:09:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.789+0000 7fa9da000640 1 -- 172.21.15.50:0/2111311422 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40a5d60 con 0x7fa9dc0c3c50 2024-01-30T08:09:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- 172.21.15.50:0/2111311422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 msgr2=0x7fa9dc0c19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 --2- 172.21.15.50:0/2111311422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 0x7fa9dc0c19b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009d90 tx=0x7fa9d401c890 comp rx=0 tx=0).stop 2024-01-30T08:09:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- 172.21.15.50:0/2111311422 shutdown_connections 2024-01-30T08:09:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 --2- 172.21.15.50:0/2111311422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 0x7fa9dc0c19b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- 172.21.15.50:0/2111311422 >> 172.21.15.50:0/2111311422 conn(0x7fa9dc0c5b30 msgr2=0x7fa9dc0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- 172.21.15.50:0/2111311422 shutdown_connections 2024-01-30T08:09:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- 172.21.15.50:0/2111311422 wait complete. 2024-01-30T08:09:54.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 Processor -- start 2024-01-30T08:09:54.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- start start 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc06bfe0 0x7fa9dc14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9dc072b60 0x7fa9dc143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 0x7fa9dc140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0a4ca0 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc149f10 con 0x7fa9dc0c3c50 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9e2800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1eca10 con 0x7fa9dc072b60 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9db400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc06bfe0 0x7fa9dc14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9db400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc06bfe0 0x7fa9dc14ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44862/0 (socket says 172.21.15.50:44862) 2024-01-30T08:09:54.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.793+0000 7fa9db400640 1 -- 172.21.15.50:0/1494410803 learned_addr learned my addr 172.21.15.50:0/1494410803 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:54.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9dbe00640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 0x7fa9dc140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9daa00640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9dc072b60 0x7fa9dc143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9db400640 1 -- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9dc072b60 msgr2=0x7fa9dc143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9db400640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9dc072b60 0x7fa9dc143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9db400640 1 -- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 msgr2=0x7fa9dc140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9db400640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 0x7fa9dc140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9db400640 1 -- 172.21.15.50:0/1494410803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009a70 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9db400640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc06bfe0 0x7fa9dc14ae20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c4c0 tx=0x7fa9cc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9d3400640 1 -- 172.21.15.50:0/1494410803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0052d0 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9d3400640 1 -- 172.21.15.50:0/1494410803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc005430 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9d3400640 1 -- 172.21.15.50:0/1494410803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc012870 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc1eccf0 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc143bb0 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc1ece80 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.797+0000 7fa9d3400640 1 -- 172.21.15.50:0/1494410803 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa9cc0129d0 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.801+0000 7fa9d3400640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9b4066500 0x7fa9b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.801+0000 7fa9d3400640 1 -- 172.21.15.50:0/1494410803 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa9cc083a00 con 0x7fa9dc06bfe0 2024-01-30T08:09:54.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.801+0000 7fa9daa00640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9b4066500 0x7fa9b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:54.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.801+0000 7fa9daa00640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9b4066500 0x7fa9b40689c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc145010 tx=0x7fa9c4007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:54.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.801+0000 7fa9d3400640 1 -- 172.21.15.50:0/1494410803 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa9cc050ca0 con 0x7fa9dc06bfe0 2024-01-30T08:09:55.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:54.997+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa9dc074a20 con 0x7fa9dc06bfe0 2024-01-30T08:09:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.937+0000 7fa9d3400640 1 -- 172.21.15.50:0/1494410803 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa9cc0542c0 con 0x7fa9dc06bfe0 2024-01-30T08:09:55.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9b4066500 msgr2=0x7fa9b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:55.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9b4066500 0x7fa9b40689c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc145010 tx=0x7fa9c4007d40 comp rx=0 tx=0).stop 2024-01-30T08:09:55.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc06bfe0 msgr2=0x7fa9dc14ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:55.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc06bfe0 0x7fa9dc14ae20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c4c0 tx=0x7fa9cc00c980 comp rx=0 tx=0).stop 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 shutdown_connections 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9dc0c3c50 0x7fa9dc140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa9b4066500 0x7fa9b40689c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa9dc072b60 0x7fa9dc143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 --2- 172.21.15.50:0/1494410803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9dc06bfe0 0x7fa9dc14ae20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 >> 172.21.15.50:0/1494410803 conn(0x7fa9dc0c5b30 msgr2=0x7fa9dc06c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 shutdown_connections 2024-01-30T08:09:55.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:55.941+0000 7fa9e2800640 1 -- 172.21.15.50:0/1494410803 wait complete. 2024-01-30T08:09:55.968 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-30T08:09:55.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-30T08:09:56.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a6e00640 1 Processor -- start 2024-01-30T08:09:56.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a6e00640 1 -- start start 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a6e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0a006f240 0x7fd0a006f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a6e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a0158b70 con 0x7fd0a00c1200 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a6e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a00c8cf0 con 0x7fd0a0155500 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a6e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a0157f60 con 0x7fd0a006f240 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd09f400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0a006f240 0x7fd0a006f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a4e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd0a00c1200 0x7fd0a00c1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50428/0 (socket says 172.21.15.50:50428) 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd0a4e00640 1 -- 172.21.15.50:0/2382915385 learned_addr learned my addr 172.21.15.50:0/2382915385 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd09f400640 1 -- 172.21.15.50:0/2382915385 >> v1:172.21.15.125:6789/0 conn(0x7fd0a0155500 legacy=0x7fd0a00c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd09f400640 1 -- 172.21.15.50:0/2382915385 >> v1:172.21.15.50:6789/0 conn(0x7fd0a00c1200 legacy=0x7fd0a00c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd09ea00640 1 -- 172.21.15.50:0/2382915385 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882461869 0 0) 0x7fd0a0158b70 con 0x7fd0a00c1200 2024-01-30T08:09:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.117+0000 7fd09f400640 1 -- 172.21.15.50:0/2382915385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0158240 con 0x7fd0a006f240 2024-01-30T08:09:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd09f400640 1 --2- 172.21.15.50:0/2382915385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a006f240 0x7fd0a006f6d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0880097c0 tx=0x7fd08801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1968907a5a28cea0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd09ea00640 1 -- 172.21.15.50:0/2382915385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880ab600 con 0x7fd0a006f240 2024-01-30T08:09:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd09ea00640 1 -- 172.21.15.50:0/2382915385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0880a7050 con 0x7fd0a006f240 2024-01-30T08:09:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd09ea00640 1 -- 172.21.15.50:0/2382915385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880ab980 con 0x7fd0a006f240 2024-01-30T08:09:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2382915385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a006f240 msgr2=0x7fd0a006f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2382915385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a006f240 0x7fd0a006f6d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0880097c0 tx=0x7fd08801c330 comp rx=0 tx=0).stop 2024-01-30T08:09:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2382915385 shutdown_connections 2024-01-30T08:09:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2382915385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a006f240 0x7fd0a006f6d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.121+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2382915385 >> 172.21.15.50:0/2382915385 conn(0x7fd0a00727c0 msgr2=0x7fd0a006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2382915385 shutdown_connections 2024-01-30T08:09:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2382915385 wait complete. 2024-01-30T08:09:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 Processor -- start 2024-01-30T08:09:56.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 -- start start 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006f240 0x7fd0a015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a00c1200 0x7fd0a00c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a0155500 0x7fd0a01540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a015d760 con 0x7fd0a00c1200 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a015edf0 con 0x7fd0a006f240 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00a9f20 con 0x7fd0a0155500 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a00c1200 0x7fd0a00c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a00c1200 0x7fd0a00c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44878/0 (socket says 172.21.15.50:44878) 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 -- 172.21.15.50:0/2265818407 learned_addr learned my addr 172.21.15.50:0/2265818407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:56.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09fe00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006f240 0x7fd0a015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a4e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a0155500 0x7fd0a01540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 -- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a0155500 msgr2=0x7fd0a01540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a0155500 0x7fd0a01540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 -- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006f240 msgr2=0x7fd0a015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006f240 0x7fd0a015e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 -- 172.21.15.50:0/2265818407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009420 con 0x7fd0a00c1200 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd09f400640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a00c1200 0x7fd0a00c37b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd0880ae040 tx=0x7fd0880190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd097e00640 1 -- 172.21.15.50:0/2265818407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880b4610 con 0x7fd0a00c1200 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd097e00640 1 -- 172.21.15.50:0/2265818407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0880abe90 con 0x7fd0a00c1200 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd097e00640 1 -- 172.21.15.50:0/2265818407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880b49d0 con 0x7fd0a00c1200 2024-01-30T08:09:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.125+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a015d970 con 0x7fd0a00c1200 2024-01-30T08:09:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.129+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a015df30 con 0x7fd0a00c1200 2024-01-30T08:09:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.129+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a0067cc0 con 0x7fd0a00c1200 2024-01-30T08:09:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.129+0000 7fd097e00640 1 -- 172.21.15.50:0/2265818407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd0880b2040 con 0x7fd0a00c1200 2024-01-30T08:09:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.129+0000 7fd097e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd078066530 0x7fd0780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.129+0000 7fd097e00640 1 -- 172.21.15.50:0/2265818407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd08811dfe0 con 0x7fd0a00c1200 2024-01-30T08:09:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.129+0000 7fd09fe00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd078066530 0x7fd0780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.129+0000 7fd09fe00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd078066530 0x7fd0780689f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd090007fd0 tx=0x7fd090009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:56.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.133+0000 7fd097e00640 1 -- 172.21.15.50:0/2265818407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd0880eb240 con 0x7fd0a00c1200 2024-01-30T08:09:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.329+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd0a00c6280 con 0x7fd0a00c1200 2024-01-30T08:09:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.937+0000 7fd097e00640 1 -- 172.21.15.50:0/2265818407 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd0a00c6280 con 0x7fd0a00c1200 2024-01-30T08:09:56.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd078066530 msgr2=0x7fd0780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:56.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd078066530 0x7fd0780689f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd090007fd0 tx=0x7fd090009040 comp rx=0 tx=0).stop 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a00c1200 msgr2=0x7fd0a00c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a00c1200 0x7fd0a00c37b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd0880ae040 tx=0x7fd0880190d0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 shutdown_connections 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd078066530 0x7fd0780689f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0a0155500 0x7fd0a01540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0a00c1200 0x7fd0a00c37b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 --2- 172.21.15.50:0/2265818407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006f240 0x7fd0a015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 >> 172.21.15.50:0/2265818407 conn(0x7fd0a00727c0 msgr2=0x7fd0a006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 shutdown_connections 2024-01-30T08:09:56.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:56.941+0000 7fd0a6e00640 1 -- 172.21.15.50:0/2265818407 wait complete. 2024-01-30T08:09:56.968 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-30T08:09:56.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:09:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cdf200640 1 Processor -- start 2024-01-30T08:09:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cdf200640 1 -- start start 2024-01-30T08:09:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cdf200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80c4e00 0x7f5cd80729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cdf200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cd80a4e50 0x7f5cd80a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cdf200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd80c3e40 con 0x7f5cd80a9ad0 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cdf200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80c42d0 con 0x7f5cd80a4e50 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cdf200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80a8c20 con 0x7f5cd80c4e00 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.113+0000 7f5cd7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cd80a4e50 0x7f5cd80a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cdd200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5cd80a9ad0 0x7f5cd80c04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50432/0 (socket says 172.21.15.50:50432) 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cdd200640 1 -- 172.21.15.50:0/417113334 learned_addr learned my addr 172.21.15.50:0/417113334 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd7e00640 1 --2- 172.21.15.50:0/417113334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80c4e00 0x7f5cd80729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd7400640 1 -- 172.21.15.50:0/417113334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80c4e00 msgr2=0x7f5cd80729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd7400640 1 --2- 172.21.15.50:0/417113334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80c4e00 0x7f5cd80729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd7400640 1 -- 172.21.15.50:0/417113334 >> v1:172.21.15.50:6789/0 conn(0x7f5cd80a9ad0 legacy=0x7f5cd80c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd6a00640 1 -- 172.21.15.50:0/417113334 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732199072 0 0) 0x7f5cd80c3e40 con 0x7f5cd80a9ad0 2024-01-30T08:09:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd7400640 1 -- 172.21.15.50:0/417113334 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd80c3b10 con 0x7f5cd80a4e50 2024-01-30T08:09:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd7e00640 1 --2- 172.21.15.50:0/417113334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80c4e00 0x7f5cd80729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd7400640 1 --2- 172.21.15.50:0/417113334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80a4e50 0x7f5cd80a9590 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00097c0 tx=0x7f5cc001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3200f430713c1e1c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd6a00640 1 -- 172.21.15.50:0/417113334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00ab600 con 0x7f5cd80a4e50 2024-01-30T08:09:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd6a00640 1 -- 172.21.15.50:0/417113334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00a7050 con 0x7f5cd80a4e50 2024-01-30T08:09:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.117+0000 7f5cd6a00640 1 -- 172.21.15.50:0/417113334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00ab980 con 0x7f5cd80a4e50 2024-01-30T08:09:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- 172.21.15.50:0/417113334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80a4e50 msgr2=0x7f5cd80a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 --2- 172.21.15.50:0/417113334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80a4e50 0x7f5cd80a9590 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00097c0 tx=0x7f5cc001c450 comp rx=0 tx=0).stop 2024-01-30T08:09:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- 172.21.15.50:0/417113334 shutdown_connections 2024-01-30T08:09:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 --2- 172.21.15.50:0/417113334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80a4e50 0x7f5cd80a9590 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 --2- 172.21.15.50:0/417113334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80c4e00 0x7f5cd80729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- 172.21.15.50:0/417113334 >> 172.21.15.50:0/417113334 conn(0x7f5cd80c5b50 msgr2=0x7f5cd80c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- 172.21.15.50:0/417113334 shutdown_connections 2024-01-30T08:09:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- 172.21.15.50:0/417113334 wait complete. 2024-01-30T08:09:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 Processor -- start 2024-01-30T08:09:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- start start 2024-01-30T08:09:57.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5cd80a4e50 0x7f5cd814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80a9ad0 0x7f5cd81f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80c4e00 0x7f5cd80bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80bf910 con 0x7f5cd80c4e00 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd81f0e10 con 0x7f5cd80a4e50 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdf200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd815ea60 con 0x7f5cd80a9ad0 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdd200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80c4e00 0x7f5cd80bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdd200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80c4e00 0x7f5cd80bfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44896/0 (socket says 172.21.15.50:44896) 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cdd200640 1 -- 172.21.15.50:0/1278359605 learned_addr learned my addr 172.21.15.50:0/1278359605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cd7e00640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5cd80a4e50 0x7f5cd814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.121+0000 7f5cd7400640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80a9ad0 0x7f5cd81f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdd200640 1 -- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80a9ad0 msgr2=0x7f5cd81f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdd200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80a9ad0 0x7f5cd81f04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdd200640 1 -- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5cd80a4e50 msgr2=0x7f5cd814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdd200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5cd80a4e50 0x7f5cd814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdd200640 1 -- 172.21.15.50:0/1278359605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0009420 con 0x7f5cd80c4e00 2024-01-30T08:09:57.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdd200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80c4e00 0x7f5cd80bfda0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c7a0 tx=0x7f5cd000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5ccfe00640 1 -- 172.21.15.50:0/1278359605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000a640 con 0x7f5cd80c4e00 2024-01-30T08:09:57.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5ccfe00640 1 -- 172.21.15.50:0/1278359605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd000a7a0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5ccfe00640 1 -- 172.21.15.50:0/1278359605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000ab90 con 0x7f5cd80c4e00 2024-01-30T08:09:57.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd815ed40 con 0x7f5cd80c4e00 2024-01-30T08:09:57.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd81f10b0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd80bfac0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5ccfe00640 1 -- 172.21.15.50:0/1278359605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5cd000acf0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5ccfe00640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5cb0066500 0x7f5cb00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.125+0000 7f5ccfe00640 1 -- 172.21.15.50:0/1278359605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5cd00834b0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.129+0000 7f5cd7e00640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5cb0066500 0x7f5cb00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.129+0000 7f5cd7e00640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5cb0066500 0x7f5cb00689c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80045f0 tx=0x7f5cc8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.129+0000 7f5ccfe00640 1 -- 172.21.15.50:0/1278359605 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5cd80bfac0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.325+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cd80bfac0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.325+0000 7f5ccfe00640 1 -- 172.21.15.50:0/1278359605 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f5cd80bfac0 con 0x7f5cd80c4e00 2024-01-30T08:09:57.329 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:57.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5170,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:09:53.316367+0000","modified":"2024-01-30T08:09:56.334652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1837689837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1837689837},{"type":"v1","addr":"172.21.15.50:6835","nonce":1837689837}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-30T08:09:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5cb0066500 msgr2=0x7f5cb00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5cb0066500 0x7f5cb00689c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80045f0 tx=0x7f5cc8008040 comp rx=0 tx=0).stop 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80c4e00 msgr2=0x7f5cd80bfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80c4e00 0x7f5cd80bfda0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c7a0 tx=0x7f5cd000cc60 comp rx=0 tx=0).stop 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 shutdown_connections 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5cb0066500 0x7f5cb00689c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cd80c4e00 0x7f5cd80bfda0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5cd80a9ad0 0x7f5cd81f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 --2- 172.21.15.50:0/1278359605 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5cd80a4e50 0x7f5cd814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 >> 172.21.15.50:0/1278359605 conn(0x7f5cd80c5b50 msgr2=0x7f5cd80a5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 shutdown_connections 2024-01-30T08:09:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.329+0000 7f5cdf200640 1 -- 172.21.15.50:0/1278359605 wait complete. 2024-01-30T08:09:57.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:09:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.489+0000 7f83be000640 1 Processor -- start 2024-01-30T08:09:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.489+0000 7f83be000640 1 -- start start 2024-01-30T08:09:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83be000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83b806de40 0x7f83b80a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83be000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806e220 0x7f83b8157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83be000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80c7b40 con 0x7f83b81582d0 2024-01-30T08:09:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83be000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80a7770 con 0x7f83b806de40 2024-01-30T08:09:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83be000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8155310 con 0x7f83b806e220 2024-01-30T08:09:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83b806de40 0x7f83b80a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f83b81582d0 0x7f83b806f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50448/0 (socket says 172.21.15.50:50448) 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7e00640 1 -- 172.21.15.50:0/1755033839 learned_addr learned my addr 172.21.15.50:0/1755033839 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83b806de40 0x7f83b80a7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44900/0 (socket says 172.21.15.50:44900) 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b6a00640 1 --2- 172.21.15.50:0/1755033839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806e220 0x7f83b8157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7400640 1 -- 172.21.15.50:0/1755033839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806e220 msgr2=0x7f83b8157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7400640 1 --2- 172.21.15.50:0/1755033839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806e220 0x7f83b8157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7400640 1 -- 172.21.15.50:0/1755033839 >> v1:172.21.15.50:6789/0 conn(0x7f83b81582d0 legacy=0x7f83b806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7400640 1 -- 172.21.15.50:0/1755033839 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8155730 con 0x7f83b806de40 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b6000640 1 -- 172.21.15.50:0/1755033839 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271035846 0 0) 0x7f83b00014a0 con 0x7f83b81582d0 2024-01-30T08:09:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b6a00640 1 --2- 172.21.15.50:0/1755033839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806e220 0x7f83b8157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.493+0000 7f83b7400640 1 --2- 172.21.15.50:0/1755033839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b806de40 0x7f83b80a7120 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f83a80097c0 tx=0x7f83a801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f41e2912016ef5 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83b6000640 1 -- 172.21.15.50:0/1755033839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a80ab600 con 0x7f83b806de40 2024-01-30T08:09:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83b6000640 1 -- 172.21.15.50:0/1755033839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a80a7050 con 0x7f83b806de40 2024-01-30T08:09:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83b6000640 1 -- 172.21.15.50:0/1755033839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a80ab980 con 0x7f83b806de40 2024-01-30T08:09:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- 172.21.15.50:0/1755033839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b806de40 msgr2=0x7f83b80a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 --2- 172.21.15.50:0/1755033839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b806de40 0x7f83b80a7120 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f83a80097c0 tx=0x7f83a801c480 comp rx=0 tx=0).stop 2024-01-30T08:09:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- 172.21.15.50:0/1755033839 shutdown_connections 2024-01-30T08:09:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 --2- 172.21.15.50:0/1755033839 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806e220 0x7f83b8157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 --2- 172.21.15.50:0/1755033839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b806de40 0x7f83b80a7120 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- 172.21.15.50:0/1755033839 >> 172.21.15.50:0/1755033839 conn(0x7f83b80c4830 msgr2=0x7f83b80c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- 172.21.15.50:0/1755033839 shutdown_connections 2024-01-30T08:09:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- 172.21.15.50:0/1755033839 wait complete. 2024-01-30T08:09:57.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 Processor -- start 2024-01-30T08:09:57.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- start start 2024-01-30T08:09:57.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806de40 0x7f83b80c0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83b806e220 0x7f83b814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81582d0 0x7f83b80c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80bfc40 con 0x7f83b81582d0 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80c20b0 con 0x7f83b806e220 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83be000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80a8f90 con 0x7f83b806de40 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81582d0 0x7f83b80c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81582d0 0x7f83b80c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44910/0 (socket says 172.21.15.50:44910) 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.497+0000 7f83b7e00640 1 -- 172.21.15.50:0/100290147 learned_addr learned my addr 172.21.15.50:0/100290147 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b7400640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806de40 0x7f83b80c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b6a00640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83b806e220 0x7f83b814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b7e00640 1 -- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806de40 msgr2=0x7f83b80c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b7e00640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806de40 0x7f83b80c0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b7e00640 1 -- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83b806e220 msgr2=0x7f83b814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b7e00640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83b806e220 0x7f83b814f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b7e00640 1 -- 172.21.15.50:0/100290147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8009420 con 0x7f83b81582d0 2024-01-30T08:09:57.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b6a00640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83b806e220 0x7f83b814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:57.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83b7e00640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81582d0 0x7f83b80c1a40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c700 tx=0x7f83b000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83af400640 1 -- 172.21.15.50:0/100290147 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000ce10 con 0x7f83b81582d0 2024-01-30T08:09:57.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83af400640 1 -- 172.21.15.50:0/100290147 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000a640 con 0x7f83b81582d0 2024-01-30T08:09:57.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83af400640 1 -- 172.21.15.50:0/100290147 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000aa70 con 0x7f83b81582d0 2024-01-30T08:09:57.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b80a9270 con 0x7f83b81582d0 2024-01-30T08:09:57.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b814f980 con 0x7f83b81582d0 2024-01-30T08:09:57.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b8074a20 con 0x7f83b81582d0 2024-01-30T08:09:57.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83af400640 1 -- 172.21.15.50:0/100290147 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f83b000abd0 con 0x7f83b81582d0 2024-01-30T08:09:57.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.501+0000 7f83af400640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8390066500 0x7f83900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.505+0000 7f83af400640 1 -- 172.21.15.50:0/100290147 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f83b00834f0 con 0x7f83b81582d0 2024-01-30T08:09:57.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.505+0000 7f83b7400640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8390066500 0x7f83900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.505+0000 7f83b7400640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8390066500 0x7f83900689c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83a80ad000 tx=0x7f83a80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.505+0000 7f83af400640 1 -- 172.21.15.50:0/100290147 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f83b00506e0 con 0x7f83b81582d0 2024-01-30T08:09:57.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.665+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83b80c7b20 con 0x7f83b81582d0 2024-01-30T08:09:57.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83af400640 1 -- 172.21.15.50:0/100290147 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f83b0053d00 con 0x7f83b81582d0 2024-01-30T08:09:57.670 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:57.670 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:54.862108+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:09:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8390066500 msgr2=0x7f83900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8390066500 0x7f83900689c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83a80ad000 tx=0x7f83a80a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81582d0 msgr2=0x7f83b80c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81582d0 0x7f83b80c1a40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c700 tx=0x7f83b000cbc0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 shutdown_connections 2024-01-30T08:09:57.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83b806e220 0x7f83b814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8390066500 0x7f83900689c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81582d0 0x7f83b80c1a40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 --2- 172.21.15.50:0/100290147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83b806de40 0x7f83b80c0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 >> 172.21.15.50:0/100290147 conn(0x7f83b80c4830 msgr2=0x7f83b80c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:57.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 shutdown_connections 2024-01-30T08:09:57.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.669+0000 7f83be000640 1 -- 172.21.15.50:0/100290147 wait complete. 2024-01-30T08:09:57.692 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-30T08:09:57.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:57.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ee00640 1 Processor -- start 2024-01-30T08:09:57.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ee00640 1 -- start start 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ee00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80280c0080 0x7f802806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ee00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8028152230 0x7f80280c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ee00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802806c6e0 con 0x7f80280c63e0 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ee00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8028154b40 con 0x7f8028152230 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ee00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8028154e20 con 0x7f80280c0080 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ce00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8028152230 0x7f80280c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ce00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8028152230 0x7f80280c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44918/0 (socket says 172.21.15.50:44918) 2024-01-30T08:09:57.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ce00640 1 -- 172.21.15.50:0/2995922107 learned_addr learned my addr 172.21.15.50:0/2995922107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:57.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f8027e00640 1 --2- 172.21.15.50:0/2995922107 >> v2:172.21.15.125:3300/0 conn(0x7f80280c0080 0x7f802806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ce00640 1 -- 172.21.15.50:0/2995922107 >> v2:172.21.15.125:3300/0 conn(0x7f80280c0080 msgr2=0x7f802806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:57.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ce00640 1 --2- 172.21.15.50:0/2995922107 >> v2:172.21.15.125:3300/0 conn(0x7f80280c0080 0x7f802806c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ce00640 1 -- 172.21.15.50:0/2995922107 >> v1:172.21.15.125:6789/0 conn(0x7f80280c63e0 legacy=0x7f8028151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:57.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.833+0000 7f802ce00640 1 -- 172.21.15.50:0/2995922107 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8028155100 con 0x7f8028152230 2024-01-30T08:09:57.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ce00640 1 --2- 172.21.15.50:0/2995922107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8028152230 0x7f80280c0460 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f80280c7a40 tx=0x7f802001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85347d58dd52d942 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f8026a00640 1 -- 172.21.15.50:0/2995922107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80200a5870 con 0x7f8028152230 2024-01-30T08:09:57.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f8026a00640 1 -- 172.21.15.50:0/2995922107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80200a59d0 con 0x7f8028152230 2024-01-30T08:09:57.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f8026a00640 1 -- 172.21.15.50:0/2995922107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80200a5d60 con 0x7f8028152230 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 -- 172.21.15.50:0/2995922107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8028152230 msgr2=0x7f80280c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 --2- 172.21.15.50:0/2995922107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8028152230 0x7f80280c0460 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f80280c7a40 tx=0x7f802001c990 comp rx=0 tx=0).stop 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 -- 172.21.15.50:0/2995922107 shutdown_connections 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 --2- 172.21.15.50:0/2995922107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8028152230 0x7f80280c0460 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 --2- 172.21.15.50:0/2995922107 >> v2:172.21.15.125:3300/0 conn(0x7f80280c0080 0x7f802806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 -- 172.21.15.50:0/2995922107 >> 172.21.15.50:0/2995922107 conn(0x7f80280a9590 msgr2=0x7f80280c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 -- 172.21.15.50:0/2995922107 shutdown_connections 2024-01-30T08:09:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.837+0000 7f802ee00640 1 -- 172.21.15.50:0/2995922107 wait complete. 2024-01-30T08:09:57.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 Processor -- start 2024-01-30T08:09:57.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 -- start start 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80280c0080 0x7f80281edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80280c63e0 0x7f802814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8028152230 0x7f80281ee860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80281ed500 con 0x7f80280c0080 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8028149890 con 0x7f8028152230 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80281f1510 con 0x7f80280c63e0 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80280c0080 0x7f80281edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80280c0080 0x7f80281edfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44920/0 (socket says 172.21.15.50:44920) 2024-01-30T08:09:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 -- 172.21.15.50:0/901400185 learned_addr learned my addr 172.21.15.50:0/901400185 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:57.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ce00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8028152230 0x7f80281ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027400640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80280c63e0 0x7f802814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 -- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80280c63e0 msgr2=0x7f802814e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80280c63e0 0x7f802814e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 -- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8028152230 msgr2=0x7f80281ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8028152230 0x7f80281ee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 -- 172.21.15.50:0/901400185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020009b30 con 0x7f80280c0080 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ce00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8028152230 0x7f80281ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f8027e00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80280c0080 0x7f80281edfa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f801800d800 tx=0x7f801800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f801fe00640 1 -- 172.21.15.50:0/901400185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800b6c0 con 0x7f80280c0080 2024-01-30T08:09:57.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f801fe00640 1 -- 172.21.15.50:0/901400185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800b820 con 0x7f80280c0080 2024-01-30T08:09:57.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80281ed7a0 con 0x7f80280c0080 2024-01-30T08:09:57.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f801fe00640 1 -- 172.21.15.50:0/901400185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800bb90 con 0x7f80280c0080 2024-01-30T08:09:57.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.841+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80281f17f0 con 0x7f80280c0080 2024-01-30T08:09:57.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.845+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80280c7110 con 0x7f80280c0080 2024-01-30T08:09:57.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.845+0000 7f801fe00640 1 -- 172.21.15.50:0/901400185 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f801800bcf0 con 0x7f80280c0080 2024-01-30T08:09:57.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.845+0000 7f801fe00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8000066530 0x7f80000689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:57.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.845+0000 7f801fe00640 1 -- 172.21.15.50:0/901400185 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8018084340 con 0x7f80280c0080 2024-01-30T08:09:57.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.845+0000 7f8027400640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8000066530 0x7f80000689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:57.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.845+0000 7f8027400640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8000066530 0x7f80000689f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f802814fd10 tx=0x7f8010007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:57.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:57.849+0000 7f801fe00640 1 -- 172.21.15.50:0/901400185 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f80180515e0 con 0x7f80280c0080 2024-01-30T08:09:57.885 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-01-30T08:09:57.881+0000 7fc62a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-30T08:09:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.009+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8028074a20 con 0x7f8000066530 2024-01-30T08:09:58.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.017+0000 7f801fe00640 1 -- 172.21.15.50:0/901400185 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288088 (secure 0 0 0) 0x7f8028074a20 con 0x7f8000066530 2024-01-30T08:09:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:58.025 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:58.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8000066530 msgr2=0x7f80000689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8000066530 0x7f80000689f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f802814fd10 tx=0x7f8010007e40 comp rx=0 tx=0).stop 2024-01-30T08:09:58.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80280c0080 msgr2=0x7f80281edfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80280c0080 0x7f80281edfa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f801800d800 tx=0x7f801800dcc0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 shutdown_connections 2024-01-30T08:09:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8028152230 0x7f80281ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8000066530 0x7f80000689f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80280c63e0 0x7f802814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 --2- 172.21.15.50:0/901400185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80280c0080 0x7f80281edfa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 >> 172.21.15.50:0/901400185 conn(0x7f80280a9590 msgr2=0x7f80280c4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 shutdown_connections 2024-01-30T08:09:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.021+0000 7f802ee00640 1 -- 172.21.15.50:0/901400185 wait complete. 2024-01-30T08:09:58.043 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-01-30T08:09:57.068750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592666,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232192,"kb_used_data":3524,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742528,"statfs":{"total":773094113280,"available":772856348672,"internally_reserved":0,"allocated":3608576,"data_stored":2640694,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2298,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.162243"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866841+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:09:54.866841+0000","last_peered":"2024-01-30T08:09:54.866841+0000","last_clean":"2024-01-30T08:09:54.866841+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:09:54.866841+0000","last_undegraded":"2024-01-30T08:09:54.866841+0000","last_fullsized":"2024-01-30T08:09:54.866841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866478+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:09:54.866478+0000","last_peered":"2024-01-30T08:09:54.866478+0000","last_clean":"2024-01-30T08:09:54.866478+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:09:54.866478+0000","last_undegraded":"2024-01-30T08:09:54.866478+0000","last_fullsized":"2024-01-30T08:09:54.866478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922243+0000","last_change":"2024-01-30T08:09:52.922243+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922243+0000","last_undegraded":"2024-01-30T08:09:52.922243+0000","last_fullsized":"2024-01-30T08:09:52.922243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881407+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:09:53.881407+0000","last_peered":"2024-01-30T08:09:53.881407+0000","last_clean":"2024-01-30T08:09:53.881407+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:09:53.881407+0000","last_undegraded":"2024-01-30T08:09:53.881407+0000","last_fullsized":"2024-01-30T08:09:53.881407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:12.825632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875171+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:09:53.875171+0000","last_peered":"2024-01-30T08:09:53.875171+0000","last_clean":"2024-01-30T08:09:53.875171+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:09:53.875171+0000","last_undegraded":"2024-01-30T08:09:53.875171+0000","last_fullsized":"2024-01-30T08:09:53.875171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:14:32.567638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.895589+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:09:53.895589+0000","last_peered":"2024-01-30T08:09:53.895589+0000","last_clean":"2024-01-30T08:09:53.895589+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:09:53.895589+0000","last_undegraded":"2024-01-30T08:09:53.895589+0000","last_fullsized":"2024-01-30T08:09:53.895589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.924834+0000","last_change":"2024-01-30T08:09:52.924834+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.924834+0000","last_undegraded":"2024-01-30T08:09:52.924834+0000","last_fullsized":"2024-01-30T08:09:52.924834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866131+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:09:54.866131+0000","last_peered":"2024-01-30T08:09:54.866131+0000","last_clean":"2024-01-30T08:09:54.866131+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:09:54.866131+0000","last_undegraded":"2024-01-30T08:09:54.866131+0000","last_fullsized":"2024-01-30T08:09:54.866131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.923538+0000","last_change":"2024-01-30T08:09:52.923538+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.923538+0000","last_undegraded":"2024-01-30T08:09:52.923538+0000","last_fullsized":"2024-01-30T08:09:52.923538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.927557+0000","last_change":"2024-01-30T08:09:52.927557+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.927557+0000","last_undegraded":"2024-01-30T08:09:52.927557+0000","last_fullsized":"2024-01-30T08:09:52.927557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.925369+0000","last_change":"2024-01-30T08:09:52.925369+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.925369+0000","last_undegraded":"2024-01-30T08:09:52.925369+0000","last_fullsized":"2024-01-30T08:09:52.925369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.929744+0000","last_change":"2024-01-30T08:09:52.929744+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.929744+0000","last_undegraded":"2024-01-30T08:09:52.929744+0000","last_fullsized":"2024-01-30T08:09:52.929744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921737+0000","last_change":"2024-01-30T08:09:52.921737+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921737+0000","last_undegraded":"2024-01-30T08:09:52.921737+0000","last_fullsized":"2024-01-30T08:09:52.921737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866488+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:09:54.866488+0000","last_peered":"2024-01-30T08:09:54.866488+0000","last_clean":"2024-01-30T08:09:54.866488+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:09:54.866488+0000","last_undegraded":"2024-01-30T08:09:54.866488+0000","last_fullsized":"2024-01-30T08:09:54.866488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.924353+0000","last_change":"2024-01-30T08:09:52.924353+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.924353+0000","last_undegraded":"2024-01-30T08:09:52.924353+0000","last_fullsized":"2024-01-30T08:09:52.924353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891438+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:09:53.891438+0000","last_peered":"2024-01-30T08:09:53.891438+0000","last_clean":"2024-01-30T08:09:53.891438+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:09:53.891438+0000","last_undegraded":"2024-01-30T08:09:53.891438+0000","last_fullsized":"2024-01-30T08:09:53.891438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891891+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:09:53.891891+0000","last_peered":"2024-01-30T08:09:53.891891+0000","last_clean":"2024-01-30T08:09:53.891891+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:09:53.891891+0000","last_undegraded":"2024-01-30T08:09:53.891891+0000","last_fullsized":"2024-01-30T08:09:53.891891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867419+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:09:54.867419+0000","last_peered":"2024-01-30T08:09:54.867419+0000","last_clean":"2024-01-30T08:09:54.867419+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:09:54.867419+0000","last_undegraded":"2024-01-30T08:09:54.867419+0000","last_fullsized":"2024-01-30T08:09:54.867419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.886526+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:09:53.886526+0000","last_peered":"2024-01-30T08:09:53.886526+0000","last_clean":"2024-01-30T08:09:53.886526+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:09:53.886526+0000","last_undegraded":"2024-01-30T08:09:53.886526+0000","last_fullsized":"2024-01-30T08:09:53.886526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:42.377477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867251+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:09:54.867251+0000","last_peered":"2024-01-30T08:09:54.867251+0000","last_clean":"2024-01-30T08:09:54.867251+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:09:54.867251+0000","last_undegraded":"2024-01-30T08:09:54.867251+0000","last_fullsized":"2024-01-30T08:09:54.867251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921200+0000","last_change":"2024-01-30T08:09:52.921200+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921200+0000","last_undegraded":"2024-01-30T08:09:52.921200+0000","last_fullsized":"2024-01-30T08:09:52.921200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866793+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:09:54.866793+0000","last_peered":"2024-01-30T08:09:54.866793+0000","last_clean":"2024-01-30T08:09:54.866793+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:09:54.866793+0000","last_undegraded":"2024-01-30T08:09:54.866793+0000","last_fullsized":"2024-01-30T08:09:54.866793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892219+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:09:53.892219+0000","last_peered":"2024-01-30T08:09:53.892219+0000","last_clean":"2024-01-30T08:09:53.892219+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:09:53.892219+0000","last_undegraded":"2024-01-30T08:09:53.892219+0000","last_fullsized":"2024-01-30T08:09:53.892219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890815+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:09:53.890815+0000","last_peered":"2024-01-30T08:09:53.890815+0000","last_clean":"2024-01-30T08:09:53.890815+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:09:53.890815+0000","last_undegraded":"2024-01-30T08:09:53.890815+0000","last_fullsized":"2024-01-30T08:09:53.890815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:37.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867410+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:09:54.867410+0000","last_peered":"2024-01-30T08:09:54.867410+0000","last_clean":"2024-01-30T08:09:54.867410+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:09:54.867410+0000","last_undegraded":"2024-01-30T08:09:54.867410+0000","last_fullsized":"2024-01-30T08:09:54.867410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890622+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:09:53.890622+0000","last_peered":"2024-01-30T08:09:53.890622+0000","last_clean":"2024-01-30T08:09:53.890622+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:09:53.890622+0000","last_undegraded":"2024-01-30T08:09:53.890622+0000","last_fullsized":"2024-01-30T08:09:53.890622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867532+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:09:54.867532+0000","last_peered":"2024-01-30T08:09:54.867532+0000","last_clean":"2024-01-30T08:09:54.867532+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:09:54.867532+0000","last_undegraded":"2024-01-30T08:09:54.867532+0000","last_fullsized":"2024-01-30T08:09:54.867532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921825+0000","last_change":"2024-01-30T08:09:52.921825+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921825+0000","last_undegraded":"2024-01-30T08:09:52.921825+0000","last_fullsized":"2024-01-30T08:09:52.921825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867588+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:09:54.867588+0000","last_peered":"2024-01-30T08:09:54.867588+0000","last_clean":"2024-01-30T08:09:54.867588+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:09:54.867588+0000","last_undegraded":"2024-01-30T08:09:54.867588+0000","last_fullsized":"2024-01-30T08:09:54.867588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867228+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:09:54.867228+0000","last_peered":"2024-01-30T08:09:54.867228+0000","last_clean":"2024-01-30T08:09:54.867228+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:09:54.867228+0000","last_undegraded":"2024-01-30T08:09:54.867228+0000","last_fullsized":"2024-01-30T08:09:54.867228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891248+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:09:53.891248+0000","last_peered":"2024-01-30T08:09:53.891248+0000","last_clean":"2024-01-30T08:09:53.891248+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:09:53.891248+0000","last_undegraded":"2024-01-30T08:09:53.891248+0000","last_fullsized":"2024-01-30T08:09:53.891248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893973+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:09:53.893973+0000","last_peered":"2024-01-30T08:09:53.893973+0000","last_clean":"2024-01-30T08:09:53.893973+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:09:53.893973+0000","last_undegraded":"2024-01-30T08:09:53.893973+0000","last_fullsized":"2024-01-30T08:09:53.893973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891153+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:09:53.891153+0000","last_peered":"2024-01-30T08:09:53.891153+0000","last_clean":"2024-01-30T08:09:53.891153+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:09:53.891153+0000","last_undegraded":"2024-01-30T08:09:53.891153+0000","last_fullsized":"2024-01-30T08:09:53.891153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867365+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:09:54.867365+0000","last_peered":"2024-01-30T08:09:54.867365+0000","last_clean":"2024-01-30T08:09:54.867365+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:09:54.867365+0000","last_undegraded":"2024-01-30T08:09:54.867365+0000","last_fullsized":"2024-01-30T08:09:54.867365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889611+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:09:53.889611+0000","last_peered":"2024-01-30T08:09:53.889611+0000","last_clean":"2024-01-30T08:09:53.889611+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:09:53.889611+0000","last_undegraded":"2024-01-30T08:09:53.889611+0000","last_fullsized":"2024-01-30T08:09:53.889611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.938882+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:09:52.938882+0000","last_peered":"2024-01-30T08:09:52.938882+0000","last_clean":"2024-01-30T08:09:52.938882+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:09:52.938882+0000","last_undegraded":"2024-01-30T08:09:52.938882+0000","last_fullsized":"2024-01-30T08:09:52.938882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:26.642485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866710+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:09:54.866710+0000","last_peered":"2024-01-30T08:09:54.866710+0000","last_clean":"2024-01-30T08:09:54.866710+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:09:54.866710+0000","last_undegraded":"2024-01-30T08:09:54.866710+0000","last_fullsized":"2024-01-30T08:09:54.866710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940179+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:09:53.940179+0000","last_peered":"2024-01-30T08:09:53.940179+0000","last_clean":"2024-01-30T08:09:53.940179+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:09:53.940179+0000","last_undegraded":"2024-01-30T08:09:53.940179+0000","last_fullsized":"2024-01-30T08:09:53.940179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866856+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:09:54.866856+0000","last_peered":"2024-01-30T08:09:54.866856+0000","last_clean":"2024-01-30T08:09:54.866856+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:09:54.866856+0000","last_undegraded":"2024-01-30T08:09:54.866856+0000","last_fullsized":"2024-01-30T08:09:54.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866448+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:09:54.866448+0000","last_peered":"2024-01-30T08:09:54.866448+0000","last_clean":"2024-01-30T08:09:54.866448+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:09:54.866448+0000","last_undegraded":"2024-01-30T08:09:54.866448+0000","last_fullsized":"2024-01-30T08:09:54.866448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.920540+0000","last_change":"2024-01-30T08:09:52.920540+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.920540+0000","last_undegraded":"2024-01-30T08:09:52.920540+0000","last_fullsized":"2024-01-30T08:09:52.920540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943116+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:09:52.943116+0000","last_peered":"2024-01-30T08:09:52.943116+0000","last_clean":"2024-01-30T08:09:52.943116+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:09:52.943116+0000","last_undegraded":"2024-01-30T08:09:52.943116+0000","last_fullsized":"2024-01-30T08:09:52.943116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:08:17.770601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922054+0000","last_change":"2024-01-30T08:09:52.922054+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922054+0000","last_undegraded":"2024-01-30T08:09:52.922054+0000","last_fullsized":"2024-01-30T08:09:52.922054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.938191+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:09:53.938191+0000","last_peered":"2024-01-30T08:09:53.938191+0000","last_clean":"2024-01-30T08:09:53.938191+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:09:53.938191+0000","last_undegraded":"2024-01-30T08:09:53.938191+0000","last_fullsized":"2024-01-30T08:09:53.938191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866823+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:09:54.866823+0000","last_peered":"2024-01-30T08:09:54.866823+0000","last_clean":"2024-01-30T08:09:54.866823+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:09:54.866823+0000","last_undegraded":"2024-01-30T08:09:54.866823+0000","last_fullsized":"2024-01-30T08:09:54.866823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873889+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:09:53.873889+0000","last_peered":"2024-01-30T08:09:53.873889+0000","last_clean":"2024-01-30T08:09:53.873889+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:09:53.873889+0000","last_undegraded":"2024-01-30T08:09:53.873889+0000","last_fullsized":"2024-01-30T08:09:53.873889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866287+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:09:54.866287+0000","last_peered":"2024-01-30T08:09:54.866287+0000","last_clean":"2024-01-30T08:09:54.866287+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:09:54.866287+0000","last_undegraded":"2024-01-30T08:09:54.866287+0000","last_fullsized":"2024-01-30T08:09:54.866287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866091+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:09:54.866091+0000","last_peered":"2024-01-30T08:09:54.866091+0000","last_clean":"2024-01-30T08:09:54.866091+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:09:54.866091+0000","last_undegraded":"2024-01-30T08:09:54.866091+0000","last_fullsized":"2024-01-30T08:09:54.866091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881427+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:09:53.881427+0000","last_peered":"2024-01-30T08:09:53.881427+0000","last_clean":"2024-01-30T08:09:53.881427+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:09:53.881427+0000","last_undegraded":"2024-01-30T08:09:53.881427+0000","last_fullsized":"2024-01-30T08:09:53.881427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:17.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866901+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:09:54.866901+0000","last_peered":"2024-01-30T08:09:54.866901+0000","last_clean":"2024-01-30T08:09:54.866901+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:09:54.866901+0000","last_undegraded":"2024-01-30T08:09:54.866901+0000","last_fullsized":"2024-01-30T08:09:54.866901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888571+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:09:53.888571+0000","last_peered":"2024-01-30T08:09:53.888571+0000","last_clean":"2024-01-30T08:09:53.888571+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:09:53.888571+0000","last_undegraded":"2024-01-30T08:09:53.888571+0000","last_fullsized":"2024-01-30T08:09:53.888571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.936220+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:09:52.936220+0000","last_peered":"2024-01-30T08:09:52.936220+0000","last_clean":"2024-01-30T08:09:52.936220+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:09:52.936220+0000","last_undegraded":"2024-01-30T08:09:52.936220+0000","last_fullsized":"2024-01-30T08:09:52.936220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922039+0000","last_change":"2024-01-30T08:09:52.922039+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922039+0000","last_undegraded":"2024-01-30T08:09:52.922039+0000","last_fullsized":"2024-01-30T08:09:52.922039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943122+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:09:52.943122+0000","last_peered":"2024-01-30T08:09:52.943122+0000","last_clean":"2024-01-30T08:09:52.943122+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:09:52.943122+0000","last_undegraded":"2024-01-30T08:09:52.943122+0000","last_fullsized":"2024-01-30T08:09:52.943122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:02:30.703040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866544+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:09:54.866544+0000","last_peered":"2024-01-30T08:09:54.866544+0000","last_clean":"2024-01-30T08:09:54.866544+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:09:54.866544+0000","last_undegraded":"2024-01-30T08:09:54.866544+0000","last_fullsized":"2024-01-30T08:09:54.866544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866416+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:09:54.866416+0000","last_peered":"2024-01-30T08:09:54.866416+0000","last_clean":"2024-01-30T08:09:54.866416+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:09:54.866416+0000","last_undegraded":"2024-01-30T08:09:54.866416+0000","last_fullsized":"2024-01-30T08:09:54.866416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.920143+0000","last_change":"2024-01-30T08:09:52.920143+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.920143+0000","last_undegraded":"2024-01-30T08:09:52.920143+0000","last_fullsized":"2024-01-30T08:09:52.920143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866446+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:09:54.866446+0000","last_peered":"2024-01-30T08:09:54.866446+0000","last_clean":"2024-01-30T08:09:54.866446+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:09:54.866446+0000","last_undegraded":"2024-01-30T08:09:54.866446+0000","last_fullsized":"2024-01-30T08:09:54.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866128+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:09:54.866128+0000","last_peered":"2024-01-30T08:09:54.866128+0000","last_clean":"2024-01-30T08:09:54.866128+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:09:54.866128+0000","last_undegraded":"2024-01-30T08:09:54.866128+0000","last_fullsized":"2024-01-30T08:09:54.866128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875608+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:09:53.875608+0000","last_peered":"2024-01-30T08:09:53.875608+0000","last_clean":"2024-01-30T08:09:53.875608+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:09:53.875608+0000","last_undegraded":"2024-01-30T08:09:53.875608+0000","last_fullsized":"2024-01-30T08:09:53.875608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891268+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:09:53.891268+0000","last_peered":"2024-01-30T08:09:53.891268+0000","last_clean":"2024-01-30T08:09:53.891268+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:09:53.891268+0000","last_undegraded":"2024-01-30T08:09:53.891268+0000","last_fullsized":"2024-01-30T08:09:53.891268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866862+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:09:54.866862+0000","last_peered":"2024-01-30T08:09:54.866862+0000","last_clean":"2024-01-30T08:09:54.866862+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:09:54.866862+0000","last_undegraded":"2024-01-30T08:09:54.866862+0000","last_fullsized":"2024-01-30T08:09:54.866862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866330+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:09:54.866330+0000","last_peered":"2024-01-30T08:09:54.866330+0000","last_clean":"2024-01-30T08:09:54.866330+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:09:54.866330+0000","last_undegraded":"2024-01-30T08:09:54.866330+0000","last_fullsized":"2024-01-30T08:09:54.866330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.941256+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:09:53.941256+0000","last_peered":"2024-01-30T08:09:53.941256+0000","last_clean":"2024-01-30T08:09:53.941256+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:09:53.941256+0000","last_undegraded":"2024-01-30T08:09:53.941256+0000","last_fullsized":"2024-01-30T08:09:53.941256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866363+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:09:54.866363+0000","last_peered":"2024-01-30T08:09:54.866363+0000","last_clean":"2024-01-30T08:09:54.866363+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:09:54.866363+0000","last_undegraded":"2024-01-30T08:09:54.866363+0000","last_fullsized":"2024-01-30T08:09:54.866363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.942505+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:09:52.942505+0000","last_peered":"2024-01-30T08:09:52.942505+0000","last_clean":"2024-01-30T08:09:52.942505+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:09:52.942505+0000","last_undegraded":"2024-01-30T08:09:52.942505+0000","last_fullsized":"2024-01-30T08:09:52.942505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922110+0000","last_change":"2024-01-30T08:09:52.922110+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922110+0000","last_undegraded":"2024-01-30T08:09:52.922110+0000","last_fullsized":"2024-01-30T08:09:52.922110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866781+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:09:54.866781+0000","last_peered":"2024-01-30T08:09:54.866781+0000","last_clean":"2024-01-30T08:09:54.866781+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:09:54.866781+0000","last_undegraded":"2024-01-30T08:09:54.866781+0000","last_fullsized":"2024-01-30T08:09:54.866781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866674+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:09:54.866674+0000","last_peered":"2024-01-30T08:09:54.866674+0000","last_clean":"2024-01-30T08:09:54.866674+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:09:54.866674+0000","last_undegraded":"2024-01-30T08:09:54.866674+0000","last_fullsized":"2024-01-30T08:09:54.866674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940428+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:09:53.940428+0000","last_peered":"2024-01-30T08:09:53.940428+0000","last_clean":"2024-01-30T08:09:53.940428+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:09:53.940428+0000","last_undegraded":"2024-01-30T08:09:53.940428+0000","last_fullsized":"2024-01-30T08:09:53.940428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890710+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:09:53.890710+0000","last_peered":"2024-01-30T08:09:53.890710+0000","last_clean":"2024-01-30T08:09:53.890710+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:09:53.890710+0000","last_undegraded":"2024-01-30T08:09:53.890710+0000","last_fullsized":"2024-01-30T08:09:53.890710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:11:28.469716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873459+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:09:53.873459+0000","last_peered":"2024-01-30T08:09:53.873459+0000","last_clean":"2024-01-30T08:09:53.873459+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:09:53.873459+0000","last_undegraded":"2024-01-30T08:09:53.873459+0000","last_fullsized":"2024-01-30T08:09:53.873459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892220+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:09:53.892220+0000","last_peered":"2024-01-30T08:09:53.892220+0000","last_clean":"2024-01-30T08:09:53.892220+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:09:53.892220+0000","last_undegraded":"2024-01-30T08:09:53.892220+0000","last_fullsized":"2024-01-30T08:09:53.892220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.939996+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:09:53.939996+0000","last_peered":"2024-01-30T08:09:53.939996+0000","last_clean":"2024-01-30T08:09:53.939996+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:09:53.939996+0000","last_undegraded":"2024-01-30T08:09:53.939996+0000","last_fullsized":"2024-01-30T08:09:53.939996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.919218+0000","last_change":"2024-01-30T08:09:52.919218+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.919218+0000","last_undegraded":"2024-01-30T08:09:52.919218+0000","last_fullsized":"2024-01-30T08:09:52.919218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864882+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:09:53.864882+0000","last_peered":"2024-01-30T08:09:53.864882+0000","last_clean":"2024-01-30T08:09:53.864882+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:09:53.864882+0000","last_undegraded":"2024-01-30T08:09:53.864882+0000","last_fullsized":"2024-01-30T08:09:53.864882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921117+0000","last_change":"2024-01-30T08:09:52.921117+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921117+0000","last_undegraded":"2024-01-30T08:09:52.921117+0000","last_fullsized":"2024-01-30T08:09:52.921117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.871973+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:09:53.871973+0000","last_peered":"2024-01-30T08:09:53.871973+0000","last_clean":"2024-01-30T08:09:53.871973+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:09:53.871973+0000","last_undegraded":"2024-01-30T08:09:53.871973+0000","last_fullsized":"2024-01-30T08:09:53.871973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866449+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:09:54.866449+0000","last_peered":"2024-01-30T08:09:54.866449+0000","last_clean":"2024-01-30T08:09:54.866449+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:09:54.866449+0000","last_undegraded":"2024-01-30T08:09:54.866449+0000","last_fullsized":"2024-01-30T08:09:54.866449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864990+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:09:53.864990+0000","last_peered":"2024-01-30T08:09:53.864990+0000","last_clean":"2024-01-30T08:09:53.864990+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:09:53.864990+0000","last_undegraded":"2024-01-30T08:09:53.864990+0000","last_fullsized":"2024-01-30T08:09:53.864990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889661+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:09:53.889661+0000","last_peered":"2024-01-30T08:09:53.889661+0000","last_clean":"2024-01-30T08:09:53.889661+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:09:53.889661+0000","last_undegraded":"2024-01-30T08:09:53.889661+0000","last_fullsized":"2024-01-30T08:09:53.889661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943085+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:09:52.943085+0000","last_peered":"2024-01-30T08:09:52.943085+0000","last_clean":"2024-01-30T08:09:52.943085+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:09:52.943085+0000","last_undegraded":"2024-01-30T08:09:52.943085+0000","last_fullsized":"2024-01-30T08:09:52.943085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:12.097808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888593+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:09:53.888593+0000","last_peered":"2024-01-30T08:09:53.888593+0000","last_clean":"2024-01-30T08:09:53.888593+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:09:53.888593+0000","last_undegraded":"2024-01-30T08:09:53.888593+0000","last_fullsized":"2024-01-30T08:09:53.888593+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.865627+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:09:53.865627+0000","last_peered":"2024-01-30T08:09:53.865627+0000","last_clean":"2024-01-30T08:09:53.865627+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:09:53.865627+0000","last_undegraded":"2024-01-30T08:09:53.865627+0000","last_fullsized":"2024-01-30T08:09:53.865627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866673+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:09:54.866673+0000","last_peered":"2024-01-30T08:09:54.866673+0000","last_clean":"2024-01-30T08:09:54.866673+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:09:54.866673+0000","last_undegraded":"2024-01-30T08:09:54.866673+0000","last_fullsized":"2024-01-30T08:09:54.866673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.941163+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:09:52.941163+0000","last_peered":"2024-01-30T08:09:52.941163+0000","last_clean":"2024-01-30T08:09:52.941163+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:09:52.941163+0000","last_undegraded":"2024-01-30T08:09:52.941163+0000","last_fullsized":"2024-01-30T08:09:52.941163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:11:01.997982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.919766+0000","last_change":"2024-01-30T08:09:52.919766+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.919766+0000","last_undegraded":"2024-01-30T08:09:52.919766+0000","last_fullsized":"2024-01-30T08:09:52.919766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.941180+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:09:52.941180+0000","last_peered":"2024-01-30T08:09:52.941180+0000","last_clean":"2024-01-30T08:09:52.941180+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:09:52.941180+0000","last_undegraded":"2024-01-30T08:09:52.941180+0000","last_fullsized":"2024-01-30T08:09:52.941180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:03.860020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893904+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:09:53.893904+0000","last_peered":"2024-01-30T08:09:53.893904+0000","last_clean":"2024-01-30T08:09:53.893904+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:09:53.893904+0000","last_undegraded":"2024-01-30T08:09:53.893904+0000","last_fullsized":"2024-01-30T08:09:53.893904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867208+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:09:54.867208+0000","last_peered":"2024-01-30T08:09:54.867208+0000","last_clean":"2024-01-30T08:09:54.867208+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:09:54.867208+0000","last_undegraded":"2024-01-30T08:09:54.867208+0000","last_fullsized":"2024-01-30T08:09:54.867208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866671+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:09:54.866671+0000","last_peered":"2024-01-30T08:09:54.866671+0000","last_clean":"2024-01-30T08:09:54.866671+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:09:54.866671+0000","last_undegraded":"2024-01-30T08:09:54.866671+0000","last_fullsized":"2024-01-30T08:09:54.866671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866042+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:09:54.866042+0000","last_peered":"2024-01-30T08:09:54.866042+0000","last_clean":"2024-01-30T08:09:54.866042+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:09:54.866042+0000","last_undegraded":"2024-01-30T08:09:54.866042+0000","last_fullsized":"2024-01-30T08:09:54.866042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889868+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:09:53.889868+0000","last_peered":"2024-01-30T08:09:53.889868+0000","last_clean":"2024-01-30T08:09:53.889868+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:09:53.889868+0000","last_undegraded":"2024-01-30T08:09:53.889868+0000","last_fullsized":"2024-01-30T08:09:53.889868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866145+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:09:54.866145+0000","last_peered":"2024-01-30T08:09:54.866145+0000","last_clean":"2024-01-30T08:09:54.866145+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:09:54.866145+0000","last_undegraded":"2024-01-30T08:09:54.866145+0000","last_fullsized":"2024-01-30T08:09:54.866145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.925114+0000","last_change":"2024-01-30T08:09:52.925114+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.925114+0000","last_undegraded":"2024-01-30T08:09:52.925114+0000","last_fullsized":"2024-01-30T08:09:52.925114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874866+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:09:53.874866+0000","last_peered":"2024-01-30T08:09:53.874866+0000","last_clean":"2024-01-30T08:09:53.874866+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:09:53.874866+0000","last_undegraded":"2024-01-30T08:09:53.874866+0000","last_fullsized":"2024-01-30T08:09:53.874866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874458+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:09:53.874458+0000","last_peered":"2024-01-30T08:09:53.874458+0000","last_clean":"2024-01-30T08:09:53.874458+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:09:53.874458+0000","last_undegraded":"2024-01-30T08:09:53.874458+0000","last_fullsized":"2024-01-30T08:09:53.874458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2298,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":777383,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.874}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.442}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68400000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.46500000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.754},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":185937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60599999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":186979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.316},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.78200000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.76600000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80800000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39600000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.502}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.96899999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.871}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.016}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":171643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.629},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.51100000000000001}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":762011,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.748},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:09:58.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa68a600640 1 Processor -- start 2024-01-30T08:09:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa68a600640 1 -- start start 2024-01-30T08:09:58.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa68a600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa68406de40 0x7fa6840a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa68a600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa68406e220 0x7fa684157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa68a600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6840c7b40 con 0x7fa6841582d0 2024-01-30T08:09:58.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa68a600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840a7770 con 0x7fa68406de40 2024-01-30T08:09:58.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa68a600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa684155310 con 0x7fa68406e220 2024-01-30T08:09:58.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa682a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa68406e220 0x7fa684157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa682a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa68406e220 0x7fa684157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:44904/0 (socket says 172.21.15.50:44904) 2024-01-30T08:09:58.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa682a00640 1 -- 172.21.15.50:0/3999346607 learned_addr learned my addr 172.21.15.50:0/3999346607 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:58.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa683e00640 1 --1- 172.21.15.50:0/3999346607 >> v1:172.21.15.125:6789/0 conn(0x7fa6841582d0 0x7fa68406f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:50752/0 (socket says 172.21.15.50:50752) 2024-01-30T08:09:58.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa683400640 1 --2- 172.21.15.50:0/3999346607 >> v2:172.21.15.125:3300/0 conn(0x7fa68406de40 0x7fa6840a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa682a00640 1 -- 172.21.15.50:0/3999346607 >> v2:172.21.15.125:3300/0 conn(0x7fa68406de40 msgr2=0x7fa6840a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:58.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa682a00640 1 --2- 172.21.15.50:0/3999346607 >> v2:172.21.15.125:3300/0 conn(0x7fa68406de40 0x7fa6840a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa682a00640 1 -- 172.21.15.50:0/3999346607 >> v1:172.21.15.125:6789/0 conn(0x7fa6841582d0 legacy=0x7fa68406f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.225+0000 7fa682a00640 1 -- 172.21.15.50:0/3999346607 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684155730 con 0x7fa68406e220 2024-01-30T08:09:58.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa682a00640 1 --2- 172.21.15.50:0/3999346607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa68406e220 0x7fa684157d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a9b4543a5553532 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:58.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa682000640 1 -- 172.21.15.50:0/3999346607 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0ab600 con 0x7fa68406e220 2024-01-30T08:09:58.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa682000640 1 -- 172.21.15.50:0/3999346607 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0a7050 con 0x7fa68406e220 2024-01-30T08:09:58.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa682000640 1 -- 172.21.15.50:0/3999346607 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0ab980 con 0x7fa68406e220 2024-01-30T08:09:58.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa68a600640 1 -- 172.21.15.50:0/3999346607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa68406e220 msgr2=0x7fa684157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa68a600640 1 --2- 172.21.15.50:0/3999346607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa68406e220 0x7fa684157d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c01c540 comp rx=0 tx=0).stop 2024-01-30T08:09:58.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa68a600640 1 -- 172.21.15.50:0/3999346607 shutdown_connections 2024-01-30T08:09:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa68a600640 1 --2- 172.21.15.50:0/3999346607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa68406e220 0x7fa684157d90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa68a600640 1 --2- 172.21.15.50:0/3999346607 >> v2:172.21.15.125:3300/0 conn(0x7fa68406de40 0x7fa6840a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa68a600640 1 -- 172.21.15.50:0/3999346607 >> 172.21.15.50:0/3999346607 conn(0x7fa6840c4830 msgr2=0x7fa6840c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.229+0000 7fa68a600640 1 -- 172.21.15.50:0/3999346607 shutdown_connections 2024-01-30T08:09:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 -- 172.21.15.50:0/3999346607 wait complete. 2024-01-30T08:09:58.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 Processor -- start 2024-01-30T08:09:58.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 -- start start 2024-01-30T08:09:58.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa68406de40 0x7fa684156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa68406e220 0x7fa68414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6841582d0 0x7fa68414f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840a9980 con 0x7fa68406de40 2024-01-30T08:09:58.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68414fab0 con 0x7fa68406e220 2024-01-30T08:09:58.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840aa250 con 0x7fa6841582d0 2024-01-30T08:09:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa68406de40 0x7fa684156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa68406de40 0x7fa684156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44930/0 (socket says 172.21.15.50:44930) 2024-01-30T08:09:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 -- 172.21.15.50:0/1088785707 learned_addr learned my addr 172.21.15.50:0/1088785707 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683e00640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6841582d0 0x7fa68414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa682a00640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa68406e220 0x7fa68414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 -- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6841582d0 msgr2=0x7fa68414f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6841582d0 0x7fa68414f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 -- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa68406e220 msgr2=0x7fa68414f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa68406e220 0x7fa68414f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 -- 172.21.15.50:0/1088785707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0094d0 con 0x7fa68406de40 2024-01-30T08:09:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683e00640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6841582d0 0x7fa68414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa682a00640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa68406e220 0x7fa68414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa683400640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa68406de40 0x7fa684156d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa67400e930 tx=0x7fa67400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa67b400640 1 -- 172.21.15.50:0/1088785707 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674009690 con 0x7fa68406de40 2024-01-30T08:09:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa67b400640 1 -- 172.21.15.50:0/1088785707 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400ca00 con 0x7fa68406de40 2024-01-30T08:09:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa67b400640 1 -- 172.21.15.50:0/1088785707 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400cd70 con 0x7fa68406de40 2024-01-30T08:09:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6840a96a0 con 0x7fa68406de40 2024-01-30T08:09:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.233+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6841f16a0 con 0x7fa68406de40 2024-01-30T08:09:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.237+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6841f1220 con 0x7fa68406de40 2024-01-30T08:09:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.237+0000 7fa67b400640 1 -- 172.21.15.50:0/1088785707 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa674013470 con 0x7fa68406de40 2024-01-30T08:09:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.237+0000 7fa67b400640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa65c066550 0x7fa65c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.237+0000 7fa67b400640 1 -- 172.21.15.50:0/1088785707 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa6740842c0 con 0x7fa68406de40 2024-01-30T08:09:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.237+0000 7fa682a00640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa65c066550 0x7fa65c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.237+0000 7fa682a00640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa65c066550 0x7fa65c068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0ad000 tx=0x7fa66c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.241+0000 7fa67b400640 1 -- 172.21.15.50:0/1088785707 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa6841f1220 con 0x7fa68406de40 2024-01-30T08:09:58.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.397+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa684070ba0 con 0x7fa65c066550 2024-01-30T08:09:58.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.405+0000 7fa67b400640 1 -- 172.21.15.50:0/1088785707 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288088 (secure 0 0 0) 0x7fa684070ba0 con 0x7fa65c066550 2024-01-30T08:09:58.412 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:58.414 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa65c066550 msgr2=0x7fa65c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa65c066550 0x7fa65c068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0ad000 tx=0x7fa66c008040 comp rx=0 tx=0).stop 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa68406de40 msgr2=0x7fa684156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa68406de40 0x7fa684156d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa67400e930 tx=0x7fa67400edf0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 shutdown_connections 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa68406e220 0x7fa68414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa65c066550 0x7fa65c068a10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6841582d0 0x7fa68414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 --2- 172.21.15.50:0/1088785707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa68406de40 0x7fa684156d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.409+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 >> 172.21.15.50:0/1088785707 conn(0x7fa6840c4830 msgr2=0x7fa6840c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.413+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 shutdown_connections 2024-01-30T08:09:58.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.413+0000 7fa68a600640 1 -- 172.21.15.50:0/1088785707 wait complete. 2024-01-30T08:09:58.434 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-01-30T08:09:57.068750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592666,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232192,"kb_used_data":3524,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742528,"statfs":{"total":773094113280,"available":772856348672,"internally_reserved":0,"allocated":3608576,"data_stored":2640694,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2298,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.162243"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866841+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:09:54.866841+0000","last_peered":"2024-01-30T08:09:54.866841+0000","last_clean":"2024-01-30T08:09:54.866841+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:09:54.866841+0000","last_undegraded":"2024-01-30T08:09:54.866841+0000","last_fullsized":"2024-01-30T08:09:54.866841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866478+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:09:54.866478+0000","last_peered":"2024-01-30T08:09:54.866478+0000","last_clean":"2024-01-30T08:09:54.866478+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:09:54.866478+0000","last_undegraded":"2024-01-30T08:09:54.866478+0000","last_fullsized":"2024-01-30T08:09:54.866478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922243+0000","last_change":"2024-01-30T08:09:52.922243+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922243+0000","last_undegraded":"2024-01-30T08:09:52.922243+0000","last_fullsized":"2024-01-30T08:09:52.922243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881407+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:09:53.881407+0000","last_peered":"2024-01-30T08:09:53.881407+0000","last_clean":"2024-01-30T08:09:53.881407+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:09:53.881407+0000","last_undegraded":"2024-01-30T08:09:53.881407+0000","last_fullsized":"2024-01-30T08:09:53.881407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:12.825632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875171+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:09:53.875171+0000","last_peered":"2024-01-30T08:09:53.875171+0000","last_clean":"2024-01-30T08:09:53.875171+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:09:53.875171+0000","last_undegraded":"2024-01-30T08:09:53.875171+0000","last_fullsized":"2024-01-30T08:09:53.875171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:14:32.567638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.895589+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:09:53.895589+0000","last_peered":"2024-01-30T08:09:53.895589+0000","last_clean":"2024-01-30T08:09:53.895589+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:09:53.895589+0000","last_undegraded":"2024-01-30T08:09:53.895589+0000","last_fullsized":"2024-01-30T08:09:53.895589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.924834+0000","last_change":"2024-01-30T08:09:52.924834+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.924834+0000","last_undegraded":"2024-01-30T08:09:52.924834+0000","last_fullsized":"2024-01-30T08:09:52.924834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866131+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:09:54.866131+0000","last_peered":"2024-01-30T08:09:54.866131+0000","last_clean":"2024-01-30T08:09:54.866131+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:09:54.866131+0000","last_undegraded":"2024-01-30T08:09:54.866131+0000","last_fullsized":"2024-01-30T08:09:54.866131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.923538+0000","last_change":"2024-01-30T08:09:52.923538+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.923538+0000","last_undegraded":"2024-01-30T08:09:52.923538+0000","last_fullsized":"2024-01-30T08:09:52.923538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.927557+0000","last_change":"2024-01-30T08:09:52.927557+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.927557+0000","last_undegraded":"2024-01-30T08:09:52.927557+0000","last_fullsized":"2024-01-30T08:09:52.927557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.925369+0000","last_change":"2024-01-30T08:09:52.925369+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.925369+0000","last_undegraded":"2024-01-30T08:09:52.925369+0000","last_fullsized":"2024-01-30T08:09:52.925369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.929744+0000","last_change":"2024-01-30T08:09:52.929744+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.929744+0000","last_undegraded":"2024-01-30T08:09:52.929744+0000","last_fullsized":"2024-01-30T08:09:52.929744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921737+0000","last_change":"2024-01-30T08:09:52.921737+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921737+0000","last_undegraded":"2024-01-30T08:09:52.921737+0000","last_fullsized":"2024-01-30T08:09:52.921737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866488+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:09:54.866488+0000","last_peered":"2024-01-30T08:09:54.866488+0000","last_clean":"2024-01-30T08:09:54.866488+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:09:54.866488+0000","last_undegraded":"2024-01-30T08:09:54.866488+0000","last_fullsized":"2024-01-30T08:09:54.866488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.924353+0000","last_change":"2024-01-30T08:09:52.924353+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.924353+0000","last_undegraded":"2024-01-30T08:09:52.924353+0000","last_fullsized":"2024-01-30T08:09:52.924353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891438+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:09:53.891438+0000","last_peered":"2024-01-30T08:09:53.891438+0000","last_clean":"2024-01-30T08:09:53.891438+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:09:53.891438+0000","last_undegraded":"2024-01-30T08:09:53.891438+0000","last_fullsized":"2024-01-30T08:09:53.891438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891891+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:09:53.891891+0000","last_peered":"2024-01-30T08:09:53.891891+0000","last_clean":"2024-01-30T08:09:53.891891+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:09:53.891891+0000","last_undegraded":"2024-01-30T08:09:53.891891+0000","last_fullsized":"2024-01-30T08:09:53.891891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867419+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:09:54.867419+0000","last_peered":"2024-01-30T08:09:54.867419+0000","last_clean":"2024-01-30T08:09:54.867419+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:09:54.867419+0000","last_undegraded":"2024-01-30T08:09:54.867419+0000","last_fullsized":"2024-01-30T08:09:54.867419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.886526+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:09:53.886526+0000","last_peered":"2024-01-30T08:09:53.886526+0000","last_clean":"2024-01-30T08:09:53.886526+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:09:53.886526+0000","last_undegraded":"2024-01-30T08:09:53.886526+0000","last_fullsized":"2024-01-30T08:09:53.886526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:42.377477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867251+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:09:54.867251+0000","last_peered":"2024-01-30T08:09:54.867251+0000","last_clean":"2024-01-30T08:09:54.867251+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:09:54.867251+0000","last_undegraded":"2024-01-30T08:09:54.867251+0000","last_fullsized":"2024-01-30T08:09:54.867251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921200+0000","last_change":"2024-01-30T08:09:52.921200+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921200+0000","last_undegraded":"2024-01-30T08:09:52.921200+0000","last_fullsized":"2024-01-30T08:09:52.921200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866793+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:09:54.866793+0000","last_peered":"2024-01-30T08:09:54.866793+0000","last_clean":"2024-01-30T08:09:54.866793+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:09:54.866793+0000","last_undegraded":"2024-01-30T08:09:54.866793+0000","last_fullsized":"2024-01-30T08:09:54.866793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892219+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:09:53.892219+0000","last_peered":"2024-01-30T08:09:53.892219+0000","last_clean":"2024-01-30T08:09:53.892219+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:09:53.892219+0000","last_undegraded":"2024-01-30T08:09:53.892219+0000","last_fullsized":"2024-01-30T08:09:53.892219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890815+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:09:53.890815+0000","last_peered":"2024-01-30T08:09:53.890815+0000","last_clean":"2024-01-30T08:09:53.890815+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:09:53.890815+0000","last_undegraded":"2024-01-30T08:09:53.890815+0000","last_fullsized":"2024-01-30T08:09:53.890815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:37.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867410+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:09:54.867410+0000","last_peered":"2024-01-30T08:09:54.867410+0000","last_clean":"2024-01-30T08:09:54.867410+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:09:54.867410+0000","last_undegraded":"2024-01-30T08:09:54.867410+0000","last_fullsized":"2024-01-30T08:09:54.867410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890622+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:09:53.890622+0000","last_peered":"2024-01-30T08:09:53.890622+0000","last_clean":"2024-01-30T08:09:53.890622+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:09:53.890622+0000","last_undegraded":"2024-01-30T08:09:53.890622+0000","last_fullsized":"2024-01-30T08:09:53.890622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867532+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:09:54.867532+0000","last_peered":"2024-01-30T08:09:54.867532+0000","last_clean":"2024-01-30T08:09:54.867532+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:09:54.867532+0000","last_undegraded":"2024-01-30T08:09:54.867532+0000","last_fullsized":"2024-01-30T08:09:54.867532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921825+0000","last_change":"2024-01-30T08:09:52.921825+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921825+0000","last_undegraded":"2024-01-30T08:09:52.921825+0000","last_fullsized":"2024-01-30T08:09:52.921825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867588+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:09:54.867588+0000","last_peered":"2024-01-30T08:09:54.867588+0000","last_clean":"2024-01-30T08:09:54.867588+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:09:54.867588+0000","last_undegraded":"2024-01-30T08:09:54.867588+0000","last_fullsized":"2024-01-30T08:09:54.867588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867228+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:09:54.867228+0000","last_peered":"2024-01-30T08:09:54.867228+0000","last_clean":"2024-01-30T08:09:54.867228+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:09:54.867228+0000","last_undegraded":"2024-01-30T08:09:54.867228+0000","last_fullsized":"2024-01-30T08:09:54.867228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891248+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:09:53.891248+0000","last_peered":"2024-01-30T08:09:53.891248+0000","last_clean":"2024-01-30T08:09:53.891248+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:09:53.891248+0000","last_undegraded":"2024-01-30T08:09:53.891248+0000","last_fullsized":"2024-01-30T08:09:53.891248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893973+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:09:53.893973+0000","last_peered":"2024-01-30T08:09:53.893973+0000","last_clean":"2024-01-30T08:09:53.893973+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:09:53.893973+0000","last_undegraded":"2024-01-30T08:09:53.893973+0000","last_fullsized":"2024-01-30T08:09:53.893973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891153+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:09:53.891153+0000","last_peered":"2024-01-30T08:09:53.891153+0000","last_clean":"2024-01-30T08:09:53.891153+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:09:53.891153+0000","last_undegraded":"2024-01-30T08:09:53.891153+0000","last_fullsized":"2024-01-30T08:09:53.891153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867365+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:09:54.867365+0000","last_peered":"2024-01-30T08:09:54.867365+0000","last_clean":"2024-01-30T08:09:54.867365+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:09:54.867365+0000","last_undegraded":"2024-01-30T08:09:54.867365+0000","last_fullsized":"2024-01-30T08:09:54.867365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889611+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:09:53.889611+0000","last_peered":"2024-01-30T08:09:53.889611+0000","last_clean":"2024-01-30T08:09:53.889611+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:09:53.889611+0000","last_undegraded":"2024-01-30T08:09:53.889611+0000","last_fullsized":"2024-01-30T08:09:53.889611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.938882+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:09:52.938882+0000","last_peered":"2024-01-30T08:09:52.938882+0000","last_clean":"2024-01-30T08:09:52.938882+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:09:52.938882+0000","last_undegraded":"2024-01-30T08:09:52.938882+0000","last_fullsized":"2024-01-30T08:09:52.938882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:26.642485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866710+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:09:54.866710+0000","last_peered":"2024-01-30T08:09:54.866710+0000","last_clean":"2024-01-30T08:09:54.866710+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:09:54.866710+0000","last_undegraded":"2024-01-30T08:09:54.866710+0000","last_fullsized":"2024-01-30T08:09:54.866710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940179+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:09:53.940179+0000","last_peered":"2024-01-30T08:09:53.940179+0000","last_clean":"2024-01-30T08:09:53.940179+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:09:53.940179+0000","last_undegraded":"2024-01-30T08:09:53.940179+0000","last_fullsized":"2024-01-30T08:09:53.940179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866856+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:09:54.866856+0000","last_peered":"2024-01-30T08:09:54.866856+0000","last_clean":"2024-01-30T08:09:54.866856+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:09:54.866856+0000","last_undegraded":"2024-01-30T08:09:54.866856+0000","last_fullsized":"2024-01-30T08:09:54.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866448+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:09:54.866448+0000","last_peered":"2024-01-30T08:09:54.866448+0000","last_clean":"2024-01-30T08:09:54.866448+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:09:54.866448+0000","last_undegraded":"2024-01-30T08:09:54.866448+0000","last_fullsized":"2024-01-30T08:09:54.866448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.920540+0000","last_change":"2024-01-30T08:09:52.920540+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.920540+0000","last_undegraded":"2024-01-30T08:09:52.920540+0000","last_fullsized":"2024-01-30T08:09:52.920540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943116+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:09:52.943116+0000","last_peered":"2024-01-30T08:09:52.943116+0000","last_clean":"2024-01-30T08:09:52.943116+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:09:52.943116+0000","last_undegraded":"2024-01-30T08:09:52.943116+0000","last_fullsized":"2024-01-30T08:09:52.943116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:08:17.770601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922054+0000","last_change":"2024-01-30T08:09:52.922054+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922054+0000","last_undegraded":"2024-01-30T08:09:52.922054+0000","last_fullsized":"2024-01-30T08:09:52.922054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.938191+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:09:53.938191+0000","last_peered":"2024-01-30T08:09:53.938191+0000","last_clean":"2024-01-30T08:09:53.938191+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:09:53.938191+0000","last_undegraded":"2024-01-30T08:09:53.938191+0000","last_fullsized":"2024-01-30T08:09:53.938191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866823+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:09:54.866823+0000","last_peered":"2024-01-30T08:09:54.866823+0000","last_clean":"2024-01-30T08:09:54.866823+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:09:54.866823+0000","last_undegraded":"2024-01-30T08:09:54.866823+0000","last_fullsized":"2024-01-30T08:09:54.866823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873889+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:09:53.873889+0000","last_peered":"2024-01-30T08:09:53.873889+0000","last_clean":"2024-01-30T08:09:53.873889+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:09:53.873889+0000","last_undegraded":"2024-01-30T08:09:53.873889+0000","last_fullsized":"2024-01-30T08:09:53.873889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866287+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:09:54.866287+0000","last_peered":"2024-01-30T08:09:54.866287+0000","last_clean":"2024-01-30T08:09:54.866287+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:09:54.866287+0000","last_undegraded":"2024-01-30T08:09:54.866287+0000","last_fullsized":"2024-01-30T08:09:54.866287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866091+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:09:54.866091+0000","last_peered":"2024-01-30T08:09:54.866091+0000","last_clean":"2024-01-30T08:09:54.866091+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:09:54.866091+0000","last_undegraded":"2024-01-30T08:09:54.866091+0000","last_fullsized":"2024-01-30T08:09:54.866091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881427+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:09:53.881427+0000","last_peered":"2024-01-30T08:09:53.881427+0000","last_clean":"2024-01-30T08:09:53.881427+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:09:53.881427+0000","last_undegraded":"2024-01-30T08:09:53.881427+0000","last_fullsized":"2024-01-30T08:09:53.881427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:17.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866901+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:09:54.866901+0000","last_peered":"2024-01-30T08:09:54.866901+0000","last_clean":"2024-01-30T08:09:54.866901+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:09:54.866901+0000","last_undegraded":"2024-01-30T08:09:54.866901+0000","last_fullsized":"2024-01-30T08:09:54.866901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888571+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:09:53.888571+0000","last_peered":"2024-01-30T08:09:53.888571+0000","last_clean":"2024-01-30T08:09:53.888571+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:09:53.888571+0000","last_undegraded":"2024-01-30T08:09:53.888571+0000","last_fullsized":"2024-01-30T08:09:53.888571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.936220+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:09:52.936220+0000","last_peered":"2024-01-30T08:09:52.936220+0000","last_clean":"2024-01-30T08:09:52.936220+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:09:52.936220+0000","last_undegraded":"2024-01-30T08:09:52.936220+0000","last_fullsized":"2024-01-30T08:09:52.936220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922039+0000","last_change":"2024-01-30T08:09:52.922039+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922039+0000","last_undegraded":"2024-01-30T08:09:52.922039+0000","last_fullsized":"2024-01-30T08:09:52.922039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943122+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:09:52.943122+0000","last_peered":"2024-01-30T08:09:52.943122+0000","last_clean":"2024-01-30T08:09:52.943122+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:09:52.943122+0000","last_undegraded":"2024-01-30T08:09:52.943122+0000","last_fullsized":"2024-01-30T08:09:52.943122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:02:30.703040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866544+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:09:54.866544+0000","last_peered":"2024-01-30T08:09:54.866544+0000","last_clean":"2024-01-30T08:09:54.866544+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:09:54.866544+0000","last_undegraded":"2024-01-30T08:09:54.866544+0000","last_fullsized":"2024-01-30T08:09:54.866544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866416+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:09:54.866416+0000","last_peered":"2024-01-30T08:09:54.866416+0000","last_clean":"2024-01-30T08:09:54.866416+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:09:54.866416+0000","last_undegraded":"2024-01-30T08:09:54.866416+0000","last_fullsized":"2024-01-30T08:09:54.866416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.920143+0000","last_change":"2024-01-30T08:09:52.920143+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.920143+0000","last_undegraded":"2024-01-30T08:09:52.920143+0000","last_fullsized":"2024-01-30T08:09:52.920143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866446+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:09:54.866446+0000","last_peered":"2024-01-30T08:09:54.866446+0000","last_clean":"2024-01-30T08:09:54.866446+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:09:54.866446+0000","last_undegraded":"2024-01-30T08:09:54.866446+0000","last_fullsized":"2024-01-30T08:09:54.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866128+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:09:54.866128+0000","last_peered":"2024-01-30T08:09:54.866128+0000","last_clean":"2024-01-30T08:09:54.866128+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:09:54.866128+0000","last_undegraded":"2024-01-30T08:09:54.866128+0000","last_fullsized":"2024-01-30T08:09:54.866128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875608+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:09:53.875608+0000","last_peered":"2024-01-30T08:09:53.875608+0000","last_clean":"2024-01-30T08:09:53.875608+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:09:53.875608+0000","last_undegraded":"2024-01-30T08:09:53.875608+0000","last_fullsized":"2024-01-30T08:09:53.875608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891268+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:09:53.891268+0000","last_peered":"2024-01-30T08:09:53.891268+0000","last_clean":"2024-01-30T08:09:53.891268+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:09:53.891268+0000","last_undegraded":"2024-01-30T08:09:53.891268+0000","last_fullsized":"2024-01-30T08:09:53.891268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866862+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:09:54.866862+0000","last_peered":"2024-01-30T08:09:54.866862+0000","last_clean":"2024-01-30T08:09:54.866862+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:09:54.866862+0000","last_undegraded":"2024-01-30T08:09:54.866862+0000","last_fullsized":"2024-01-30T08:09:54.866862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866330+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:09:54.866330+0000","last_peered":"2024-01-30T08:09:54.866330+0000","last_clean":"2024-01-30T08:09:54.866330+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:09:54.866330+0000","last_undegraded":"2024-01-30T08:09:54.866330+0000","last_fullsized":"2024-01-30T08:09:54.866330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.941256+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:09:53.941256+0000","last_peered":"2024-01-30T08:09:53.941256+0000","last_clean":"2024-01-30T08:09:53.941256+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:09:53.941256+0000","last_undegraded":"2024-01-30T08:09:53.941256+0000","last_fullsized":"2024-01-30T08:09:53.941256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866363+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:09:54.866363+0000","last_peered":"2024-01-30T08:09:54.866363+0000","last_clean":"2024-01-30T08:09:54.866363+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:09:54.866363+0000","last_undegraded":"2024-01-30T08:09:54.866363+0000","last_fullsized":"2024-01-30T08:09:54.866363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.942505+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:09:52.942505+0000","last_peered":"2024-01-30T08:09:52.942505+0000","last_clean":"2024-01-30T08:09:52.942505+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:09:52.942505+0000","last_undegraded":"2024-01-30T08:09:52.942505+0000","last_fullsized":"2024-01-30T08:09:52.942505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922110+0000","last_change":"2024-01-30T08:09:52.922110+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922110+0000","last_undegraded":"2024-01-30T08:09:52.922110+0000","last_fullsized":"2024-01-30T08:09:52.922110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866781+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:09:54.866781+0000","last_peered":"2024-01-30T08:09:54.866781+0000","last_clean":"2024-01-30T08:09:54.866781+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:09:54.866781+0000","last_undegraded":"2024-01-30T08:09:54.866781+0000","last_fullsized":"2024-01-30T08:09:54.866781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866674+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:09:54.866674+0000","last_peered":"2024-01-30T08:09:54.866674+0000","last_clean":"2024-01-30T08:09:54.866674+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:09:54.866674+0000","last_undegraded":"2024-01-30T08:09:54.866674+0000","last_fullsized":"2024-01-30T08:09:54.866674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940428+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:09:53.940428+0000","last_peered":"2024-01-30T08:09:53.940428+0000","last_clean":"2024-01-30T08:09:53.940428+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:09:53.940428+0000","last_undegraded":"2024-01-30T08:09:53.940428+0000","last_fullsized":"2024-01-30T08:09:53.940428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890710+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:09:53.890710+0000","last_peered":"2024-01-30T08:09:53.890710+0000","last_clean":"2024-01-30T08:09:53.890710+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:09:53.890710+0000","last_undegraded":"2024-01-30T08:09:53.890710+0000","last_fullsized":"2024-01-30T08:09:53.890710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:11:28.469716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873459+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:09:53.873459+0000","last_peered":"2024-01-30T08:09:53.873459+0000","last_clean":"2024-01-30T08:09:53.873459+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:09:53.873459+0000","last_undegraded":"2024-01-30T08:09:53.873459+0000","last_fullsized":"2024-01-30T08:09:53.873459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892220+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:09:53.892220+0000","last_peered":"2024-01-30T08:09:53.892220+0000","last_clean":"2024-01-30T08:09:53.892220+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:09:53.892220+0000","last_undegraded":"2024-01-30T08:09:53.892220+0000","last_fullsized":"2024-01-30T08:09:53.892220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.939996+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:09:53.939996+0000","last_peered":"2024-01-30T08:09:53.939996+0000","last_clean":"2024-01-30T08:09:53.939996+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:09:53.939996+0000","last_undegraded":"2024-01-30T08:09:53.939996+0000","last_fullsized":"2024-01-30T08:09:53.939996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.919218+0000","last_change":"2024-01-30T08:09:52.919218+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.919218+0000","last_undegraded":"2024-01-30T08:09:52.919218+0000","last_fullsized":"2024-01-30T08:09:52.919218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864882+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:09:53.864882+0000","last_peered":"2024-01-30T08:09:53.864882+0000","last_clean":"2024-01-30T08:09:53.864882+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:09:53.864882+0000","last_undegraded":"2024-01-30T08:09:53.864882+0000","last_fullsized":"2024-01-30T08:09:53.864882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921117+0000","last_change":"2024-01-30T08:09:52.921117+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921117+0000","last_undegraded":"2024-01-30T08:09:52.921117+0000","last_fullsized":"2024-01-30T08:09:52.921117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.871973+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:09:53.871973+0000","last_peered":"2024-01-30T08:09:53.871973+0000","last_clean":"2024-01-30T08:09:53.871973+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:09:53.871973+0000","last_undegraded":"2024-01-30T08:09:53.871973+0000","last_fullsized":"2024-01-30T08:09:53.871973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866449+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:09:54.866449+0000","last_peered":"2024-01-30T08:09:54.866449+0000","last_clean":"2024-01-30T08:09:54.866449+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:09:54.866449+0000","last_undegraded":"2024-01-30T08:09:54.866449+0000","last_fullsized":"2024-01-30T08:09:54.866449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864990+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:09:53.864990+0000","last_peered":"2024-01-30T08:09:53.864990+0000","last_clean":"2024-01-30T08:09:53.864990+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:09:53.864990+0000","last_undegraded":"2024-01-30T08:09:53.864990+0000","last_fullsized":"2024-01-30T08:09:53.864990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889661+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:09:53.889661+0000","last_peered":"2024-01-30T08:09:53.889661+0000","last_clean":"2024-01-30T08:09:53.889661+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:09:53.889661+0000","last_undegraded":"2024-01-30T08:09:53.889661+0000","last_fullsized":"2024-01-30T08:09:53.889661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943085+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:09:52.943085+0000","last_peered":"2024-01-30T08:09:52.943085+0000","last_clean":"2024-01-30T08:09:52.943085+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:09:52.943085+0000","last_undegraded":"2024-01-30T08:09:52.943085+0000","last_fullsized":"2024-01-30T08:09:52.943085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:12.097808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888593+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:09:53.888593+0000","last_peered":"2024-01-30T08:09:53.888593+0000","last_clean":"2024-01-30T08:09:53.888593+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:09:53.888593+0000","last_undegraded":"2024-01-30T08:09:53.888593+0000","last_fullsized":"2024-01-30T08:09:53.888593+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.865627+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:09:53.865627+0000","last_peered":"2024-01-30T08:09:53.865627+0000","last_clean":"2024-01-30T08:09:53.865627+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:09:53.865627+0000","last_undegraded":"2024-01-30T08:09:53.865627+0000","last_fullsized":"2024-01-30T08:09:53.865627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866673+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:09:54.866673+0000","last_peered":"2024-01-30T08:09:54.866673+0000","last_clean":"2024-01-30T08:09:54.866673+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:09:54.866673+0000","last_undegraded":"2024-01-30T08:09:54.866673+0000","last_fullsized":"2024-01-30T08:09:54.866673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.941163+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:09:52.941163+0000","last_peered":"2024-01-30T08:09:52.941163+0000","last_clean":"2024-01-30T08:09:52.941163+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:09:52.941163+0000","last_undegraded":"2024-01-30T08:09:52.941163+0000","last_fullsized":"2024-01-30T08:09:52.941163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:11:01.997982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.919766+0000","last_change":"2024-01-30T08:09:52.919766+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.919766+0000","last_undegraded":"2024-01-30T08:09:52.919766+0000","last_fullsized":"2024-01-30T08:09:52.919766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.941180+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:09:52.941180+0000","last_peered":"2024-01-30T08:09:52.941180+0000","last_clean":"2024-01-30T08:09:52.941180+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:09:52.941180+0000","last_undegraded":"2024-01-30T08:09:52.941180+0000","last_fullsized":"2024-01-30T08:09:52.941180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:03.860020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893904+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:09:53.893904+0000","last_peered":"2024-01-30T08:09:53.893904+0000","last_clean":"2024-01-30T08:09:53.893904+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:09:53.893904+0000","last_undegraded":"2024-01-30T08:09:53.893904+0000","last_fullsized":"2024-01-30T08:09:53.893904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867208+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:09:54.867208+0000","last_peered":"2024-01-30T08:09:54.867208+0000","last_clean":"2024-01-30T08:09:54.867208+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:09:54.867208+0000","last_undegraded":"2024-01-30T08:09:54.867208+0000","last_fullsized":"2024-01-30T08:09:54.867208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866671+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:09:54.866671+0000","last_peered":"2024-01-30T08:09:54.866671+0000","last_clean":"2024-01-30T08:09:54.866671+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:09:54.866671+0000","last_undegraded":"2024-01-30T08:09:54.866671+0000","last_fullsized":"2024-01-30T08:09:54.866671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866042+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:09:54.866042+0000","last_peered":"2024-01-30T08:09:54.866042+0000","last_clean":"2024-01-30T08:09:54.866042+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:09:54.866042+0000","last_undegraded":"2024-01-30T08:09:54.866042+0000","last_fullsized":"2024-01-30T08:09:54.866042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889868+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:09:53.889868+0000","last_peered":"2024-01-30T08:09:53.889868+0000","last_clean":"2024-01-30T08:09:53.889868+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:09:53.889868+0000","last_undegraded":"2024-01-30T08:09:53.889868+0000","last_fullsized":"2024-01-30T08:09:53.889868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866145+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:09:54.866145+0000","last_peered":"2024-01-30T08:09:54.866145+0000","last_clean":"2024-01-30T08:09:54.866145+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:09:54.866145+0000","last_undegraded":"2024-01-30T08:09:54.866145+0000","last_fullsized":"2024-01-30T08:09:54.866145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.925114+0000","last_change":"2024-01-30T08:09:52.925114+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.925114+0000","last_undegraded":"2024-01-30T08:09:52.925114+0000","last_fullsized":"2024-01-30T08:09:52.925114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874866+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:09:53.874866+0000","last_peered":"2024-01-30T08:09:53.874866+0000","last_clean":"2024-01-30T08:09:53.874866+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:09:53.874866+0000","last_undegraded":"2024-01-30T08:09:53.874866+0000","last_fullsized":"2024-01-30T08:09:53.874866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874458+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:09:53.874458+0000","last_peered":"2024-01-30T08:09:53.874458+0000","last_clean":"2024-01-30T08:09:53.874458+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:09:53.874458+0000","last_undegraded":"2024-01-30T08:09:53.874458+0000","last_fullsized":"2024-01-30T08:09:53.874458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2298,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":777383,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.874}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.442}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68400000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.46500000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.754},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":185937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60599999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":186979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.316},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.78200000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.76600000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80800000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39600000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.502}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.96899999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.871}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.016}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":171643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.629},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.51100000000000001}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":762011,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.748},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:09:58.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:58.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.617+0000 7fad09800640 1 Processor -- start 2024-01-30T08:09:58.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.617+0000 7fad09800640 1 -- start start 2024-01-30T08:09:58.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad09800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad041584a0 0x7fad0406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad09800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040c7b40 con 0x7fad040a7120 2024-01-30T08:09:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad09800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad04155730 con 0x7fad0406de40 2024-01-30T08:09:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad09800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040a7770 con 0x7fad041584a0 2024-01-30T08:09:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad02000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fad040a7120 0x7fad0415d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50450/0 (socket says 172.21.15.50:50450) 2024-01-30T08:09:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad02000640 1 -- 172.21.15.50:0/2673521995 learned_addr learned my addr 172.21.15.50:0/2673521995 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad03400640 1 --2- 172.21.15.50:0/2673521995 >> v2:172.21.15.125:3300/0 conn(0x7fad041584a0 0x7fad0406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969718137 0 0) 0x7facec001120 con 0x7fad040a7120 2024-01-30T08:09:58.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face4003530 con 0x7fad040a7120 2024-01-30T08:09:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036978882 0 0) 0x7facf4001120 con 0x7fad0406de40 2024-01-30T08:09:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facec001120 con 0x7fad0406de40 2024-01-30T08:09:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2432283832 0 0) 0x7face4003530 con 0x7fad040a7120 2024-01-30T08:09:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad03400640 1 -- 172.21.15.50:0/2673521995 >> v1:172.21.15.125:6789/0 conn(0x7fad0406de40 legacy=0x7fad04157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad03400640 1 -- 172.21.15.50:0/2673521995 >> v1:172.21.15.50:6789/0 conn(0x7fad040a7120 legacy=0x7fad0415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.621+0000 7fad03400640 1 -- 172.21.15.50:0/2673521995 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0406ec20 con 0x7fad041584a0 2024-01-30T08:09:58.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad03400640 1 --2- 172.21.15.50:0/2673521995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad041584a0 0x7fad0406e220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facfc009d90 tx=0x7facfc01c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cc0590cdd2c15f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:58.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec001810 con 0x7fad041584a0 2024-01-30T08:09:58.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc0a64c0 con 0x7fad041584a0 2024-01-30T08:09:58.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad01600640 1 -- 172.21.15.50:0/2673521995 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0a6850 con 0x7fad041584a0 2024-01-30T08:09:58.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 -- 172.21.15.50:0/2673521995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad041584a0 msgr2=0x7fad0406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 --2- 172.21.15.50:0/2673521995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad041584a0 0x7fad0406e220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facfc009d90 tx=0x7facfc01c870 comp rx=0 tx=0).stop 2024-01-30T08:09:58.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 -- 172.21.15.50:0/2673521995 shutdown_connections 2024-01-30T08:09:58.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 --2- 172.21.15.50:0/2673521995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad041584a0 0x7fad0406e220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 -- 172.21.15.50:0/2673521995 >> 172.21.15.50:0/2673521995 conn(0x7fad040c4830 msgr2=0x7fad040c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:58.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 -- 172.21.15.50:0/2673521995 shutdown_connections 2024-01-30T08:09:58.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 -- 172.21.15.50:0/2673521995 wait complete. 2024-01-30T08:09:58.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.625+0000 7fad09800640 1 Processor -- start 2024-01-30T08:09:58.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 -- start start 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0406de40 0x7fad04152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a7120 0x7fad04145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad041584a0 0x7fad041462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad04155310 con 0x7fad0406de40 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad04146800 con 0x7fad040a7120 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad041f0ca0 con 0x7fad041584a0 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0406de40 0x7fad04152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0406de40 0x7fad04152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44938/0 (socket says 172.21.15.50:44938) 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 -- 172.21.15.50:0/2944816022 learned_addr learned my addr 172.21.15.50:0/2944816022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02000640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a7120 0x7fad04145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad03400640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad041584a0 0x7fad041462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 -- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad041584a0 msgr2=0x7fad041462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad041584a0 0x7fad041462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 -- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a7120 msgr2=0x7fad04145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a7120 0x7fad04145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 -- 172.21.15.50:0/2944816022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009a70 con 0x7fad0406de40 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02000640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a7120 0x7fad04145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:58.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad02a00640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0406de40 0x7fad04152f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7facf400c730 tx=0x7facf400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7facfaa00640 1 -- 172.21.15.50:0/2944816022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40052d0 con 0x7fad0406de40 2024-01-30T08:09:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7facfaa00640 1 -- 172.21.15.50:0/2944816022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4005450 con 0x7fad0406de40 2024-01-30T08:09:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad041f09c0 con 0x7fad0406de40 2024-01-30T08:09:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7facfaa00640 1 -- 172.21.15.50:0/2944816022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400a880 con 0x7fad0406de40 2024-01-30T08:09:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad040a8eb0 con 0x7fad0406de40 2024-01-30T08:09:58.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.629+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad04074a20 con 0x7fad0406de40 2024-01-30T08:09:58.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.633+0000 7facfaa00640 1 -- 172.21.15.50:0/2944816022 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7facf400a9e0 con 0x7fad0406de40 2024-01-30T08:09:58.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.633+0000 7facfaa00640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7facdc066500 0x7facdc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:58.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.633+0000 7facfaa00640 1 -- 172.21.15.50:0/2944816022 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7facf4083a80 con 0x7fad0406de40 2024-01-30T08:09:58.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.633+0000 7fad02000640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7facdc066500 0x7facdc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:58.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.633+0000 7fad02000640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7facdc066500 0x7facdc0689c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7facec001940 tx=0x7facec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:58.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.637+0000 7facfaa00640 1 -- 172.21.15.50:0/2944816022 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7facf4050bd0 con 0x7fad0406de40 2024-01-30T08:09:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.789+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad041520a0 con 0x7facdc066500 2024-01-30T08:09:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.801+0000 7facfaa00640 1 -- 172.21.15.50:0/2944816022 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288088 (secure 0 0 0) 0x7facec007d70 con 0x7facdc066500 2024-01-30T08:09:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.801+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7facdc066500 msgr2=0x7facdc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.801+0000 7fad09800640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7facdc066500 0x7facdc0689c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7facec001940 tx=0x7facec009040 comp rx=0 tx=0).stop 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0406de40 msgr2=0x7fad04152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0406de40 0x7fad04152f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7facf400c730 tx=0x7facf400cbf0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 shutdown_connections 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad040a7120 0x7fad04145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7facdc066500 0x7facdc0689c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad041584a0 0x7fad041462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 --2- 172.21.15.50:0/2944816022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad0406de40 0x7fad04152f10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 >> 172.21.15.50:0/2944816022 conn(0x7fad040c4830 msgr2=0x7fad040c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 shutdown_connections 2024-01-30T08:09:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:58.805+0000 7fad09800640 1 -- 172.21.15.50:0/2944816022 wait complete. 2024-01-30T08:09:58.825 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-01-30T08:09:57.068750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592666,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232192,"kb_used_data":3524,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742528,"statfs":{"total":773094113280,"available":772856348672,"internally_reserved":0,"allocated":3608576,"data_stored":2640694,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2298,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.162243"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866841+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:09:54.866841+0000","last_peered":"2024-01-30T08:09:54.866841+0000","last_clean":"2024-01-30T08:09:54.866841+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:09:54.866841+0000","last_undegraded":"2024-01-30T08:09:54.866841+0000","last_fullsized":"2024-01-30T08:09:54.866841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866478+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:09:54.866478+0000","last_peered":"2024-01-30T08:09:54.866478+0000","last_clean":"2024-01-30T08:09:54.866478+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:09:54.866478+0000","last_undegraded":"2024-01-30T08:09:54.866478+0000","last_fullsized":"2024-01-30T08:09:54.866478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922243+0000","last_change":"2024-01-30T08:09:52.922243+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922243+0000","last_undegraded":"2024-01-30T08:09:52.922243+0000","last_fullsized":"2024-01-30T08:09:52.922243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881407+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:09:53.881407+0000","last_peered":"2024-01-30T08:09:53.881407+0000","last_clean":"2024-01-30T08:09:53.881407+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:09:53.881407+0000","last_undegraded":"2024-01-30T08:09:53.881407+0000","last_fullsized":"2024-01-30T08:09:53.881407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:12.825632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875171+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:09:53.875171+0000","last_peered":"2024-01-30T08:09:53.875171+0000","last_clean":"2024-01-30T08:09:53.875171+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:09:53.875171+0000","last_undegraded":"2024-01-30T08:09:53.875171+0000","last_fullsized":"2024-01-30T08:09:53.875171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:14:32.567638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.895589+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:09:53.895589+0000","last_peered":"2024-01-30T08:09:53.895589+0000","last_clean":"2024-01-30T08:09:53.895589+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:09:53.895589+0000","last_undegraded":"2024-01-30T08:09:53.895589+0000","last_fullsized":"2024-01-30T08:09:53.895589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.924834+0000","last_change":"2024-01-30T08:09:52.924834+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.924834+0000","last_undegraded":"2024-01-30T08:09:52.924834+0000","last_fullsized":"2024-01-30T08:09:52.924834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866131+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:09:54.866131+0000","last_peered":"2024-01-30T08:09:54.866131+0000","last_clean":"2024-01-30T08:09:54.866131+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:09:54.866131+0000","last_undegraded":"2024-01-30T08:09:54.866131+0000","last_fullsized":"2024-01-30T08:09:54.866131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.923538+0000","last_change":"2024-01-30T08:09:52.923538+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.923538+0000","last_undegraded":"2024-01-30T08:09:52.923538+0000","last_fullsized":"2024-01-30T08:09:52.923538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.927557+0000","last_change":"2024-01-30T08:09:52.927557+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.927557+0000","last_undegraded":"2024-01-30T08:09:52.927557+0000","last_fullsized":"2024-01-30T08:09:52.927557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.925369+0000","last_change":"2024-01-30T08:09:52.925369+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.925369+0000","last_undegraded":"2024-01-30T08:09:52.925369+0000","last_fullsized":"2024-01-30T08:09:52.925369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.929744+0000","last_change":"2024-01-30T08:09:52.929744+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.929744+0000","last_undegraded":"2024-01-30T08:09:52.929744+0000","last_fullsized":"2024-01-30T08:09:52.929744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921737+0000","last_change":"2024-01-30T08:09:52.921737+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921737+0000","last_undegraded":"2024-01-30T08:09:52.921737+0000","last_fullsized":"2024-01-30T08:09:52.921737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866488+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:09:54.866488+0000","last_peered":"2024-01-30T08:09:54.866488+0000","last_clean":"2024-01-30T08:09:54.866488+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:09:54.866488+0000","last_undegraded":"2024-01-30T08:09:54.866488+0000","last_fullsized":"2024-01-30T08:09:54.866488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.924353+0000","last_change":"2024-01-30T08:09:52.924353+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.924353+0000","last_undegraded":"2024-01-30T08:09:52.924353+0000","last_fullsized":"2024-01-30T08:09:52.924353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891438+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:09:53.891438+0000","last_peered":"2024-01-30T08:09:53.891438+0000","last_clean":"2024-01-30T08:09:53.891438+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:09:53.891438+0000","last_undegraded":"2024-01-30T08:09:53.891438+0000","last_fullsized":"2024-01-30T08:09:53.891438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891891+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:09:53.891891+0000","last_peered":"2024-01-30T08:09:53.891891+0000","last_clean":"2024-01-30T08:09:53.891891+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:09:53.891891+0000","last_undegraded":"2024-01-30T08:09:53.891891+0000","last_fullsized":"2024-01-30T08:09:53.891891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867419+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:09:54.867419+0000","last_peered":"2024-01-30T08:09:54.867419+0000","last_clean":"2024-01-30T08:09:54.867419+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:09:54.867419+0000","last_undegraded":"2024-01-30T08:09:54.867419+0000","last_fullsized":"2024-01-30T08:09:54.867419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.886526+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:09:53.886526+0000","last_peered":"2024-01-30T08:09:53.886526+0000","last_clean":"2024-01-30T08:09:53.886526+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:09:53.886526+0000","last_undegraded":"2024-01-30T08:09:53.886526+0000","last_fullsized":"2024-01-30T08:09:53.886526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:42.377477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867251+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:09:54.867251+0000","last_peered":"2024-01-30T08:09:54.867251+0000","last_clean":"2024-01-30T08:09:54.867251+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:09:54.867251+0000","last_undegraded":"2024-01-30T08:09:54.867251+0000","last_fullsized":"2024-01-30T08:09:54.867251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921200+0000","last_change":"2024-01-30T08:09:52.921200+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921200+0000","last_undegraded":"2024-01-30T08:09:52.921200+0000","last_fullsized":"2024-01-30T08:09:52.921200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866793+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:09:54.866793+0000","last_peered":"2024-01-30T08:09:54.866793+0000","last_clean":"2024-01-30T08:09:54.866793+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:09:54.866793+0000","last_undegraded":"2024-01-30T08:09:54.866793+0000","last_fullsized":"2024-01-30T08:09:54.866793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892219+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:09:53.892219+0000","last_peered":"2024-01-30T08:09:53.892219+0000","last_clean":"2024-01-30T08:09:53.892219+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:09:53.892219+0000","last_undegraded":"2024-01-30T08:09:53.892219+0000","last_fullsized":"2024-01-30T08:09:53.892219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890815+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:09:53.890815+0000","last_peered":"2024-01-30T08:09:53.890815+0000","last_clean":"2024-01-30T08:09:53.890815+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:09:53.890815+0000","last_undegraded":"2024-01-30T08:09:53.890815+0000","last_fullsized":"2024-01-30T08:09:53.890815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:37.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867410+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:09:54.867410+0000","last_peered":"2024-01-30T08:09:54.867410+0000","last_clean":"2024-01-30T08:09:54.867410+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:09:54.867410+0000","last_undegraded":"2024-01-30T08:09:54.867410+0000","last_fullsized":"2024-01-30T08:09:54.867410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890622+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:09:53.890622+0000","last_peered":"2024-01-30T08:09:53.890622+0000","last_clean":"2024-01-30T08:09:53.890622+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:09:53.890622+0000","last_undegraded":"2024-01-30T08:09:53.890622+0000","last_fullsized":"2024-01-30T08:09:53.890622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867532+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:09:54.867532+0000","last_peered":"2024-01-30T08:09:54.867532+0000","last_clean":"2024-01-30T08:09:54.867532+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:09:54.867532+0000","last_undegraded":"2024-01-30T08:09:54.867532+0000","last_fullsized":"2024-01-30T08:09:54.867532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921825+0000","last_change":"2024-01-30T08:09:52.921825+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921825+0000","last_undegraded":"2024-01-30T08:09:52.921825+0000","last_fullsized":"2024-01-30T08:09:52.921825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867588+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:09:54.867588+0000","last_peered":"2024-01-30T08:09:54.867588+0000","last_clean":"2024-01-30T08:09:54.867588+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:09:54.867588+0000","last_undegraded":"2024-01-30T08:09:54.867588+0000","last_fullsized":"2024-01-30T08:09:54.867588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867228+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:09:54.867228+0000","last_peered":"2024-01-30T08:09:54.867228+0000","last_clean":"2024-01-30T08:09:54.867228+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:09:54.867228+0000","last_undegraded":"2024-01-30T08:09:54.867228+0000","last_fullsized":"2024-01-30T08:09:54.867228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891248+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:09:53.891248+0000","last_peered":"2024-01-30T08:09:53.891248+0000","last_clean":"2024-01-30T08:09:53.891248+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:09:53.891248+0000","last_undegraded":"2024-01-30T08:09:53.891248+0000","last_fullsized":"2024-01-30T08:09:53.891248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893973+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:09:53.893973+0000","last_peered":"2024-01-30T08:09:53.893973+0000","last_clean":"2024-01-30T08:09:53.893973+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:09:53.893973+0000","last_undegraded":"2024-01-30T08:09:53.893973+0000","last_fullsized":"2024-01-30T08:09:53.893973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891153+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:09:53.891153+0000","last_peered":"2024-01-30T08:09:53.891153+0000","last_clean":"2024-01-30T08:09:53.891153+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:09:53.891153+0000","last_undegraded":"2024-01-30T08:09:53.891153+0000","last_fullsized":"2024-01-30T08:09:53.891153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867365+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:09:54.867365+0000","last_peered":"2024-01-30T08:09:54.867365+0000","last_clean":"2024-01-30T08:09:54.867365+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:09:54.867365+0000","last_undegraded":"2024-01-30T08:09:54.867365+0000","last_fullsized":"2024-01-30T08:09:54.867365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889611+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:09:53.889611+0000","last_peered":"2024-01-30T08:09:53.889611+0000","last_clean":"2024-01-30T08:09:53.889611+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:09:53.889611+0000","last_undegraded":"2024-01-30T08:09:53.889611+0000","last_fullsized":"2024-01-30T08:09:53.889611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.938882+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:09:52.938882+0000","last_peered":"2024-01-30T08:09:52.938882+0000","last_clean":"2024-01-30T08:09:52.938882+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:09:52.938882+0000","last_undegraded":"2024-01-30T08:09:52.938882+0000","last_fullsized":"2024-01-30T08:09:52.938882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:51:26.642485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866710+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:09:54.866710+0000","last_peered":"2024-01-30T08:09:54.866710+0000","last_clean":"2024-01-30T08:09:54.866710+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:09:54.866710+0000","last_undegraded":"2024-01-30T08:09:54.866710+0000","last_fullsized":"2024-01-30T08:09:54.866710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940179+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:09:53.940179+0000","last_peered":"2024-01-30T08:09:53.940179+0000","last_clean":"2024-01-30T08:09:53.940179+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:09:53.940179+0000","last_undegraded":"2024-01-30T08:09:53.940179+0000","last_fullsized":"2024-01-30T08:09:53.940179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866856+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:09:54.866856+0000","last_peered":"2024-01-30T08:09:54.866856+0000","last_clean":"2024-01-30T08:09:54.866856+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:09:54.866856+0000","last_undegraded":"2024-01-30T08:09:54.866856+0000","last_fullsized":"2024-01-30T08:09:54.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866448+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:09:54.866448+0000","last_peered":"2024-01-30T08:09:54.866448+0000","last_clean":"2024-01-30T08:09:54.866448+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:09:54.866448+0000","last_undegraded":"2024-01-30T08:09:54.866448+0000","last_fullsized":"2024-01-30T08:09:54.866448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.920540+0000","last_change":"2024-01-30T08:09:52.920540+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.920540+0000","last_undegraded":"2024-01-30T08:09:52.920540+0000","last_fullsized":"2024-01-30T08:09:52.920540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943116+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:09:52.943116+0000","last_peered":"2024-01-30T08:09:52.943116+0000","last_clean":"2024-01-30T08:09:52.943116+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:09:52.943116+0000","last_undegraded":"2024-01-30T08:09:52.943116+0000","last_fullsized":"2024-01-30T08:09:52.943116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:08:17.770601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922054+0000","last_change":"2024-01-30T08:09:52.922054+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922054+0000","last_undegraded":"2024-01-30T08:09:52.922054+0000","last_fullsized":"2024-01-30T08:09:52.922054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.938191+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:09:53.938191+0000","last_peered":"2024-01-30T08:09:53.938191+0000","last_clean":"2024-01-30T08:09:53.938191+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:09:53.938191+0000","last_undegraded":"2024-01-30T08:09:53.938191+0000","last_fullsized":"2024-01-30T08:09:53.938191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866823+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:09:54.866823+0000","last_peered":"2024-01-30T08:09:54.866823+0000","last_clean":"2024-01-30T08:09:54.866823+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:09:54.866823+0000","last_undegraded":"2024-01-30T08:09:54.866823+0000","last_fullsized":"2024-01-30T08:09:54.866823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873889+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:09:53.873889+0000","last_peered":"2024-01-30T08:09:53.873889+0000","last_clean":"2024-01-30T08:09:53.873889+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:09:53.873889+0000","last_undegraded":"2024-01-30T08:09:53.873889+0000","last_fullsized":"2024-01-30T08:09:53.873889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866287+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:09:54.866287+0000","last_peered":"2024-01-30T08:09:54.866287+0000","last_clean":"2024-01-30T08:09:54.866287+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:09:54.866287+0000","last_undegraded":"2024-01-30T08:09:54.866287+0000","last_fullsized":"2024-01-30T08:09:54.866287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866091+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:09:54.866091+0000","last_peered":"2024-01-30T08:09:54.866091+0000","last_clean":"2024-01-30T08:09:54.866091+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:09:54.866091+0000","last_undegraded":"2024-01-30T08:09:54.866091+0000","last_fullsized":"2024-01-30T08:09:54.866091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881427+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:09:53.881427+0000","last_peered":"2024-01-30T08:09:53.881427+0000","last_clean":"2024-01-30T08:09:53.881427+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:09:53.881427+0000","last_undegraded":"2024-01-30T08:09:53.881427+0000","last_fullsized":"2024-01-30T08:09:53.881427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:17.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866901+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:09:54.866901+0000","last_peered":"2024-01-30T08:09:54.866901+0000","last_clean":"2024-01-30T08:09:54.866901+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:09:54.866901+0000","last_undegraded":"2024-01-30T08:09:54.866901+0000","last_fullsized":"2024-01-30T08:09:54.866901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888571+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:09:53.888571+0000","last_peered":"2024-01-30T08:09:53.888571+0000","last_clean":"2024-01-30T08:09:53.888571+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:09:53.888571+0000","last_undegraded":"2024-01-30T08:09:53.888571+0000","last_fullsized":"2024-01-30T08:09:53.888571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.936220+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:09:52.936220+0000","last_peered":"2024-01-30T08:09:52.936220+0000","last_clean":"2024-01-30T08:09:52.936220+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:09:52.936220+0000","last_undegraded":"2024-01-30T08:09:52.936220+0000","last_fullsized":"2024-01-30T08:09:52.936220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922039+0000","last_change":"2024-01-30T08:09:52.922039+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922039+0000","last_undegraded":"2024-01-30T08:09:52.922039+0000","last_fullsized":"2024-01-30T08:09:52.922039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943122+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:09:52.943122+0000","last_peered":"2024-01-30T08:09:52.943122+0000","last_clean":"2024-01-30T08:09:52.943122+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:09:52.943122+0000","last_undegraded":"2024-01-30T08:09:52.943122+0000","last_fullsized":"2024-01-30T08:09:52.943122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:02:30.703040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866544+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:09:54.866544+0000","last_peered":"2024-01-30T08:09:54.866544+0000","last_clean":"2024-01-30T08:09:54.866544+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:09:54.866544+0000","last_undegraded":"2024-01-30T08:09:54.866544+0000","last_fullsized":"2024-01-30T08:09:54.866544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866416+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:09:54.866416+0000","last_peered":"2024-01-30T08:09:54.866416+0000","last_clean":"2024-01-30T08:09:54.866416+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:09:54.866416+0000","last_undegraded":"2024-01-30T08:09:54.866416+0000","last_fullsized":"2024-01-30T08:09:54.866416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.920143+0000","last_change":"2024-01-30T08:09:52.920143+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.920143+0000","last_undegraded":"2024-01-30T08:09:52.920143+0000","last_fullsized":"2024-01-30T08:09:52.920143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866446+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:09:54.866446+0000","last_peered":"2024-01-30T08:09:54.866446+0000","last_clean":"2024-01-30T08:09:54.866446+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:09:54.866446+0000","last_undegraded":"2024-01-30T08:09:54.866446+0000","last_fullsized":"2024-01-30T08:09:54.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866128+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:09:54.866128+0000","last_peered":"2024-01-30T08:09:54.866128+0000","last_clean":"2024-01-30T08:09:54.866128+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:09:54.866128+0000","last_undegraded":"2024-01-30T08:09:54.866128+0000","last_fullsized":"2024-01-30T08:09:54.866128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875608+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:09:53.875608+0000","last_peered":"2024-01-30T08:09:53.875608+0000","last_clean":"2024-01-30T08:09:53.875608+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:09:53.875608+0000","last_undegraded":"2024-01-30T08:09:53.875608+0000","last_fullsized":"2024-01-30T08:09:53.875608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891268+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:09:53.891268+0000","last_peered":"2024-01-30T08:09:53.891268+0000","last_clean":"2024-01-30T08:09:53.891268+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:09:53.891268+0000","last_undegraded":"2024-01-30T08:09:53.891268+0000","last_fullsized":"2024-01-30T08:09:53.891268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866862+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:09:54.866862+0000","last_peered":"2024-01-30T08:09:54.866862+0000","last_clean":"2024-01-30T08:09:54.866862+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:09:54.866862+0000","last_undegraded":"2024-01-30T08:09:54.866862+0000","last_fullsized":"2024-01-30T08:09:54.866862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866330+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:09:54.866330+0000","last_peered":"2024-01-30T08:09:54.866330+0000","last_clean":"2024-01-30T08:09:54.866330+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:09:54.866330+0000","last_undegraded":"2024-01-30T08:09:54.866330+0000","last_fullsized":"2024-01-30T08:09:54.866330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.941256+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:09:53.941256+0000","last_peered":"2024-01-30T08:09:53.941256+0000","last_clean":"2024-01-30T08:09:53.941256+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:09:53.941256+0000","last_undegraded":"2024-01-30T08:09:53.941256+0000","last_fullsized":"2024-01-30T08:09:53.941256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866363+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:09:54.866363+0000","last_peered":"2024-01-30T08:09:54.866363+0000","last_clean":"2024-01-30T08:09:54.866363+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:09:54.866363+0000","last_undegraded":"2024-01-30T08:09:54.866363+0000","last_fullsized":"2024-01-30T08:09:54.866363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.942505+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:09:52.942505+0000","last_peered":"2024-01-30T08:09:52.942505+0000","last_clean":"2024-01-30T08:09:52.942505+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:09:52.942505+0000","last_undegraded":"2024-01-30T08:09:52.942505+0000","last_fullsized":"2024-01-30T08:09:52.942505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.922110+0000","last_change":"2024-01-30T08:09:52.922110+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.922110+0000","last_undegraded":"2024-01-30T08:09:52.922110+0000","last_fullsized":"2024-01-30T08:09:52.922110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866781+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:09:54.866781+0000","last_peered":"2024-01-30T08:09:54.866781+0000","last_clean":"2024-01-30T08:09:54.866781+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:09:54.866781+0000","last_undegraded":"2024-01-30T08:09:54.866781+0000","last_fullsized":"2024-01-30T08:09:54.866781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866674+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:09:54.866674+0000","last_peered":"2024-01-30T08:09:54.866674+0000","last_clean":"2024-01-30T08:09:54.866674+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:09:54.866674+0000","last_undegraded":"2024-01-30T08:09:54.866674+0000","last_fullsized":"2024-01-30T08:09:54.866674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940428+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:09:53.940428+0000","last_peered":"2024-01-30T08:09:53.940428+0000","last_clean":"2024-01-30T08:09:53.940428+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:09:53.940428+0000","last_undegraded":"2024-01-30T08:09:53.940428+0000","last_fullsized":"2024-01-30T08:09:53.940428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890710+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:09:53.890710+0000","last_peered":"2024-01-30T08:09:53.890710+0000","last_clean":"2024-01-30T08:09:53.890710+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:09:53.890710+0000","last_undegraded":"2024-01-30T08:09:53.890710+0000","last_fullsized":"2024-01-30T08:09:53.890710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:11:28.469716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873459+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:09:53.873459+0000","last_peered":"2024-01-30T08:09:53.873459+0000","last_clean":"2024-01-30T08:09:53.873459+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:09:53.873459+0000","last_undegraded":"2024-01-30T08:09:53.873459+0000","last_fullsized":"2024-01-30T08:09:53.873459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892220+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:09:53.892220+0000","last_peered":"2024-01-30T08:09:53.892220+0000","last_clean":"2024-01-30T08:09:53.892220+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:09:53.892220+0000","last_undegraded":"2024-01-30T08:09:53.892220+0000","last_fullsized":"2024-01-30T08:09:53.892220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.939996+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:09:53.939996+0000","last_peered":"2024-01-30T08:09:53.939996+0000","last_clean":"2024-01-30T08:09:53.939996+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:09:53.939996+0000","last_undegraded":"2024-01-30T08:09:53.939996+0000","last_fullsized":"2024-01-30T08:09:53.939996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.919218+0000","last_change":"2024-01-30T08:09:52.919218+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.919218+0000","last_undegraded":"2024-01-30T08:09:52.919218+0000","last_fullsized":"2024-01-30T08:09:52.919218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864882+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:09:53.864882+0000","last_peered":"2024-01-30T08:09:53.864882+0000","last_clean":"2024-01-30T08:09:53.864882+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:09:53.864882+0000","last_undegraded":"2024-01-30T08:09:53.864882+0000","last_fullsized":"2024-01-30T08:09:53.864882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.921117+0000","last_change":"2024-01-30T08:09:52.921117+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.921117+0000","last_undegraded":"2024-01-30T08:09:52.921117+0000","last_fullsized":"2024-01-30T08:09:52.921117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.871973+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:09:53.871973+0000","last_peered":"2024-01-30T08:09:53.871973+0000","last_clean":"2024-01-30T08:09:53.871973+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:09:53.871973+0000","last_undegraded":"2024-01-30T08:09:53.871973+0000","last_fullsized":"2024-01-30T08:09:53.871973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866449+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:09:54.866449+0000","last_peered":"2024-01-30T08:09:54.866449+0000","last_clean":"2024-01-30T08:09:54.866449+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:09:54.866449+0000","last_undegraded":"2024-01-30T08:09:54.866449+0000","last_fullsized":"2024-01-30T08:09:54.866449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864990+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:09:53.864990+0000","last_peered":"2024-01-30T08:09:53.864990+0000","last_clean":"2024-01-30T08:09:53.864990+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:09:53.864990+0000","last_undegraded":"2024-01-30T08:09:53.864990+0000","last_fullsized":"2024-01-30T08:09:53.864990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889661+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:09:53.889661+0000","last_peered":"2024-01-30T08:09:53.889661+0000","last_clean":"2024-01-30T08:09:53.889661+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:09:53.889661+0000","last_undegraded":"2024-01-30T08:09:53.889661+0000","last_fullsized":"2024-01-30T08:09:53.889661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.943085+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:09:52.943085+0000","last_peered":"2024-01-30T08:09:52.943085+0000","last_clean":"2024-01-30T08:09:52.943085+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:09:52.943085+0000","last_undegraded":"2024-01-30T08:09:52.943085+0000","last_fullsized":"2024-01-30T08:09:52.943085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:12.097808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888593+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:09:53.888593+0000","last_peered":"2024-01-30T08:09:53.888593+0000","last_clean":"2024-01-30T08:09:53.888593+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:09:53.888593+0000","last_undegraded":"2024-01-30T08:09:53.888593+0000","last_fullsized":"2024-01-30T08:09:53.888593+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.865627+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:09:53.865627+0000","last_peered":"2024-01-30T08:09:53.865627+0000","last_clean":"2024-01-30T08:09:53.865627+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:09:53.865627+0000","last_undegraded":"2024-01-30T08:09:53.865627+0000","last_fullsized":"2024-01-30T08:09:53.865627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866673+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:09:54.866673+0000","last_peered":"2024-01-30T08:09:54.866673+0000","last_clean":"2024-01-30T08:09:54.866673+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:09:54.866673+0000","last_undegraded":"2024-01-30T08:09:54.866673+0000","last_fullsized":"2024-01-30T08:09:54.866673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.941163+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:09:52.941163+0000","last_peered":"2024-01-30T08:09:52.941163+0000","last_clean":"2024-01-30T08:09:52.941163+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:09:52.941163+0000","last_undegraded":"2024-01-30T08:09:52.941163+0000","last_fullsized":"2024-01-30T08:09:52.941163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:11:01.997982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.919766+0000","last_change":"2024-01-30T08:09:52.919766+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.919766+0000","last_undegraded":"2024-01-30T08:09:52.919766+0000","last_fullsized":"2024-01-30T08:09:52.919766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-30T08:09:52.941180+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:09:52.941180+0000","last_peered":"2024-01-30T08:09:52.941180+0000","last_clean":"2024-01-30T08:09:52.941180+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:09:52.941180+0000","last_undegraded":"2024-01-30T08:09:52.941180+0000","last_fullsized":"2024-01-30T08:09:52.941180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:10:03.860020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893904+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:09:53.893904+0000","last_peered":"2024-01-30T08:09:53.893904+0000","last_clean":"2024-01-30T08:09:53.893904+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:09:53.893904+0000","last_undegraded":"2024-01-30T08:09:53.893904+0000","last_fullsized":"2024-01-30T08:09:53.893904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867208+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:09:54.867208+0000","last_peered":"2024-01-30T08:09:54.867208+0000","last_clean":"2024-01-30T08:09:54.867208+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:09:54.867208+0000","last_undegraded":"2024-01-30T08:09:54.867208+0000","last_fullsized":"2024-01-30T08:09:54.867208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866671+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:09:54.866671+0000","last_peered":"2024-01-30T08:09:54.866671+0000","last_clean":"2024-01-30T08:09:54.866671+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:09:54.866671+0000","last_undegraded":"2024-01-30T08:09:54.866671+0000","last_fullsized":"2024-01-30T08:09:54.866671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866042+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:09:54.866042+0000","last_peered":"2024-01-30T08:09:54.866042+0000","last_clean":"2024-01-30T08:09:54.866042+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:09:54.866042+0000","last_undegraded":"2024-01-30T08:09:54.866042+0000","last_fullsized":"2024-01-30T08:09:54.866042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889868+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:09:53.889868+0000","last_peered":"2024-01-30T08:09:53.889868+0000","last_clean":"2024-01-30T08:09:53.889868+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:09:53.889868+0000","last_undegraded":"2024-01-30T08:09:53.889868+0000","last_fullsized":"2024-01-30T08:09:53.889868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866145+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:09:54.866145+0000","last_peered":"2024-01-30T08:09:54.866145+0000","last_clean":"2024-01-30T08:09:54.866145+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:09:54.866145+0000","last_undegraded":"2024-01-30T08:09:54.866145+0000","last_fullsized":"2024-01-30T08:09:54.866145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-01-30T08:09:52.925114+0000","last_change":"2024-01-30T08:09:52.925114+0000","last_active":"2024-01-30T08:09:52.907039+0000","last_peered":"2024-01-30T08:09:52.907039+0000","last_clean":"2024-01-30T08:09:52.907039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:09:52.925114+0000","last_undegraded":"2024-01-30T08:09:52.925114+0000","last_fullsized":"2024-01-30T08:09:52.925114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874866+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:09:53.874866+0000","last_peered":"2024-01-30T08:09:53.874866+0000","last_clean":"2024-01-30T08:09:53.874866+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:09:53.874866+0000","last_undegraded":"2024-01-30T08:09:53.874866+0000","last_fullsized":"2024-01-30T08:09:53.874866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874458+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:09:53.874458+0000","last_peered":"2024-01-30T08:09:53.874458+0000","last_clean":"2024-01-30T08:09:53.874458+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:09:53.874458+0000","last_undegraded":"2024-01-30T08:09:53.874458+0000","last_fullsized":"2024-01-30T08:09:53.874458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2298,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":777383,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.874}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.442}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68400000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.46500000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.754},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":185937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60599999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":186979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.316},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.78200000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.76600000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80800000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39600000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.502}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.96899999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.871}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.016}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":171643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.629},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.51100000000000001}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":762011,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.748},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.922243+0000', 'last_change': '2024-01-30T08:09:52.922243+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.922243+0000', 'last_undegraded': '2024-01-30T08:09:52.922243+0000', 'last_fullsized': '2024-01-30T08:09:52.922243+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.924834+0000', 'last_change': '2024-01-30T08:09:52.924834+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.924834+0000', 'last_undegraded': '2024-01-30T08:09:52.924834+0000', 'last_fullsized': '2024-01-30T08:09:52.924834+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.923538+0000', 'last_change': '2024-01-30T08:09:52.923538+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.923538+0000', 'last_undegraded': '2024-01-30T08:09:52.923538+0000', 'last_fullsized': '2024-01-30T08:09:52.923538+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.927557+0000', 'last_change': '2024-01-30T08:09:52.927557+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.927557+0000', 'last_undegraded': '2024-01-30T08:09:52.927557+0000', 'last_fullsized': '2024-01-30T08:09:52.927557+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-01-30T08:09:58.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.925369+0000', 'last_change': '2024-01-30T08:09:52.925369+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.925369+0000', 'last_undegraded': '2024-01-30T08:09:52.925369+0000', 'last_fullsized': '2024-01-30T08:09:52.925369+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.929744+0000', 'last_change': '2024-01-30T08:09:52.929744+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.929744+0000', 'last_undegraded': '2024-01-30T08:09:52.929744+0000', 'last_fullsized': '2024-01-30T08:09:52.929744+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.921737+0000', 'last_change': '2024-01-30T08:09:52.921737+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.921737+0000', 'last_undegraded': '2024-01-30T08:09:52.921737+0000', 'last_fullsized': '2024-01-30T08:09:52.921737+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.924353+0000', 'last_change': '2024-01-30T08:09:52.924353+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.924353+0000', 'last_undegraded': '2024-01-30T08:09:52.924353+0000', 'last_fullsized': '2024-01-30T08:09:52.924353+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.921200+0000', 'last_change': '2024-01-30T08:09:52.921200+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.921200+0000', 'last_undegraded': '2024-01-30T08:09:52.921200+0000', 'last_fullsized': '2024-01-30T08:09:52.921200+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.921825+0000', 'last_change': '2024-01-30T08:09:52.921825+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.921825+0000', 'last_undegraded': '2024-01-30T08:09:52.921825+0000', 'last_fullsized': '2024-01-30T08:09:52.921825+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-01-30T08:09:58.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.920540+0000', 'last_change': '2024-01-30T08:09:52.920540+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.920540+0000', 'last_undegraded': '2024-01-30T08:09:52.920540+0000', 'last_fullsized': '2024-01-30T08:09:52.920540+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.922054+0000', 'last_change': '2024-01-30T08:09:52.922054+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.922054+0000', 'last_undegraded': '2024-01-30T08:09:52.922054+0000', 'last_fullsized': '2024-01-30T08:09:52.922054+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.922039+0000', 'last_change': '2024-01-30T08:09:52.922039+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.922039+0000', 'last_undegraded': '2024-01-30T08:09:52.922039+0000', 'last_fullsized': '2024-01-30T08:09:52.922039+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.920143+0000', 'last_change': '2024-01-30T08:09:52.920143+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.920143+0000', 'last_undegraded': '2024-01-30T08:09:52.920143+0000', 'last_fullsized': '2024-01-30T08:09:52.920143+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.922110+0000', 'last_change': '2024-01-30T08:09:52.922110+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.922110+0000', 'last_undegraded': '2024-01-30T08:09:52.922110+0000', 'last_fullsized': '2024-01-30T08:09:52.922110+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-01-30T08:09:58.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.919218+0000', 'last_change': '2024-01-30T08:09:52.919218+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.919218+0000', 'last_undegraded': '2024-01-30T08:09:52.919218+0000', 'last_fullsized': '2024-01-30T08:09:52.919218+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-01-30T08:09:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.921117+0000', 'last_change': '2024-01-30T08:09:52.921117+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.921117+0000', 'last_undegraded': '2024-01-30T08:09:52.921117+0000', 'last_fullsized': '2024-01-30T08:09:52.921117+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-01-30T08:09:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.919766+0000', 'last_change': '2024-01-30T08:09:52.919766+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.919766+0000', 'last_undegraded': '2024-01-30T08:09:52.919766+0000', 'last_fullsized': '2024-01-30T08:09:52.919766+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-30T08:09:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-01-30T08:09:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:09:52.925114+0000', 'last_change': '2024-01-30T08:09:52.925114+0000', 'last_active': '2024-01-30T08:09:52.907039+0000', 'last_peered': '2024-01-30T08:09:52.907039+0000', 'last_clean': '2024-01-30T08:09:52.907039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:09:52.925114+0000', 'last_undegraded': '2024-01-30T08:09:52.925114+0000', 'last_fullsized': '2024-01-30T08:09:52.925114+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'last_clean_scrub_stamp': '2024-01-30T08:09:52.907039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-30T08:09:58.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-30T08:09:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.005+0000 7f29cfe00640 1 Processor -- start 2024-01-30T08:09:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.005+0000 7f29cfe00640 1 -- start start 2024-01-30T08:09:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cfe00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29c806de40 0x7f29c806e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cfe00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cfe00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c8152f00 con 0x7f29c8153390 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cfe00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c81525f0 con 0x7f29c806de40 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cfe00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80a7680 con 0x7f29c80c4310 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cde00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cca00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f29c8153390 0x7f29c80a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:50870/0 (socket says 172.21.15.50:50870) 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cde00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:35690/0 (socket says 172.21.15.50:35690) 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cd400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f29c806de40 0x7f29c806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cca00640 1 -- 172.21.15.50:0/292650685 learned_addr learned my addr 172.21.15.50:0/292650685 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:09:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cd400640 1 -- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 msgr2=0x7f29c8155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:09:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cd400640 1 --2- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cd400640 1 -- 172.21.15.50:0/292650685 >> v1:172.21.15.125:6789/0 conn(0x7f29c8153390 legacy=0x7f29c80a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29c7e00640 1 -- 172.21.15.50:0/292650685 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145002225 0 0) 0x7f29c8152f00 con 0x7f29c8153390 2024-01-30T08:09:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cd400640 1 -- 172.21.15.50:0/292650685 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c81528b0 con 0x7f29c806de40 2024-01-30T08:09:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.009+0000 7f29cde00640 1 --2- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:09:59.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cd400640 1 --2- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c806e220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097c0 tx=0x7f29b801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb8505bb26661cc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:59.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29c7e00640 1 -- 172.21.15.50:0/292650685 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80ab600 con 0x7f29c806de40 2024-01-30T08:09:59.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29c7e00640 1 -- 172.21.15.50:0/292650685 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b80a7050 con 0x7f29c806de40 2024-01-30T08:09:59.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29c7e00640 1 -- 172.21.15.50:0/292650685 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80ab980 con 0x7f29c806de40 2024-01-30T08:09:59.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 -- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 msgr2=0x7f29c806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 --2- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c806e220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097c0 tx=0x7f29b801c330 comp rx=0 tx=0).stop 2024-01-30T08:09:59.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 -- 172.21.15.50:0/292650685 shutdown_connections 2024-01-30T08:09:59.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 --2- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 --2- 172.21.15.50:0/292650685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c806e220 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 -- 172.21.15.50:0/292650685 >> 172.21.15.50:0/292650685 conn(0x7f29c80c4830 msgr2=0x7f29c80c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:59.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 -- 172.21.15.50:0/292650685 shutdown_connections 2024-01-30T08:09:59.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 -- 172.21.15.50:0/292650685 wait complete. 2024-01-30T08:09:59.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 Processor -- start 2024-01-30T08:09:59.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.013+0000 7f29cfe00640 1 -- start start 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c8158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8153390 0x7f29c814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8158790 con 0x7f29c8153390 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c814e330 con 0x7f29c806de40 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c814e610 con 0x7f29c80c4310 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8153390 0x7f29c814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8153390 0x7f29c814f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35666/0 (socket says 172.21.15.50:35666) 2024-01-30T08:09:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 -- 172.21.15.50:0/659606030 learned_addr learned my addr 172.21.15.50:0/659606030 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cca00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cd400640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c8158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 -- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 msgr2=0x7f29c8149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 -- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 msgr2=0x7f29c8158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c8158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 -- 172.21.15.50:0/659606030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0009a70 con 0x7f29c8153390 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cd400640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c8158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cde00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8153390 0x7f29c814f3d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f29c000efb0 tx=0x7f29c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29c5600640 1 -- 172.21.15.50:0/659606030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0009d50 con 0x7f29c8153390 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29c5600640 1 -- 172.21.15.50:0/659606030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c000f040 con 0x7f29c8153390 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29c5600640 1 -- 172.21.15.50:0/659606030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00146a0 con 0x7f29c8153390 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b8009420 con 0x7f29c8153390 2024-01-30T08:09:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c814ebd0 con 0x7f29c8153390 2024-01-30T08:09:59.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.017+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c8074a20 con 0x7f29c8153390 2024-01-30T08:09:59.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.021+0000 7f29c5600640 1 -- 172.21.15.50:0/659606030 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f29c0014820 con 0x7f29c8153390 2024-01-30T08:09:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.021+0000 7f29c5600640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f29a0066500 0x7f29a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.021+0000 7f29c5600640 1 -- 172.21.15.50:0/659606030 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29c0084f80 con 0x7f29c8153390 2024-01-30T08:09:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.021+0000 7f29cd400640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f29a0066500 0x7f29a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.021+0000 7f29cd400640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f29a0066500 0x7f29a00689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f29b80ad000 tx=0x7f29b80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.025+0000 7f29c5600640 1 -- 172.21.15.50:0/659606030 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f29c00b6590 con 0x7f29c8153390 2024-01-30T08:09:59.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.241+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f29c806f050 con 0x7f29c8153390 2024-01-30T08:09:59.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29c5600640 1 -- 172.21.15.50:0/659606030 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1259 (secure 0 0 0) 0x7f29c0018500 con 0x7f29c8153390 2024-01-30T08:09:59.245 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:59.246 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":95,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1706602114,"num_in_osds":8,"osd_in_since":1706602106,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"creating+peering","count":19}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592666,"bytes_used":237764608,"bytes_avail":772856348672,"bytes_total":773094113280,"inactive_pgs_ratio":0.19587628543376923,"write_bytes_sec":2380,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5214}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-30T08:09:37.063913+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-30T08:09:59.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f29a0066500 msgr2=0x7f29a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f29a0066500 0x7f29a00689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f29b80ad000 tx=0x7f29b80a6000 comp rx=0 tx=0).stop 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8153390 msgr2=0x7f29c814f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8153390 0x7f29c814f3d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f29c000efb0 tx=0x7f29c000c490 comp rx=0 tx=0).stop 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 shutdown_connections 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f29a0066500 0x7f29a00689c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c8153390 0x7f29c814f3d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f29c80c4310 0x7f29c8149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 --2- 172.21.15.50:0/659606030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c806de40 0x7f29c8158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 >> 172.21.15.50:0/659606030 conn(0x7f29c80c4830 msgr2=0x7f29c80c3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 shutdown_connections 2024-01-30T08:09:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.245+0000 7f29cfe00640 1 -- 172.21.15.50:0/659606030 wait complete. 2024-01-30T08:09:59.268 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-30T08:09:59.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:09:59.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf64600640 1 Processor -- start 2024-01-30T08:09:59.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf64600640 1 -- start start 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf64600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf5c158850 0x7faf5c15ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf64600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c157c60 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf64600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0c6a30 con 0x7faf5c151d80 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf64600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c152160 con 0x7faf5c158850 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf62600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf5c158850 0x7faf5c15ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf62600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf5c158850 0x7faf5c15ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35676/0 (socket says 172.21.15.50:35676) 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf62600640 1 -- 172.21.15.50:0/2226700726 learned_addr learned my addr 172.21.15.50:0/2226700726 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf62600640 1 -- 172.21.15.50:0/2226700726 >> v1:172.21.15.125:6789/0 conn(0x7faf5c151d80 legacy=0x7faf5c0c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf62600640 1 -- 172.21.15.50:0/2226700726 >> v1:172.21.15.50:6789/0 conn(0x7faf5c0c4bb0 legacy=0x7faf5c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.409+0000 7faf62600640 1 -- 172.21.15.50:0/2226700726 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c072790 con 0x7faf5c158850 2024-01-30T08:09:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf62600640 1 --2- 172.21.15.50:0/2226700726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c158850 0x7faf5c15ff40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf54009e50 tx=0x7faf5401d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2715b1e3e64dc34c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf5be00640 1 -- 172.21.15.50:0/2226700726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540a57f0 con 0x7faf5c158850 2024-01-30T08:09:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf5be00640 1 -- 172.21.15.50:0/2226700726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf540a5950 con 0x7faf5c158850 2024-01-30T08:09:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf5be00640 1 -- 172.21.15.50:0/2226700726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540a5ce0 con 0x7faf5c158850 2024-01-30T08:09:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf64600640 1 -- 172.21.15.50:0/2226700726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c158850 msgr2=0x7faf5c15ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf64600640 1 --2- 172.21.15.50:0/2226700726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c158850 0x7faf5c15ff40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf54009e50 tx=0x7faf5401d470 comp rx=0 tx=0).stop 2024-01-30T08:09:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf64600640 1 -- 172.21.15.50:0/2226700726 shutdown_connections 2024-01-30T08:09:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf64600640 1 --2- 172.21.15.50:0/2226700726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c158850 0x7faf5c15ff40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf64600640 1 -- 172.21.15.50:0/2226700726 >> 172.21.15.50:0/2226700726 conn(0x7faf5c0a9590 msgr2=0x7faf5c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf64600640 1 -- 172.21.15.50:0/2226700726 shutdown_connections 2024-01-30T08:09:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.413+0000 7faf64600640 1 -- 172.21.15.50:0/2226700726 wait complete. 2024-01-30T08:09:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 Processor -- start 2024-01-30T08:09:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 -- start start 2024-01-30T08:09:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c0c4bb0 0x7faf5c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c151d80 0x7faf5c1ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c158850 0x7faf5c1f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1ecfd0 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c152bb0 con 0x7faf5c158850 2024-01-30T08:09:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1edf20 con 0x7faf5c151d80 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c0c4bb0 0x7faf5c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c0c4bb0 0x7faf5c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35678/0 (socket says 172.21.15.50:35678) 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 -- 172.21.15.50:0/4273350208 learned_addr learned my addr 172.21.15.50:0/4273350208 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf62600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c158850 0x7faf5c1f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61200640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c151d80 0x7faf5c1ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 -- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c151d80 msgr2=0x7faf5c1ed9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c151d80 0x7faf5c1ed9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 -- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c158850 msgr2=0x7faf5c1f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c158850 0x7faf5c1f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 -- 172.21.15.50:0/4273350208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009b30 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf61c00640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c0c4bb0 0x7faf5c154b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00c3c0 tx=0x7faf4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf59600640 1 -- 172.21.15.50:0/4273350208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0052d0 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf59600640 1 -- 172.21.15.50:0/4273350208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c005430 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf59600640 1 -- 172.21.15.50:0/4273350208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c003840 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c1f0a80 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.417+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c1528d0 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.421+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c074a20 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.421+0000 7faf59600640 1 -- 172.21.15.50:0/4273350208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7faf4c0039a0 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.421+0000 7faf59600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faf34066500 0x7faf340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:09:59.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.421+0000 7faf59600640 1 -- 172.21.15.50:0/4273350208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faf4c083400 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.421+0000 7faf61200640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faf34066500 0x7faf340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:09:59.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.421+0000 7faf61200640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faf34066500 0x7faf340689c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf5c14e430 tx=0x7faf44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:09:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.425+0000 7faf59600640 1 -- 172.21.15.50:0/4273350208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7faf4c0506a0 con 0x7faf5c0c4bb0 2024-01-30T08:09:59.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.585+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf5c14f6e0 con 0x7faf34066500 2024-01-30T08:09:59.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.593+0000 7faf59600640 1 -- 172.21.15.50:0/4273350208 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289623 (secure 0 0 0) 0x7faf5c14f6e0 con 0x7faf34066500 2024-01-30T08:09:59.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:09:59.599 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:09:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faf34066500 msgr2=0x7faf340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faf34066500 0x7faf340689c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf5c14e430 tx=0x7faf44009040 comp rx=0 tx=0).stop 2024-01-30T08:09:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c0c4bb0 msgr2=0x7faf5c154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c0c4bb0 0x7faf5c154b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00c3c0 tx=0x7faf4c00c880 comp rx=0 tx=0).stop 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 shutdown_connections 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf5c158850 0x7faf5c1f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7faf34066500 0x7faf340689c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faf5c151d80 0x7faf5c1ed9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 --2- 172.21.15.50:0/4273350208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf5c0c4bb0 0x7faf5c154b40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 >> 172.21.15.50:0/4273350208 conn(0x7faf5c0a9590 msgr2=0x7faf5c0a7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 shutdown_connections 2024-01-30T08:09:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:09:59.597+0000 7faf64600640 1 -- 172.21.15.50:0/4273350208 wait complete. 2024-01-30T08:09:59.618 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-01-30T08:09:59.069198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232276,"kb_used_data":3608,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742444,"statfs":{"total":773094113280,"available":772856262656,"internally_reserved":0,"allocated":3694592,"data_stored":2681460,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.158904"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866841+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:09:54.866841+0000","last_peered":"2024-01-30T08:09:54.866841+0000","last_clean":"2024-01-30T08:09:54.866841+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:09:54.866841+0000","last_undegraded":"2024-01-30T08:09:54.866841+0000","last_fullsized":"2024-01-30T08:09:54.866841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866478+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:09:54.866478+0000","last_peered":"2024-01-30T08:09:54.866478+0000","last_clean":"2024-01-30T08:09:54.866478+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:09:54.866478+0000","last_undegraded":"2024-01-30T08:09:54.866478+0000","last_fullsized":"2024-01-30T08:09:54.866478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727978+0000","last_change":"2024-01-30T08:09:53.888831+0000","last_active":"2024-01-30T08:09:55.727978+0000","last_peered":"2024-01-30T08:09:55.727978+0000","last_clean":"2024-01-30T08:09:55.727978+0000","last_became_active":"2024-01-30T08:09:53.888512+0000","last_became_peered":"2024-01-30T08:09:53.888512+0000","last_unstale":"2024-01-30T08:09:55.727978+0000","last_undegraded":"2024-01-30T08:09:55.727978+0000","last_fullsized":"2024-01-30T08:09:55.727978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:19.673462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881407+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:09:53.881407+0000","last_peered":"2024-01-30T08:09:53.881407+0000","last_clean":"2024-01-30T08:09:53.881407+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:09:53.881407+0000","last_undegraded":"2024-01-30T08:09:53.881407+0000","last_fullsized":"2024-01-30T08:09:53.881407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:12.825632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875171+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:09:53.875171+0000","last_peered":"2024-01-30T08:09:53.875171+0000","last_clean":"2024-01-30T08:09:53.875171+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:09:53.875171+0000","last_undegraded":"2024-01-30T08:09:53.875171+0000","last_fullsized":"2024-01-30T08:09:53.875171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:14:32.567638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.895589+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:09:53.895589+0000","last_peered":"2024-01-30T08:09:53.895589+0000","last_clean":"2024-01-30T08:09:53.895589+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:09:53.895589+0000","last_undegraded":"2024-01-30T08:09:53.895589+0000","last_fullsized":"2024-01-30T08:09:53.895589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060737+0000","last_change":"2024-01-30T08:09:53.884011+0000","last_active":"2024-01-30T08:09:56.060737+0000","last_peered":"2024-01-30T08:09:56.060737+0000","last_clean":"2024-01-30T08:09:56.060737+0000","last_became_active":"2024-01-30T08:09:53.881881+0000","last_became_peered":"2024-01-30T08:09:53.881881+0000","last_unstale":"2024-01-30T08:09:56.060737+0000","last_undegraded":"2024-01-30T08:09:56.060737+0000","last_fullsized":"2024-01-30T08:09:56.060737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:04:50.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866131+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:09:54.866131+0000","last_peered":"2024-01-30T08:09:54.866131+0000","last_clean":"2024-01-30T08:09:54.866131+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:09:54.866131+0000","last_undegraded":"2024-01-30T08:09:54.866131+0000","last_fullsized":"2024-01-30T08:09:54.866131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728330+0000","last_change":"2024-01-30T08:09:53.887909+0000","last_active":"2024-01-30T08:09:55.728330+0000","last_peered":"2024-01-30T08:09:55.728330+0000","last_clean":"2024-01-30T08:09:55.728330+0000","last_became_active":"2024-01-30T08:09:53.887634+0000","last_became_peered":"2024-01-30T08:09:53.887634+0000","last_unstale":"2024-01-30T08:09:55.728330+0000","last_undegraded":"2024-01-30T08:09:55.728330+0000","last_fullsized":"2024-01-30T08:09:55.728330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:52.921864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061135+0000","last_change":"2024-01-30T08:09:53.883502+0000","last_active":"2024-01-30T08:09:56.061135+0000","last_peered":"2024-01-30T08:09:56.061135+0000","last_clean":"2024-01-30T08:09:56.061135+0000","last_became_active":"2024-01-30T08:09:53.883146+0000","last_became_peered":"2024-01-30T08:09:53.883146+0000","last_unstale":"2024-01-30T08:09:56.061135+0000","last_undegraded":"2024-01-30T08:09:56.061135+0000","last_fullsized":"2024-01-30T08:09:56.061135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:13.134749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061173+0000","last_change":"2024-01-30T08:09:53.883798+0000","last_active":"2024-01-30T08:09:56.061173+0000","last_peered":"2024-01-30T08:09:56.061173+0000","last_clean":"2024-01-30T08:09:56.061173+0000","last_became_active":"2024-01-30T08:09:53.883077+0000","last_became_peered":"2024-01-30T08:09:53.883077+0000","last_unstale":"2024-01-30T08:09:56.061173+0000","last_undegraded":"2024-01-30T08:09:56.061173+0000","last_fullsized":"2024-01-30T08:09:56.061173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:40.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727926+0000","last_change":"2024-01-30T08:09:53.880237+0000","last_active":"2024-01-30T08:09:55.727926+0000","last_peered":"2024-01-30T08:09:55.727926+0000","last_clean":"2024-01-30T08:09:55.727926+0000","last_became_active":"2024-01-30T08:09:53.879920+0000","last_became_peered":"2024-01-30T08:09:53.879920+0000","last_unstale":"2024-01-30T08:09:55.727926+0000","last_undegraded":"2024-01-30T08:09:55.727926+0000","last_fullsized":"2024-01-30T08:09:55.727926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:31:19.905033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060943+0000","last_change":"2024-01-30T08:09:53.879036+0000","last_active":"2024-01-30T08:09:56.060943+0000","last_peered":"2024-01-30T08:09:56.060943+0000","last_clean":"2024-01-30T08:09:56.060943+0000","last_became_active":"2024-01-30T08:09:53.878757+0000","last_became_peered":"2024-01-30T08:09:53.878757+0000","last_unstale":"2024-01-30T08:09:56.060943+0000","last_undegraded":"2024-01-30T08:09:56.060943+0000","last_fullsized":"2024-01-30T08:09:56.060943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:32:50.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866488+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:09:54.866488+0000","last_peered":"2024-01-30T08:09:54.866488+0000","last_clean":"2024-01-30T08:09:54.866488+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:09:54.866488+0000","last_undegraded":"2024-01-30T08:09:54.866488+0000","last_fullsized":"2024-01-30T08:09:54.866488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060691+0000","last_change":"2024-01-30T08:09:53.886393+0000","last_active":"2024-01-30T08:09:56.060691+0000","last_peered":"2024-01-30T08:09:56.060691+0000","last_clean":"2024-01-30T08:09:56.060691+0000","last_became_active":"2024-01-30T08:09:53.881749+0000","last_became_peered":"2024-01-30T08:09:53.881749+0000","last_unstale":"2024-01-30T08:09:56.060691+0000","last_undegraded":"2024-01-30T08:09:56.060691+0000","last_fullsized":"2024-01-30T08:09:56.060691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:22.523025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891438+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:09:53.891438+0000","last_peered":"2024-01-30T08:09:53.891438+0000","last_clean":"2024-01-30T08:09:53.891438+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:09:53.891438+0000","last_undegraded":"2024-01-30T08:09:53.891438+0000","last_fullsized":"2024-01-30T08:09:53.891438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891891+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:09:53.891891+0000","last_peered":"2024-01-30T08:09:53.891891+0000","last_clean":"2024-01-30T08:09:53.891891+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:09:53.891891+0000","last_undegraded":"2024-01-30T08:09:53.891891+0000","last_fullsized":"2024-01-30T08:09:53.891891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867419+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:09:54.867419+0000","last_peered":"2024-01-30T08:09:54.867419+0000","last_clean":"2024-01-30T08:09:54.867419+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:09:54.867419+0000","last_undegraded":"2024-01-30T08:09:54.867419+0000","last_fullsized":"2024-01-30T08:09:54.867419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.886526+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:09:53.886526+0000","last_peered":"2024-01-30T08:09:53.886526+0000","last_clean":"2024-01-30T08:09:53.886526+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:09:53.886526+0000","last_undegraded":"2024-01-30T08:09:53.886526+0000","last_fullsized":"2024-01-30T08:09:53.886526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:42.377477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867251+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:09:54.867251+0000","last_peered":"2024-01-30T08:09:54.867251+0000","last_clean":"2024-01-30T08:09:54.867251+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:09:54.867251+0000","last_undegraded":"2024-01-30T08:09:54.867251+0000","last_fullsized":"2024-01-30T08:09:54.867251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060982+0000","last_change":"2024-01-30T08:09:53.884047+0000","last_active":"2024-01-30T08:09:56.060982+0000","last_peered":"2024-01-30T08:09:56.060982+0000","last_clean":"2024-01-30T08:09:56.060982+0000","last_became_active":"2024-01-30T08:09:53.883765+0000","last_became_peered":"2024-01-30T08:09:53.883765+0000","last_unstale":"2024-01-30T08:09:56.060982+0000","last_undegraded":"2024-01-30T08:09:56.060982+0000","last_fullsized":"2024-01-30T08:09:56.060982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:54:01.174660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866793+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:09:54.866793+0000","last_peered":"2024-01-30T08:09:54.866793+0000","last_clean":"2024-01-30T08:09:54.866793+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:09:54.866793+0000","last_undegraded":"2024-01-30T08:09:54.866793+0000","last_fullsized":"2024-01-30T08:09:54.866793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892219+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:09:53.892219+0000","last_peered":"2024-01-30T08:09:53.892219+0000","last_clean":"2024-01-30T08:09:53.892219+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:09:53.892219+0000","last_undegraded":"2024-01-30T08:09:53.892219+0000","last_fullsized":"2024-01-30T08:09:53.892219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890815+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:09:53.890815+0000","last_peered":"2024-01-30T08:09:53.890815+0000","last_clean":"2024-01-30T08:09:53.890815+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:09:53.890815+0000","last_undegraded":"2024-01-30T08:09:53.890815+0000","last_fullsized":"2024-01-30T08:09:53.890815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:37.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867410+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:09:54.867410+0000","last_peered":"2024-01-30T08:09:54.867410+0000","last_clean":"2024-01-30T08:09:54.867410+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:09:54.867410+0000","last_undegraded":"2024-01-30T08:09:54.867410+0000","last_fullsized":"2024-01-30T08:09:54.867410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890622+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:09:53.890622+0000","last_peered":"2024-01-30T08:09:53.890622+0000","last_clean":"2024-01-30T08:09:53.890622+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:09:53.890622+0000","last_undegraded":"2024-01-30T08:09:53.890622+0000","last_fullsized":"2024-01-30T08:09:53.890622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867532+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:09:54.867532+0000","last_peered":"2024-01-30T08:09:54.867532+0000","last_clean":"2024-01-30T08:09:54.867532+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:09:54.867532+0000","last_undegraded":"2024-01-30T08:09:54.867532+0000","last_fullsized":"2024-01-30T08:09:54.867532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061055+0000","last_change":"2024-01-30T08:09:53.881127+0000","last_active":"2024-01-30T08:09:56.061055+0000","last_peered":"2024-01-30T08:09:56.061055+0000","last_clean":"2024-01-30T08:09:56.061055+0000","last_became_active":"2024-01-30T08:09:53.880821+0000","last_became_peered":"2024-01-30T08:09:53.880821+0000","last_unstale":"2024-01-30T08:09:56.061055+0000","last_undegraded":"2024-01-30T08:09:56.061055+0000","last_fullsized":"2024-01-30T08:09:56.061055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:34:00.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867588+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:09:54.867588+0000","last_peered":"2024-01-30T08:09:54.867588+0000","last_clean":"2024-01-30T08:09:54.867588+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:09:54.867588+0000","last_undegraded":"2024-01-30T08:09:54.867588+0000","last_fullsized":"2024-01-30T08:09:54.867588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867228+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:09:54.867228+0000","last_peered":"2024-01-30T08:09:54.867228+0000","last_clean":"2024-01-30T08:09:54.867228+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:09:54.867228+0000","last_undegraded":"2024-01-30T08:09:54.867228+0000","last_fullsized":"2024-01-30T08:09:54.867228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891248+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:09:53.891248+0000","last_peered":"2024-01-30T08:09:53.891248+0000","last_clean":"2024-01-30T08:09:53.891248+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:09:53.891248+0000","last_undegraded":"2024-01-30T08:09:53.891248+0000","last_fullsized":"2024-01-30T08:09:53.891248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893973+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:09:53.893973+0000","last_peered":"2024-01-30T08:09:53.893973+0000","last_clean":"2024-01-30T08:09:53.893973+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:09:53.893973+0000","last_undegraded":"2024-01-30T08:09:53.893973+0000","last_fullsized":"2024-01-30T08:09:53.893973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891153+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:09:53.891153+0000","last_peered":"2024-01-30T08:09:53.891153+0000","last_clean":"2024-01-30T08:09:53.891153+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:09:53.891153+0000","last_undegraded":"2024-01-30T08:09:53.891153+0000","last_fullsized":"2024-01-30T08:09:53.891153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867365+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:09:54.867365+0000","last_peered":"2024-01-30T08:09:54.867365+0000","last_clean":"2024-01-30T08:09:54.867365+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:09:54.867365+0000","last_undegraded":"2024-01-30T08:09:54.867365+0000","last_fullsized":"2024-01-30T08:09:54.867365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889611+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:09:53.889611+0000","last_peered":"2024-01-30T08:09:53.889611+0000","last_clean":"2024-01-30T08:09:53.889611+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:09:53.889611+0000","last_undegraded":"2024-01-30T08:09:53.889611+0000","last_fullsized":"2024-01-30T08:09:53.889611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728135+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:09:55.728135+0000","last_peered":"2024-01-30T08:09:55.728135+0000","last_clean":"2024-01-30T08:09:55.728135+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:09:55.728135+0000","last_undegraded":"2024-01-30T08:09:55.728135+0000","last_fullsized":"2024-01-30T08:09:55.728135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866710+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:09:54.866710+0000","last_peered":"2024-01-30T08:09:54.866710+0000","last_clean":"2024-01-30T08:09:54.866710+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:09:54.866710+0000","last_undegraded":"2024-01-30T08:09:54.866710+0000","last_fullsized":"2024-01-30T08:09:54.866710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940179+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:09:53.940179+0000","last_peered":"2024-01-30T08:09:53.940179+0000","last_clean":"2024-01-30T08:09:53.940179+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:09:53.940179+0000","last_undegraded":"2024-01-30T08:09:53.940179+0000","last_fullsized":"2024-01-30T08:09:53.940179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866856+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:09:54.866856+0000","last_peered":"2024-01-30T08:09:54.866856+0000","last_clean":"2024-01-30T08:09:54.866856+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:09:54.866856+0000","last_undegraded":"2024-01-30T08:09:54.866856+0000","last_fullsized":"2024-01-30T08:09:54.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866448+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:09:54.866448+0000","last_peered":"2024-01-30T08:09:54.866448+0000","last_clean":"2024-01-30T08:09:54.866448+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:09:54.866448+0000","last_undegraded":"2024-01-30T08:09:54.866448+0000","last_fullsized":"2024-01-30T08:09:54.866448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727765+0000","last_change":"2024-01-30T08:09:53.881438+0000","last_active":"2024-01-30T08:09:55.727765+0000","last_peered":"2024-01-30T08:09:55.727765+0000","last_clean":"2024-01-30T08:09:55.727765+0000","last_became_active":"2024-01-30T08:09:53.881166+0000","last_became_peered":"2024-01-30T08:09:53.881166+0000","last_unstale":"2024-01-30T08:09:55.727765+0000","last_undegraded":"2024-01-30T08:09:55.727765+0000","last_fullsized":"2024-01-30T08:09:55.727765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:37.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061089+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:09:56.061089+0000","last_peered":"2024-01-30T08:09:56.061089+0000","last_clean":"2024-01-30T08:09:56.061089+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:09:56.061089+0000","last_undegraded":"2024-01-30T08:09:56.061089+0000","last_fullsized":"2024-01-30T08:09:56.061089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:43.172388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060924+0000","last_change":"2024-01-30T08:09:53.881466+0000","last_active":"2024-01-30T08:09:56.060924+0000","last_peered":"2024-01-30T08:09:56.060924+0000","last_clean":"2024-01-30T08:09:56.060924+0000","last_became_active":"2024-01-30T08:09:53.880847+0000","last_became_peered":"2024-01-30T08:09:53.880847+0000","last_unstale":"2024-01-30T08:09:56.060924+0000","last_undegraded":"2024-01-30T08:09:56.060924+0000","last_fullsized":"2024-01-30T08:09:56.060924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:24:30.424249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.938191+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:09:53.938191+0000","last_peered":"2024-01-30T08:09:53.938191+0000","last_clean":"2024-01-30T08:09:53.938191+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:09:53.938191+0000","last_undegraded":"2024-01-30T08:09:53.938191+0000","last_fullsized":"2024-01-30T08:09:53.938191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866823+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:09:54.866823+0000","last_peered":"2024-01-30T08:09:54.866823+0000","last_clean":"2024-01-30T08:09:54.866823+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:09:54.866823+0000","last_undegraded":"2024-01-30T08:09:54.866823+0000","last_fullsized":"2024-01-30T08:09:54.866823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873889+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:09:53.873889+0000","last_peered":"2024-01-30T08:09:53.873889+0000","last_clean":"2024-01-30T08:09:53.873889+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:09:53.873889+0000","last_undegraded":"2024-01-30T08:09:53.873889+0000","last_fullsized":"2024-01-30T08:09:53.873889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866287+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:09:54.866287+0000","last_peered":"2024-01-30T08:09:54.866287+0000","last_clean":"2024-01-30T08:09:54.866287+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:09:54.866287+0000","last_undegraded":"2024-01-30T08:09:54.866287+0000","last_fullsized":"2024-01-30T08:09:54.866287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866091+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:09:54.866091+0000","last_peered":"2024-01-30T08:09:54.866091+0000","last_clean":"2024-01-30T08:09:54.866091+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:09:54.866091+0000","last_undegraded":"2024-01-30T08:09:54.866091+0000","last_fullsized":"2024-01-30T08:09:54.866091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.881427+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:09:53.881427+0000","last_peered":"2024-01-30T08:09:53.881427+0000","last_clean":"2024-01-30T08:09:53.881427+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:09:53.881427+0000","last_undegraded":"2024-01-30T08:09:53.881427+0000","last_fullsized":"2024-01-30T08:09:53.881427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:17.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866901+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:09:54.866901+0000","last_peered":"2024-01-30T08:09:54.866901+0000","last_clean":"2024-01-30T08:09:54.866901+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:09:54.866901+0000","last_undegraded":"2024-01-30T08:09:54.866901+0000","last_fullsized":"2024-01-30T08:09:54.866901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888571+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:09:53.888571+0000","last_peered":"2024-01-30T08:09:53.888571+0000","last_clean":"2024-01-30T08:09:53.888571+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:09:53.888571+0000","last_undegraded":"2024-01-30T08:09:53.888571+0000","last_fullsized":"2024-01-30T08:09:53.888571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061352+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:09:56.061352+0000","last_peered":"2024-01-30T08:09:56.061352+0000","last_clean":"2024-01-30T08:09:56.061352+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:09:56.061352+0000","last_undegraded":"2024-01-30T08:09:56.061352+0000","last_fullsized":"2024-01-30T08:09:56.061352+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:37.710856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727993+0000","last_change":"2024-01-30T08:09:53.883329+0000","last_active":"2024-01-30T08:09:55.727993+0000","last_peered":"2024-01-30T08:09:55.727993+0000","last_clean":"2024-01-30T08:09:55.727993+0000","last_became_active":"2024-01-30T08:09:53.881025+0000","last_became_peered":"2024-01-30T08:09:53.881025+0000","last_unstale":"2024-01-30T08:09:55.727993+0000","last_undegraded":"2024-01-30T08:09:55.727993+0000","last_fullsized":"2024-01-30T08:09:55.727993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:38.717964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061356+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:09:56.061356+0000","last_peered":"2024-01-30T08:09:56.061356+0000","last_clean":"2024-01-30T08:09:56.061356+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:09:56.061356+0000","last_undegraded":"2024-01-30T08:09:56.061356+0000","last_fullsized":"2024-01-30T08:09:56.061356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:51.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866544+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:09:54.866544+0000","last_peered":"2024-01-30T08:09:54.866544+0000","last_clean":"2024-01-30T08:09:54.866544+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:09:54.866544+0000","last_undegraded":"2024-01-30T08:09:54.866544+0000","last_fullsized":"2024-01-30T08:09:54.866544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866416+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:09:54.866416+0000","last_peered":"2024-01-30T08:09:54.866416+0000","last_clean":"2024-01-30T08:09:54.866416+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:09:54.866416+0000","last_undegraded":"2024-01-30T08:09:54.866416+0000","last_fullsized":"2024-01-30T08:09:54.866416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727822+0000","last_change":"2024-01-30T08:09:53.889988+0000","last_active":"2024-01-30T08:09:55.727822+0000","last_peered":"2024-01-30T08:09:55.727822+0000","last_clean":"2024-01-30T08:09:55.727822+0000","last_became_active":"2024-01-30T08:09:53.888579+0000","last_became_peered":"2024-01-30T08:09:53.888579+0000","last_unstale":"2024-01-30T08:09:55.727822+0000","last_undegraded":"2024-01-30T08:09:55.727822+0000","last_fullsized":"2024-01-30T08:09:55.727822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:01:50.624934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866446+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:09:54.866446+0000","last_peered":"2024-01-30T08:09:54.866446+0000","last_clean":"2024-01-30T08:09:54.866446+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:09:54.866446+0000","last_undegraded":"2024-01-30T08:09:54.866446+0000","last_fullsized":"2024-01-30T08:09:54.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866128+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:09:54.866128+0000","last_peered":"2024-01-30T08:09:54.866128+0000","last_clean":"2024-01-30T08:09:54.866128+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:09:54.866128+0000","last_undegraded":"2024-01-30T08:09:54.866128+0000","last_fullsized":"2024-01-30T08:09:54.866128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.875608+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:09:53.875608+0000","last_peered":"2024-01-30T08:09:53.875608+0000","last_clean":"2024-01-30T08:09:53.875608+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:09:53.875608+0000","last_undegraded":"2024-01-30T08:09:53.875608+0000","last_fullsized":"2024-01-30T08:09:53.875608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.891268+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:09:53.891268+0000","last_peered":"2024-01-30T08:09:53.891268+0000","last_clean":"2024-01-30T08:09:53.891268+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:09:53.891268+0000","last_undegraded":"2024-01-30T08:09:53.891268+0000","last_fullsized":"2024-01-30T08:09:53.891268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866862+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:09:54.866862+0000","last_peered":"2024-01-30T08:09:54.866862+0000","last_clean":"2024-01-30T08:09:54.866862+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:09:54.866862+0000","last_undegraded":"2024-01-30T08:09:54.866862+0000","last_fullsized":"2024-01-30T08:09:54.866862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866330+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:09:54.866330+0000","last_peered":"2024-01-30T08:09:54.866330+0000","last_clean":"2024-01-30T08:09:54.866330+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:09:54.866330+0000","last_undegraded":"2024-01-30T08:09:54.866330+0000","last_fullsized":"2024-01-30T08:09:54.866330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.941256+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:09:53.941256+0000","last_peered":"2024-01-30T08:09:53.941256+0000","last_clean":"2024-01-30T08:09:53.941256+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:09:53.941256+0000","last_undegraded":"2024-01-30T08:09:53.941256+0000","last_fullsized":"2024-01-30T08:09:53.941256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866363+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:09:54.866363+0000","last_peered":"2024-01-30T08:09:54.866363+0000","last_clean":"2024-01-30T08:09:54.866363+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:09:54.866363+0000","last_undegraded":"2024-01-30T08:09:54.866363+0000","last_fullsized":"2024-01-30T08:09:54.866363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061451+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:09:56.061451+0000","last_peered":"2024-01-30T08:09:56.061451+0000","last_clean":"2024-01-30T08:09:56.061451+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:09:56.061451+0000","last_undegraded":"2024-01-30T08:09:56.061451+0000","last_fullsized":"2024-01-30T08:09:56.061451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:36.960284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061389+0000","last_change":"2024-01-30T08:09:53.883122+0000","last_active":"2024-01-30T08:09:56.061389+0000","last_peered":"2024-01-30T08:09:56.061389+0000","last_clean":"2024-01-30T08:09:56.061389+0000","last_became_active":"2024-01-30T08:09:53.882631+0000","last_became_peered":"2024-01-30T08:09:53.882631+0000","last_unstale":"2024-01-30T08:09:56.061389+0000","last_undegraded":"2024-01-30T08:09:56.061389+0000","last_fullsized":"2024-01-30T08:09:56.061389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:41.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866781+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:09:54.866781+0000","last_peered":"2024-01-30T08:09:54.866781+0000","last_clean":"2024-01-30T08:09:54.866781+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:09:54.866781+0000","last_undegraded":"2024-01-30T08:09:54.866781+0000","last_fullsized":"2024-01-30T08:09:54.866781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866674+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:09:54.866674+0000","last_peered":"2024-01-30T08:09:54.866674+0000","last_clean":"2024-01-30T08:09:54.866674+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:09:54.866674+0000","last_undegraded":"2024-01-30T08:09:54.866674+0000","last_fullsized":"2024-01-30T08:09:54.866674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.940428+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:09:53.940428+0000","last_peered":"2024-01-30T08:09:53.940428+0000","last_clean":"2024-01-30T08:09:53.940428+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:09:53.940428+0000","last_undegraded":"2024-01-30T08:09:53.940428+0000","last_fullsized":"2024-01-30T08:09:53.940428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.890710+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:09:53.890710+0000","last_peered":"2024-01-30T08:09:53.890710+0000","last_clean":"2024-01-30T08:09:53.890710+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:09:53.890710+0000","last_undegraded":"2024-01-30T08:09:53.890710+0000","last_fullsized":"2024-01-30T08:09:53.890710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:11:28.469716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.873459+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:09:53.873459+0000","last_peered":"2024-01-30T08:09:53.873459+0000","last_clean":"2024-01-30T08:09:53.873459+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:09:53.873459+0000","last_undegraded":"2024-01-30T08:09:53.873459+0000","last_fullsized":"2024-01-30T08:09:53.873459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.892220+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:09:53.892220+0000","last_peered":"2024-01-30T08:09:53.892220+0000","last_clean":"2024-01-30T08:09:53.892220+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:09:53.892220+0000","last_undegraded":"2024-01-30T08:09:53.892220+0000","last_fullsized":"2024-01-30T08:09:53.892220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.939996+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:09:53.939996+0000","last_peered":"2024-01-30T08:09:53.939996+0000","last_clean":"2024-01-30T08:09:53.939996+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:09:53.939996+0000","last_undegraded":"2024-01-30T08:09:53.939996+0000","last_fullsized":"2024-01-30T08:09:53.939996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728159+0000","last_change":"2024-01-30T08:09:53.883346+0000","last_active":"2024-01-30T08:09:55.728159+0000","last_peered":"2024-01-30T08:09:55.728159+0000","last_clean":"2024-01-30T08:09:55.728159+0000","last_became_active":"2024-01-30T08:09:53.878878+0000","last_became_peered":"2024-01-30T08:09:53.878878+0000","last_unstale":"2024-01-30T08:09:55.728159+0000","last_undegraded":"2024-01-30T08:09:55.728159+0000","last_fullsized":"2024-01-30T08:09:55.728159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:52.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864882+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:09:53.864882+0000","last_peered":"2024-01-30T08:09:53.864882+0000","last_clean":"2024-01-30T08:09:53.864882+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:09:53.864882+0000","last_undegraded":"2024-01-30T08:09:53.864882+0000","last_fullsized":"2024-01-30T08:09:53.864882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060916+0000","last_change":"2024-01-30T08:09:53.886717+0000","last_active":"2024-01-30T08:09:56.060916+0000","last_peered":"2024-01-30T08:09:56.060916+0000","last_clean":"2024-01-30T08:09:56.060916+0000","last_became_active":"2024-01-30T08:09:53.884242+0000","last_became_peered":"2024-01-30T08:09:53.884242+0000","last_unstale":"2024-01-30T08:09:56.060916+0000","last_undegraded":"2024-01-30T08:09:56.060916+0000","last_fullsized":"2024-01-30T08:09:56.060916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:05.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.871973+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:09:53.871973+0000","last_peered":"2024-01-30T08:09:53.871973+0000","last_clean":"2024-01-30T08:09:53.871973+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:09:53.871973+0000","last_undegraded":"2024-01-30T08:09:53.871973+0000","last_fullsized":"2024-01-30T08:09:53.871973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866449+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:09:54.866449+0000","last_peered":"2024-01-30T08:09:54.866449+0000","last_clean":"2024-01-30T08:09:54.866449+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:09:54.866449+0000","last_undegraded":"2024-01-30T08:09:54.866449+0000","last_fullsized":"2024-01-30T08:09:54.866449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.864990+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:09:53.864990+0000","last_peered":"2024-01-30T08:09:53.864990+0000","last_clean":"2024-01-30T08:09:53.864990+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:09:53.864990+0000","last_undegraded":"2024-01-30T08:09:53.864990+0000","last_fullsized":"2024-01-30T08:09:53.864990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889661+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:09:53.889661+0000","last_peered":"2024-01-30T08:09:53.889661+0000","last_clean":"2024-01-30T08:09:53.889661+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:09:53.889661+0000","last_undegraded":"2024-01-30T08:09:53.889661+0000","last_fullsized":"2024-01-30T08:09:53.889661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061516+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:09:56.061516+0000","last_peered":"2024-01-30T08:09:56.061516+0000","last_clean":"2024-01-30T08:09:56.061516+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:09:56.061516+0000","last_undegraded":"2024-01-30T08:09:56.061516+0000","last_fullsized":"2024-01-30T08:09:56.061516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:51.914756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.888593+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:09:53.888593+0000","last_peered":"2024-01-30T08:09:53.888593+0000","last_clean":"2024-01-30T08:09:53.888593+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:09:53.888593+0000","last_undegraded":"2024-01-30T08:09:53.888593+0000","last_fullsized":"2024-01-30T08:09:53.888593+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.865627+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:09:53.865627+0000","last_peered":"2024-01-30T08:09:53.865627+0000","last_clean":"2024-01-30T08:09:53.865627+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:09:53.865627+0000","last_undegraded":"2024-01-30T08:09:53.865627+0000","last_fullsized":"2024-01-30T08:09:53.865627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866673+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:09:54.866673+0000","last_peered":"2024-01-30T08:09:54.866673+0000","last_clean":"2024-01-30T08:09:54.866673+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:09:54.866673+0000","last_undegraded":"2024-01-30T08:09:54.866673+0000","last_fullsized":"2024-01-30T08:09:54.866673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727979+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:09:55.727979+0000","last_peered":"2024-01-30T08:09:55.727979+0000","last_clean":"2024-01-30T08:09:55.727979+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:09:55.727979+0000","last_undegraded":"2024-01-30T08:09:55.727979+0000","last_fullsized":"2024-01-30T08:09:55.727979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:30:27.351725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728049+0000","last_change":"2024-01-30T08:09:53.882768+0000","last_active":"2024-01-30T08:09:55.728049+0000","last_peered":"2024-01-30T08:09:55.728049+0000","last_clean":"2024-01-30T08:09:55.728049+0000","last_became_active":"2024-01-30T08:09:53.882430+0000","last_became_peered":"2024-01-30T08:09:53.882430+0000","last_unstale":"2024-01-30T08:09:55.728049+0000","last_undegraded":"2024-01-30T08:09:55.728049+0000","last_fullsized":"2024-01-30T08:09:55.728049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:58.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728185+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:09:55.728185+0000","last_peered":"2024-01-30T08:09:55.728185+0000","last_clean":"2024-01-30T08:09:55.728185+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:09:55.728185+0000","last_undegraded":"2024-01-30T08:09:55.728185+0000","last_fullsized":"2024-01-30T08:09:55.728185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.893904+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:09:53.893904+0000","last_peered":"2024-01-30T08:09:53.893904+0000","last_clean":"2024-01-30T08:09:53.893904+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:09:53.893904+0000","last_undegraded":"2024-01-30T08:09:53.893904+0000","last_fullsized":"2024-01-30T08:09:53.893904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867208+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:09:54.867208+0000","last_peered":"2024-01-30T08:09:54.867208+0000","last_clean":"2024-01-30T08:09:54.867208+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:09:54.867208+0000","last_undegraded":"2024-01-30T08:09:54.867208+0000","last_fullsized":"2024-01-30T08:09:54.867208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866671+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:09:54.866671+0000","last_peered":"2024-01-30T08:09:54.866671+0000","last_clean":"2024-01-30T08:09:54.866671+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:09:54.866671+0000","last_undegraded":"2024-01-30T08:09:54.866671+0000","last_fullsized":"2024-01-30T08:09:54.866671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866042+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:09:54.866042+0000","last_peered":"2024-01-30T08:09:54.866042+0000","last_clean":"2024-01-30T08:09:54.866042+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:09:54.866042+0000","last_undegraded":"2024-01-30T08:09:54.866042+0000","last_fullsized":"2024-01-30T08:09:54.866042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.889868+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:09:53.889868+0000","last_peered":"2024-01-30T08:09:53.889868+0000","last_clean":"2024-01-30T08:09:53.889868+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:09:53.889868+0000","last_undegraded":"2024-01-30T08:09:53.889868+0000","last_fullsized":"2024-01-30T08:09:53.889868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866145+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:09:54.866145+0000","last_peered":"2024-01-30T08:09:54.866145+0000","last_clean":"2024-01-30T08:09:54.866145+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:09:54.866145+0000","last_undegraded":"2024-01-30T08:09:54.866145+0000","last_fullsized":"2024-01-30T08:09:54.866145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061352+0000","last_change":"2024-01-30T08:09:53.893858+0000","last_active":"2024-01-30T08:09:56.061352+0000","last_peered":"2024-01-30T08:09:56.061352+0000","last_clean":"2024-01-30T08:09:56.061352+0000","last_became_active":"2024-01-30T08:09:53.893613+0000","last_became_peered":"2024-01-30T08:09:53.893613+0000","last_unstale":"2024-01-30T08:09:56.061352+0000","last_undegraded":"2024-01-30T08:09:56.061352+0000","last_fullsized":"2024-01-30T08:09:56.061352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:09.834509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874866+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:09:53.874866+0000","last_peered":"2024-01-30T08:09:53.874866+0000","last_clean":"2024-01-30T08:09:53.874866+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:09:53.874866+0000","last_undegraded":"2024-01-30T08:09:53.874866+0000","last_fullsized":"2024-01-30T08:09:53.874866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-30T08:09:53.874458+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:09:53.874458+0000","last_peered":"2024-01-30T08:09:53.874458+0000","last_clean":"2024-01-30T08:09:53.874458+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:09:53.874458+0000","last_undegraded":"2024-01-30T08:09:53.874458+0000","last_fullsized":"2024-01-30T08:09:53.874458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":777383,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.874}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.442}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68400000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.46500000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.754},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":185937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60599999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":186979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.316},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.78200000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.76600000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80800000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39600000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.502}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":185423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.96899999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.871}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.016}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":192065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.79800000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.98399999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.121},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.872}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0720000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":782355,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.153},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.91100000000000003}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.012}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.1819999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:02.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023f800640 1 Processor -- start 2024-01-30T08:10:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023f800640 1 -- start start 2024-01-30T08:10:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023f800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f023806de40 0x7f023806e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023f800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0238152f00 con 0x7f02380c4310 2024-01-30T08:10:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023f800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02381525f0 con 0x7f0238153390 2024-01-30T08:10:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023f800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380a7680 con 0x7f023806de40 2024-01-30T08:10:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023d800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02380c4310 0x7f0238155be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39368/0 (socket says 172.21.15.50:39368) 2024-01-30T08:10:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023d800640 1 -- 172.21.15.50:0/1805123833 learned_addr learned my addr 172.21.15.50:0/1805123833 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023ce00640 1 --2- 172.21.15.50:0/1805123833 >> v2:172.21.15.125:3300/0 conn(0x7f023806de40 0x7f023806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503817104 0 0) 0x7f0238152f00 con 0x7f02380c4310 2024-01-30T08:10:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0218003530 con 0x7f02380c4310 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880301372 0 0) 0x7f02381525f0 con 0x7f0238153390 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0238152f00 con 0x7f0238153390 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3158615135 0 0) 0x7f0218003530 con 0x7f02380c4310 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 >> v2:172.21.15.125:3300/0 conn(0x7f023806de40 msgr2=0x7f023806e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 --2- 172.21.15.50:0/1805123833 >> v2:172.21.15.125:3300/0 conn(0x7f023806de40 0x7f023806e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 >> v1:172.21.15.125:6789/0 conn(0x7f0238153390 legacy=0x7f02380a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02381528b0 con 0x7f02380c4310 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f0230001a00 con 0x7f02380c4310 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 >> v1:172.21.15.50:6789/0 conn(0x7f02380c4310 legacy=0x7f0238155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0218003b60 0x7f0218003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02180047d0 0x7f0218004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0218005250 0x7f021800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380a7680 con 0x7f02180047d0 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021800c190 con 0x7f0218003b60 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021800c350 con 0x7f0218005250 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237e00640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02180047d0 0x7f0218004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023ce00640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0218003b60 0x7f0218003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023d800640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0218005250 0x7f021800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237e00640 1 -- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0218005250 msgr2=0x7f021800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237e00640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0218005250 0x7f021800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237e00640 1 -- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0218003b60 msgr2=0x7f0218003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237e00640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0218003b60 0x7f0218003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f0237e00640 1 -- 172.21.15.50:0/1805123833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218003530 con 0x7f02180047d0 2024-01-30T08:10:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.777+0000 7f023d800640 1 -- 172.21.15.50:0/1805123833 reap_dead start 2024-01-30T08:10:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f0237e00640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02180047d0 0x7f0218004c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0238072200 tx=0x7f022001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebe9868eb1837ba server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200052d0 con 0x7f02180047d0 2024-01-30T08:10:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220005450 con 0x7f02180047d0 2024-01-30T08:10:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f0237400640 1 -- 172.21.15.50:0/1805123833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220003840 con 0x7f02180047d0 2024-01-30T08:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f023f800640 1 -- 172.21.15.50:0/1805123833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02180047d0 msgr2=0x7f0218004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f023f800640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02180047d0 0x7f0218004c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0238072200 tx=0x7f022001c510 comp rx=0 tx=0).stop 2024-01-30T08:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f023f800640 1 -- 172.21.15.50:0/1805123833 shutdown_connections 2024-01-30T08:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f023f800640 1 --2- 172.21.15.50:0/1805123833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02180047d0 0x7f0218004c50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.781+0000 7f023f800640 1 -- 172.21.15.50:0/1805123833 >> 172.21.15.50:0/1805123833 conn(0x7f02380c4830 msgr2=0x7f02380c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 -- 172.21.15.50:0/1805123833 shutdown_connections 2024-01-30T08:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 -- 172.21.15.50:0/1805123833 wait complete. 2024-01-30T08:10:02.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 Processor -- start 2024-01-30T08:10:02.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 -- start start 2024-01-30T08:10:02.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02180047d0 0x7f02381ee190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380ad3b0 0x7f023814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02380a94f0 0x7f02380a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02381f0d00 con 0x7f02380ad3b0 2024-01-30T08:10:02.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023814a9b0 con 0x7f02380a94f0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023f800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380aa270 con 0x7f02180047d0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380ad3b0 0x7f023814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380ad3b0 0x7f023814a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35708/0 (socket says 172.21.15.50:35708) 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 -- 172.21.15.50:0/2462435961 learned_addr learned my addr 172.21.15.50:0/2462435961 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023ce00640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02180047d0 0x7f02381ee190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f023d800640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02380a94f0 0x7f02380a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 -- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02180047d0 msgr2=0x7f02381ee190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02180047d0 0x7f02381ee190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 -- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02380a94f0 msgr2=0x7f02380a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02380a94f0 0x7f02380a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 -- 172.21.15.50:0/2462435961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02381f0f50 con 0x7f02380ad3b0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.785+0000 7f0237e00640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380ad3b0 0x7f023814a470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0220005040 tx=0x7f0218005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f0234c00640 1 -- 172.21.15.50:0/2462435961 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220003e60 con 0x7f02380ad3b0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f0234c00640 1 -- 172.21.15.50:0/2462435961 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02200052e0 con 0x7f02380ad3b0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f0234c00640 1 -- 172.21.15.50:0/2462435961 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220006a00 con 0x7f02380ad3b0 2024-01-30T08:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02381f1230 con 0x7f02380ad3b0 2024-01-30T08:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02381f17f0 con 0x7f02380ad3b0 2024-01-30T08:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0238074a20 con 0x7f02380ad3b0 2024-01-30T08:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f0234c00640 1 -- 172.21.15.50:0/2462435961 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f02200b2040 con 0x7f02380ad3b0 2024-01-30T08:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f0234c00640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0210066530 0x7f02100689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f0234c00640 1 -- 172.21.15.50:0/2462435961 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f022011dd70 con 0x7f02380ad3b0 2024-01-30T08:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.789+0000 7f023ce00640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0210066530 0x7f02100689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.793+0000 7f023ce00640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0210066530 0x7f02100689f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0238069730 tx=0x7f0228009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.793+0000 7f0234c00640 1 -- 172.21.15.50:0/2462435961 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f02200eb010 con 0x7f02380ad3b0 2024-01-30T08:10:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.953+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02381f0d00 con 0x7f0210066530 2024-01-30T08:10:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.961+0000 7f0234c00640 1 -- 172.21.15.50:0/2462435961 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289572 (secure 0 0 0) 0x7f02381f0d00 con 0x7f0210066530 2024-01-30T08:10:02.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0210066530 msgr2=0x7f02100689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0210066530 0x7f02100689f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0238069730 tx=0x7f0228009190 comp rx=0 tx=0).stop 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380ad3b0 msgr2=0x7f023814a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380ad3b0 0x7f023814a470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0220005040 tx=0x7f0218005800 comp rx=0 tx=0).stop 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 shutdown_connections 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02380a94f0 0x7f02380a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0210066530 0x7f02100689f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380ad3b0 0x7f023814a470 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 --2- 172.21.15.50:0/2462435961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02180047d0 0x7f02381ee190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 >> 172.21.15.50:0/2462435961 conn(0x7f02380c4830 msgr2=0x7f023814c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 shutdown_connections 2024-01-30T08:10:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:02.965+0000 7f023f800640 1 -- 172.21.15.50:0/2462435961 wait complete. 2024-01-30T08:10:02.988 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-01-30T08:10:01.069591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232344,"kb_used_data":3680,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742376,"statfs":{"total":773094113280,"available":772856193024,"internally_reserved":0,"allocated":3768320,"data_stored":2721180,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001817"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866841+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:09:54.866841+0000","last_peered":"2024-01-30T08:09:54.866841+0000","last_clean":"2024-01-30T08:09:54.866841+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:09:54.866841+0000","last_undegraded":"2024-01-30T08:09:54.866841+0000","last_fullsized":"2024-01-30T08:09:54.866841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866478+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:09:54.866478+0000","last_peered":"2024-01-30T08:09:54.866478+0000","last_clean":"2024-01-30T08:09:54.866478+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:09:54.866478+0000","last_undegraded":"2024-01-30T08:09:54.866478+0000","last_fullsized":"2024-01-30T08:09:54.866478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727978+0000","last_change":"2024-01-30T08:09:53.888831+0000","last_active":"2024-01-30T08:09:55.727978+0000","last_peered":"2024-01-30T08:09:55.727978+0000","last_clean":"2024-01-30T08:09:55.727978+0000","last_became_active":"2024-01-30T08:09:53.888512+0000","last_became_peered":"2024-01-30T08:09:53.888512+0000","last_unstale":"2024-01-30T08:09:55.727978+0000","last_undegraded":"2024-01-30T08:09:55.727978+0000","last_fullsized":"2024-01-30T08:09:55.727978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:19.673462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059625+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:09:56.059625+0000","last_peered":"2024-01-30T08:09:56.059625+0000","last_clean":"2024-01-30T08:09:56.059625+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:09:56.059625+0000","last_undegraded":"2024-01-30T08:09:56.059625+0000","last_fullsized":"2024-01-30T08:09:56.059625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059533+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:09:56.059533+0000","last_peered":"2024-01-30T08:09:56.059533+0000","last_clean":"2024-01-30T08:09:56.059533+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:09:56.059533+0000","last_undegraded":"2024-01-30T08:09:56.059533+0000","last_fullsized":"2024-01-30T08:09:56.059533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:47.332748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184535+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:09:56.184535+0000","last_peered":"2024-01-30T08:09:56.184535+0000","last_clean":"2024-01-30T08:09:56.184535+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:09:56.184535+0000","last_undegraded":"2024-01-30T08:09:56.184535+0000","last_fullsized":"2024-01-30T08:09:56.184535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060737+0000","last_change":"2024-01-30T08:09:53.884011+0000","last_active":"2024-01-30T08:09:56.060737+0000","last_peered":"2024-01-30T08:09:56.060737+0000","last_clean":"2024-01-30T08:09:56.060737+0000","last_became_active":"2024-01-30T08:09:53.881881+0000","last_became_peered":"2024-01-30T08:09:53.881881+0000","last_unstale":"2024-01-30T08:09:56.060737+0000","last_undegraded":"2024-01-30T08:09:56.060737+0000","last_fullsized":"2024-01-30T08:09:56.060737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:04:50.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866131+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:09:54.866131+0000","last_peered":"2024-01-30T08:09:54.866131+0000","last_clean":"2024-01-30T08:09:54.866131+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:09:54.866131+0000","last_undegraded":"2024-01-30T08:09:54.866131+0000","last_fullsized":"2024-01-30T08:09:54.866131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728330+0000","last_change":"2024-01-30T08:09:53.887909+0000","last_active":"2024-01-30T08:09:55.728330+0000","last_peered":"2024-01-30T08:09:55.728330+0000","last_clean":"2024-01-30T08:09:55.728330+0000","last_became_active":"2024-01-30T08:09:53.887634+0000","last_became_peered":"2024-01-30T08:09:53.887634+0000","last_unstale":"2024-01-30T08:09:55.728330+0000","last_undegraded":"2024-01-30T08:09:55.728330+0000","last_fullsized":"2024-01-30T08:09:55.728330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:52.921864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061135+0000","last_change":"2024-01-30T08:09:53.883502+0000","last_active":"2024-01-30T08:09:56.061135+0000","last_peered":"2024-01-30T08:09:56.061135+0000","last_clean":"2024-01-30T08:09:56.061135+0000","last_became_active":"2024-01-30T08:09:53.883146+0000","last_became_peered":"2024-01-30T08:09:53.883146+0000","last_unstale":"2024-01-30T08:09:56.061135+0000","last_undegraded":"2024-01-30T08:09:56.061135+0000","last_fullsized":"2024-01-30T08:09:56.061135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:13.134749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061173+0000","last_change":"2024-01-30T08:09:53.883798+0000","last_active":"2024-01-30T08:09:56.061173+0000","last_peered":"2024-01-30T08:09:56.061173+0000","last_clean":"2024-01-30T08:09:56.061173+0000","last_became_active":"2024-01-30T08:09:53.883077+0000","last_became_peered":"2024-01-30T08:09:53.883077+0000","last_unstale":"2024-01-30T08:09:56.061173+0000","last_undegraded":"2024-01-30T08:09:56.061173+0000","last_fullsized":"2024-01-30T08:09:56.061173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:40.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727926+0000","last_change":"2024-01-30T08:09:53.880237+0000","last_active":"2024-01-30T08:09:55.727926+0000","last_peered":"2024-01-30T08:09:55.727926+0000","last_clean":"2024-01-30T08:09:55.727926+0000","last_became_active":"2024-01-30T08:09:53.879920+0000","last_became_peered":"2024-01-30T08:09:53.879920+0000","last_unstale":"2024-01-30T08:09:55.727926+0000","last_undegraded":"2024-01-30T08:09:55.727926+0000","last_fullsized":"2024-01-30T08:09:55.727926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:31:19.905033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060943+0000","last_change":"2024-01-30T08:09:53.879036+0000","last_active":"2024-01-30T08:09:56.060943+0000","last_peered":"2024-01-30T08:09:56.060943+0000","last_clean":"2024-01-30T08:09:56.060943+0000","last_became_active":"2024-01-30T08:09:53.878757+0000","last_became_peered":"2024-01-30T08:09:53.878757+0000","last_unstale":"2024-01-30T08:09:56.060943+0000","last_undegraded":"2024-01-30T08:09:56.060943+0000","last_fullsized":"2024-01-30T08:09:56.060943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:32:50.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866488+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:09:54.866488+0000","last_peered":"2024-01-30T08:09:54.866488+0000","last_clean":"2024-01-30T08:09:54.866488+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:09:54.866488+0000","last_undegraded":"2024-01-30T08:09:54.866488+0000","last_fullsized":"2024-01-30T08:09:54.866488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060691+0000","last_change":"2024-01-30T08:09:53.886393+0000","last_active":"2024-01-30T08:09:56.060691+0000","last_peered":"2024-01-30T08:09:56.060691+0000","last_clean":"2024-01-30T08:09:56.060691+0000","last_became_active":"2024-01-30T08:09:53.881749+0000","last_became_peered":"2024-01-30T08:09:53.881749+0000","last_unstale":"2024-01-30T08:09:56.060691+0000","last_undegraded":"2024-01-30T08:09:56.060691+0000","last_fullsized":"2024-01-30T08:09:56.060691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:22.523025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183006+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:09:56.183006+0000","last_peered":"2024-01-30T08:09:56.183006+0000","last_clean":"2024-01-30T08:09:56.183006+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:09:56.183006+0000","last_undegraded":"2024-01-30T08:09:56.183006+0000","last_fullsized":"2024-01-30T08:09:56.183006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183468+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:09:56.183468+0000","last_peered":"2024-01-30T08:09:56.183468+0000","last_clean":"2024-01-30T08:09:56.183468+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:09:56.183468+0000","last_undegraded":"2024-01-30T08:09:56.183468+0000","last_fullsized":"2024-01-30T08:09:56.183468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867419+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:09:54.867419+0000","last_peered":"2024-01-30T08:09:54.867419+0000","last_clean":"2024-01-30T08:09:54.867419+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:09:54.867419+0000","last_undegraded":"2024-01-30T08:09:54.867419+0000","last_fullsized":"2024-01-30T08:09:54.867419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059748+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:09:56.059748+0000","last_peered":"2024-01-30T08:09:56.059748+0000","last_clean":"2024-01-30T08:09:56.059748+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:09:56.059748+0000","last_undegraded":"2024-01-30T08:09:56.059748+0000","last_fullsized":"2024-01-30T08:09:56.059748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867251+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:09:54.867251+0000","last_peered":"2024-01-30T08:09:54.867251+0000","last_clean":"2024-01-30T08:09:54.867251+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:09:54.867251+0000","last_undegraded":"2024-01-30T08:09:54.867251+0000","last_fullsized":"2024-01-30T08:09:54.867251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060982+0000","last_change":"2024-01-30T08:09:53.884047+0000","last_active":"2024-01-30T08:09:56.060982+0000","last_peered":"2024-01-30T08:09:56.060982+0000","last_clean":"2024-01-30T08:09:56.060982+0000","last_became_active":"2024-01-30T08:09:53.883765+0000","last_became_peered":"2024-01-30T08:09:53.883765+0000","last_unstale":"2024-01-30T08:09:56.060982+0000","last_undegraded":"2024-01-30T08:09:56.060982+0000","last_fullsized":"2024-01-30T08:09:56.060982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:54:01.174660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866793+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:09:54.866793+0000","last_peered":"2024-01-30T08:09:54.866793+0000","last_clean":"2024-01-30T08:09:54.866793+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:09:54.866793+0000","last_undegraded":"2024-01-30T08:09:54.866793+0000","last_fullsized":"2024-01-30T08:09:54.866793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183145+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:09:56.183145+0000","last_peered":"2024-01-30T08:09:56.183145+0000","last_clean":"2024-01-30T08:09:56.183145+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:09:56.183145+0000","last_undegraded":"2024-01-30T08:09:56.183145+0000","last_fullsized":"2024-01-30T08:09:56.183145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:00.220792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059460+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:09:56.059460+0000","last_peered":"2024-01-30T08:09:56.059460+0000","last_clean":"2024-01-30T08:09:56.059460+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:09:56.059460+0000","last_undegraded":"2024-01-30T08:09:56.059460+0000","last_fullsized":"2024-01-30T08:09:56.059460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:22.789462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867410+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:09:54.867410+0000","last_peered":"2024-01-30T08:09:54.867410+0000","last_clean":"2024-01-30T08:09:54.867410+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:09:54.867410+0000","last_undegraded":"2024-01-30T08:09:54.867410+0000","last_fullsized":"2024-01-30T08:09:54.867410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184835+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:09:56.184835+0000","last_peered":"2024-01-30T08:09:56.184835+0000","last_clean":"2024-01-30T08:09:56.184835+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:09:56.184835+0000","last_undegraded":"2024-01-30T08:09:56.184835+0000","last_fullsized":"2024-01-30T08:09:56.184835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867532+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:09:54.867532+0000","last_peered":"2024-01-30T08:09:54.867532+0000","last_clean":"2024-01-30T08:09:54.867532+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:09:54.867532+0000","last_undegraded":"2024-01-30T08:09:54.867532+0000","last_fullsized":"2024-01-30T08:09:54.867532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061055+0000","last_change":"2024-01-30T08:09:53.881127+0000","last_active":"2024-01-30T08:09:56.061055+0000","last_peered":"2024-01-30T08:09:56.061055+0000","last_clean":"2024-01-30T08:09:56.061055+0000","last_became_active":"2024-01-30T08:09:53.880821+0000","last_became_peered":"2024-01-30T08:09:53.880821+0000","last_unstale":"2024-01-30T08:09:56.061055+0000","last_undegraded":"2024-01-30T08:09:56.061055+0000","last_fullsized":"2024-01-30T08:09:56.061055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:34:00.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867588+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:09:54.867588+0000","last_peered":"2024-01-30T08:09:54.867588+0000","last_clean":"2024-01-30T08:09:54.867588+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:09:54.867588+0000","last_undegraded":"2024-01-30T08:09:54.867588+0000","last_fullsized":"2024-01-30T08:09:54.867588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867228+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:09:54.867228+0000","last_peered":"2024-01-30T08:09:54.867228+0000","last_clean":"2024-01-30T08:09:54.867228+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:09:54.867228+0000","last_undegraded":"2024-01-30T08:09:54.867228+0000","last_fullsized":"2024-01-30T08:09:54.867228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183556+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:09:56.183556+0000","last_peered":"2024-01-30T08:09:56.183556+0000","last_clean":"2024-01-30T08:09:56.183556+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:09:56.183556+0000","last_undegraded":"2024-01-30T08:09:56.183556+0000","last_fullsized":"2024-01-30T08:09:56.183556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184506+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:09:56.184506+0000","last_peered":"2024-01-30T08:09:56.184506+0000","last_clean":"2024-01-30T08:09:56.184506+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:09:56.184506+0000","last_undegraded":"2024-01-30T08:09:56.184506+0000","last_fullsized":"2024-01-30T08:09:56.184506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183393+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:09:56.183393+0000","last_peered":"2024-01-30T08:09:56.183393+0000","last_clean":"2024-01-30T08:09:56.183393+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:09:56.183393+0000","last_undegraded":"2024-01-30T08:09:56.183393+0000","last_fullsized":"2024-01-30T08:09:56.183393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867365+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:09:54.867365+0000","last_peered":"2024-01-30T08:09:54.867365+0000","last_clean":"2024-01-30T08:09:54.867365+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:09:54.867365+0000","last_undegraded":"2024-01-30T08:09:54.867365+0000","last_fullsized":"2024-01-30T08:09:54.867365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184844+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:09:56.184844+0000","last_peered":"2024-01-30T08:09:56.184844+0000","last_clean":"2024-01-30T08:09:56.184844+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:09:56.184844+0000","last_undegraded":"2024-01-30T08:09:56.184844+0000","last_fullsized":"2024-01-30T08:09:56.184844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728135+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:09:55.728135+0000","last_peered":"2024-01-30T08:09:55.728135+0000","last_clean":"2024-01-30T08:09:55.728135+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:09:55.728135+0000","last_undegraded":"2024-01-30T08:09:55.728135+0000","last_fullsized":"2024-01-30T08:09:55.728135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866710+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:09:54.866710+0000","last_peered":"2024-01-30T08:09:54.866710+0000","last_clean":"2024-01-30T08:09:54.866710+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:09:54.866710+0000","last_undegraded":"2024-01-30T08:09:54.866710+0000","last_fullsized":"2024-01-30T08:09:54.866710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184876+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:09:56.184876+0000","last_peered":"2024-01-30T08:09:56.184876+0000","last_clean":"2024-01-30T08:09:56.184876+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:09:56.184876+0000","last_undegraded":"2024-01-30T08:09:56.184876+0000","last_fullsized":"2024-01-30T08:09:56.184876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866856+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:09:54.866856+0000","last_peered":"2024-01-30T08:09:54.866856+0000","last_clean":"2024-01-30T08:09:54.866856+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:09:54.866856+0000","last_undegraded":"2024-01-30T08:09:54.866856+0000","last_fullsized":"2024-01-30T08:09:54.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866448+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:09:54.866448+0000","last_peered":"2024-01-30T08:09:54.866448+0000","last_clean":"2024-01-30T08:09:54.866448+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:09:54.866448+0000","last_undegraded":"2024-01-30T08:09:54.866448+0000","last_fullsized":"2024-01-30T08:09:54.866448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727765+0000","last_change":"2024-01-30T08:09:53.881438+0000","last_active":"2024-01-30T08:09:55.727765+0000","last_peered":"2024-01-30T08:09:55.727765+0000","last_clean":"2024-01-30T08:09:55.727765+0000","last_became_active":"2024-01-30T08:09:53.881166+0000","last_became_peered":"2024-01-30T08:09:53.881166+0000","last_unstale":"2024-01-30T08:09:55.727765+0000","last_undegraded":"2024-01-30T08:09:55.727765+0000","last_fullsized":"2024-01-30T08:09:55.727765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:37.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061089+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:09:56.061089+0000","last_peered":"2024-01-30T08:09:56.061089+0000","last_clean":"2024-01-30T08:09:56.061089+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:09:56.061089+0000","last_undegraded":"2024-01-30T08:09:56.061089+0000","last_fullsized":"2024-01-30T08:09:56.061089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:43.172388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060924+0000","last_change":"2024-01-30T08:09:53.881466+0000","last_active":"2024-01-30T08:09:56.060924+0000","last_peered":"2024-01-30T08:09:56.060924+0000","last_clean":"2024-01-30T08:09:56.060924+0000","last_became_active":"2024-01-30T08:09:53.880847+0000","last_became_peered":"2024-01-30T08:09:53.880847+0000","last_unstale":"2024-01-30T08:09:56.060924+0000","last_undegraded":"2024-01-30T08:09:56.060924+0000","last_fullsized":"2024-01-30T08:09:56.060924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:24:30.424249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.182999+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:09:56.182999+0000","last_peered":"2024-01-30T08:09:56.182999+0000","last_clean":"2024-01-30T08:09:56.182999+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:09:56.182999+0000","last_undegraded":"2024-01-30T08:09:56.182999+0000","last_fullsized":"2024-01-30T08:09:56.182999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866823+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:09:54.866823+0000","last_peered":"2024-01-30T08:09:54.866823+0000","last_clean":"2024-01-30T08:09:54.866823+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:09:54.866823+0000","last_undegraded":"2024-01-30T08:09:54.866823+0000","last_fullsized":"2024-01-30T08:09:54.866823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184496+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:09:56.184496+0000","last_peered":"2024-01-30T08:09:56.184496+0000","last_clean":"2024-01-30T08:09:56.184496+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:09:56.184496+0000","last_undegraded":"2024-01-30T08:09:56.184496+0000","last_fullsized":"2024-01-30T08:09:56.184496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866287+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:09:54.866287+0000","last_peered":"2024-01-30T08:09:54.866287+0000","last_clean":"2024-01-30T08:09:54.866287+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:09:54.866287+0000","last_undegraded":"2024-01-30T08:09:54.866287+0000","last_fullsized":"2024-01-30T08:09:54.866287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866091+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:09:54.866091+0000","last_peered":"2024-01-30T08:09:54.866091+0000","last_clean":"2024-01-30T08:09:54.866091+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:09:54.866091+0000","last_undegraded":"2024-01-30T08:09:54.866091+0000","last_fullsized":"2024-01-30T08:09:54.866091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059652+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:09:56.059652+0000","last_peered":"2024-01-30T08:09:56.059652+0000","last_clean":"2024-01-30T08:09:56.059652+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:09:56.059652+0000","last_undegraded":"2024-01-30T08:09:56.059652+0000","last_fullsized":"2024-01-30T08:09:56.059652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:23.401989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866901+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:09:54.866901+0000","last_peered":"2024-01-30T08:09:54.866901+0000","last_clean":"2024-01-30T08:09:54.866901+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:09:54.866901+0000","last_undegraded":"2024-01-30T08:09:54.866901+0000","last_fullsized":"2024-01-30T08:09:54.866901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183262+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:09:56.183262+0000","last_peered":"2024-01-30T08:09:56.183262+0000","last_clean":"2024-01-30T08:09:56.183262+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:09:56.183262+0000","last_undegraded":"2024-01-30T08:09:56.183262+0000","last_fullsized":"2024-01-30T08:09:56.183262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:00:52.172429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061352+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:09:56.061352+0000","last_peered":"2024-01-30T08:09:56.061352+0000","last_clean":"2024-01-30T08:09:56.061352+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:09:56.061352+0000","last_undegraded":"2024-01-30T08:09:56.061352+0000","last_fullsized":"2024-01-30T08:09:56.061352+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:37.710856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727993+0000","last_change":"2024-01-30T08:09:53.883329+0000","last_active":"2024-01-30T08:09:55.727993+0000","last_peered":"2024-01-30T08:09:55.727993+0000","last_clean":"2024-01-30T08:09:55.727993+0000","last_became_active":"2024-01-30T08:09:53.881025+0000","last_became_peered":"2024-01-30T08:09:53.881025+0000","last_unstale":"2024-01-30T08:09:55.727993+0000","last_undegraded":"2024-01-30T08:09:55.727993+0000","last_fullsized":"2024-01-30T08:09:55.727993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:38.717964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061356+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:09:56.061356+0000","last_peered":"2024-01-30T08:09:56.061356+0000","last_clean":"2024-01-30T08:09:56.061356+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:09:56.061356+0000","last_undegraded":"2024-01-30T08:09:56.061356+0000","last_fullsized":"2024-01-30T08:09:56.061356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:51.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866544+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:09:54.866544+0000","last_peered":"2024-01-30T08:09:54.866544+0000","last_clean":"2024-01-30T08:09:54.866544+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:09:54.866544+0000","last_undegraded":"2024-01-30T08:09:54.866544+0000","last_fullsized":"2024-01-30T08:09:54.866544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866416+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:09:54.866416+0000","last_peered":"2024-01-30T08:09:54.866416+0000","last_clean":"2024-01-30T08:09:54.866416+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:09:54.866416+0000","last_undegraded":"2024-01-30T08:09:54.866416+0000","last_fullsized":"2024-01-30T08:09:54.866416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727822+0000","last_change":"2024-01-30T08:09:53.889988+0000","last_active":"2024-01-30T08:09:55.727822+0000","last_peered":"2024-01-30T08:09:55.727822+0000","last_clean":"2024-01-30T08:09:55.727822+0000","last_became_active":"2024-01-30T08:09:53.888579+0000","last_became_peered":"2024-01-30T08:09:53.888579+0000","last_unstale":"2024-01-30T08:09:55.727822+0000","last_undegraded":"2024-01-30T08:09:55.727822+0000","last_fullsized":"2024-01-30T08:09:55.727822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:01:50.624934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866446+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:09:54.866446+0000","last_peered":"2024-01-30T08:09:54.866446+0000","last_clean":"2024-01-30T08:09:54.866446+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:09:54.866446+0000","last_undegraded":"2024-01-30T08:09:54.866446+0000","last_fullsized":"2024-01-30T08:09:54.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866128+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:09:54.866128+0000","last_peered":"2024-01-30T08:09:54.866128+0000","last_clean":"2024-01-30T08:09:54.866128+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:09:54.866128+0000","last_undegraded":"2024-01-30T08:09:54.866128+0000","last_fullsized":"2024-01-30T08:09:54.866128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184592+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:09:56.184592+0000","last_peered":"2024-01-30T08:09:56.184592+0000","last_clean":"2024-01-30T08:09:56.184592+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:09:56.184592+0000","last_undegraded":"2024-01-30T08:09:56.184592+0000","last_fullsized":"2024-01-30T08:09:56.184592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183070+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:09:56.183070+0000","last_peered":"2024-01-30T08:09:56.183070+0000","last_clean":"2024-01-30T08:09:56.183070+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:09:56.183070+0000","last_undegraded":"2024-01-30T08:09:56.183070+0000","last_fullsized":"2024-01-30T08:09:56.183070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866862+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:09:54.866862+0000","last_peered":"2024-01-30T08:09:54.866862+0000","last_clean":"2024-01-30T08:09:54.866862+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:09:54.866862+0000","last_undegraded":"2024-01-30T08:09:54.866862+0000","last_fullsized":"2024-01-30T08:09:54.866862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866330+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:09:54.866330+0000","last_peered":"2024-01-30T08:09:54.866330+0000","last_clean":"2024-01-30T08:09:54.866330+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:09:54.866330+0000","last_undegraded":"2024-01-30T08:09:54.866330+0000","last_fullsized":"2024-01-30T08:09:54.866330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183078+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:09:56.183078+0000","last_peered":"2024-01-30T08:09:56.183078+0000","last_clean":"2024-01-30T08:09:56.183078+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:09:56.183078+0000","last_undegraded":"2024-01-30T08:09:56.183078+0000","last_fullsized":"2024-01-30T08:09:56.183078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866363+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:09:54.866363+0000","last_peered":"2024-01-30T08:09:54.866363+0000","last_clean":"2024-01-30T08:09:54.866363+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:09:54.866363+0000","last_undegraded":"2024-01-30T08:09:54.866363+0000","last_fullsized":"2024-01-30T08:09:54.866363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061451+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:09:56.061451+0000","last_peered":"2024-01-30T08:09:56.061451+0000","last_clean":"2024-01-30T08:09:56.061451+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:09:56.061451+0000","last_undegraded":"2024-01-30T08:09:56.061451+0000","last_fullsized":"2024-01-30T08:09:56.061451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:36.960284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061389+0000","last_change":"2024-01-30T08:09:53.883122+0000","last_active":"2024-01-30T08:09:56.061389+0000","last_peered":"2024-01-30T08:09:56.061389+0000","last_clean":"2024-01-30T08:09:56.061389+0000","last_became_active":"2024-01-30T08:09:53.882631+0000","last_became_peered":"2024-01-30T08:09:53.882631+0000","last_unstale":"2024-01-30T08:09:56.061389+0000","last_undegraded":"2024-01-30T08:09:56.061389+0000","last_fullsized":"2024-01-30T08:09:56.061389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:41.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866781+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:09:54.866781+0000","last_peered":"2024-01-30T08:09:54.866781+0000","last_clean":"2024-01-30T08:09:54.866781+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:09:54.866781+0000","last_undegraded":"2024-01-30T08:09:54.866781+0000","last_fullsized":"2024-01-30T08:09:54.866781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866674+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:09:54.866674+0000","last_peered":"2024-01-30T08:09:54.866674+0000","last_clean":"2024-01-30T08:09:54.866674+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:09:54.866674+0000","last_undegraded":"2024-01-30T08:09:54.866674+0000","last_fullsized":"2024-01-30T08:09:54.866674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059712+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:09:56.059712+0000","last_peered":"2024-01-30T08:09:56.059712+0000","last_clean":"2024-01-30T08:09:56.059712+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:09:56.059712+0000","last_undegraded":"2024-01-30T08:09:56.059712+0000","last_fullsized":"2024-01-30T08:09:56.059712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059887+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:09:56.059887+0000","last_peered":"2024-01-30T08:09:56.059887+0000","last_clean":"2024-01-30T08:09:56.059887+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:09:56.059887+0000","last_undegraded":"2024-01-30T08:09:56.059887+0000","last_fullsized":"2024-01-30T08:09:56.059887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184645+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:09:56.184645+0000","last_peered":"2024-01-30T08:09:56.184645+0000","last_clean":"2024-01-30T08:09:56.184645+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:09:56.184645+0000","last_undegraded":"2024-01-30T08:09:56.184645+0000","last_fullsized":"2024-01-30T08:09:56.184645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183187+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:09:56.183187+0000","last_peered":"2024-01-30T08:09:56.183187+0000","last_clean":"2024-01-30T08:09:56.183187+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:09:56.183187+0000","last_undegraded":"2024-01-30T08:09:56.183187+0000","last_fullsized":"2024-01-30T08:09:56.183187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:13:20.247550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059633+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:09:56.059633+0000","last_peered":"2024-01-30T08:09:56.059633+0000","last_clean":"2024-01-30T08:09:56.059633+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:09:56.059633+0000","last_undegraded":"2024-01-30T08:09:56.059633+0000","last_fullsized":"2024-01-30T08:09:56.059633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728159+0000","last_change":"2024-01-30T08:09:53.883346+0000","last_active":"2024-01-30T08:09:55.728159+0000","last_peered":"2024-01-30T08:09:55.728159+0000","last_clean":"2024-01-30T08:09:55.728159+0000","last_became_active":"2024-01-30T08:09:53.878878+0000","last_became_peered":"2024-01-30T08:09:53.878878+0000","last_unstale":"2024-01-30T08:09:55.728159+0000","last_undegraded":"2024-01-30T08:09:55.728159+0000","last_fullsized":"2024-01-30T08:09:55.728159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:52.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059425+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:09:56.059425+0000","last_peered":"2024-01-30T08:09:56.059425+0000","last_clean":"2024-01-30T08:09:56.059425+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:09:56.059425+0000","last_undegraded":"2024-01-30T08:09:56.059425+0000","last_fullsized":"2024-01-30T08:09:56.059425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.060916+0000","last_change":"2024-01-30T08:09:53.886717+0000","last_active":"2024-01-30T08:09:56.060916+0000","last_peered":"2024-01-30T08:09:56.060916+0000","last_clean":"2024-01-30T08:09:56.060916+0000","last_became_active":"2024-01-30T08:09:53.884242+0000","last_became_peered":"2024-01-30T08:09:53.884242+0000","last_unstale":"2024-01-30T08:09:56.060916+0000","last_undegraded":"2024-01-30T08:09:56.060916+0000","last_fullsized":"2024-01-30T08:09:56.060916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:05.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183495+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:09:56.183495+0000","last_peered":"2024-01-30T08:09:56.183495+0000","last_clean":"2024-01-30T08:09:56.183495+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:09:56.183495+0000","last_undegraded":"2024-01-30T08:09:56.183495+0000","last_fullsized":"2024-01-30T08:09:56.183495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866449+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:09:54.866449+0000","last_peered":"2024-01-30T08:09:54.866449+0000","last_clean":"2024-01-30T08:09:54.866449+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:09:54.866449+0000","last_undegraded":"2024-01-30T08:09:54.866449+0000","last_fullsized":"2024-01-30T08:09:54.866449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059378+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:09:56.059378+0000","last_peered":"2024-01-30T08:09:56.059378+0000","last_clean":"2024-01-30T08:09:56.059378+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:09:56.059378+0000","last_undegraded":"2024-01-30T08:09:56.059378+0000","last_fullsized":"2024-01-30T08:09:56.059378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184647+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:09:56.184647+0000","last_peered":"2024-01-30T08:09:56.184647+0000","last_clean":"2024-01-30T08:09:56.184647+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:09:56.184647+0000","last_undegraded":"2024-01-30T08:09:56.184647+0000","last_fullsized":"2024-01-30T08:09:56.184647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061516+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:09:56.061516+0000","last_peered":"2024-01-30T08:09:56.061516+0000","last_clean":"2024-01-30T08:09:56.061516+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:09:56.061516+0000","last_undegraded":"2024-01-30T08:09:56.061516+0000","last_fullsized":"2024-01-30T08:09:56.061516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:51.914756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183512+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:09:56.183512+0000","last_peered":"2024-01-30T08:09:56.183512+0000","last_clean":"2024-01-30T08:09:56.183512+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:09:56.183512+0000","last_undegraded":"2024-01-30T08:09:56.183512+0000","last_fullsized":"2024-01-30T08:09:56.183512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.059800+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:09:56.059800+0000","last_peered":"2024-01-30T08:09:56.059800+0000","last_clean":"2024-01-30T08:09:56.059800+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:09:56.059800+0000","last_undegraded":"2024-01-30T08:09:56.059800+0000","last_fullsized":"2024-01-30T08:09:56.059800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866673+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:09:54.866673+0000","last_peered":"2024-01-30T08:09:54.866673+0000","last_clean":"2024-01-30T08:09:54.866673+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:09:54.866673+0000","last_undegraded":"2024-01-30T08:09:54.866673+0000","last_fullsized":"2024-01-30T08:09:54.866673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.727979+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:09:55.727979+0000","last_peered":"2024-01-30T08:09:55.727979+0000","last_clean":"2024-01-30T08:09:55.727979+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:09:55.727979+0000","last_undegraded":"2024-01-30T08:09:55.727979+0000","last_fullsized":"2024-01-30T08:09:55.727979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:30:27.351725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728049+0000","last_change":"2024-01-30T08:09:53.882768+0000","last_active":"2024-01-30T08:09:55.728049+0000","last_peered":"2024-01-30T08:09:55.728049+0000","last_clean":"2024-01-30T08:09:55.728049+0000","last_became_active":"2024-01-30T08:09:53.882430+0000","last_became_peered":"2024-01-30T08:09:53.882430+0000","last_unstale":"2024-01-30T08:09:55.728049+0000","last_undegraded":"2024-01-30T08:09:55.728049+0000","last_fullsized":"2024-01-30T08:09:55.728049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:58.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:55.728185+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:09:55.728185+0000","last_peered":"2024-01-30T08:09:55.728185+0000","last_clean":"2024-01-30T08:09:55.728185+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:09:55.728185+0000","last_undegraded":"2024-01-30T08:09:55.728185+0000","last_fullsized":"2024-01-30T08:09:55.728185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.184512+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:09:56.184512+0000","last_peered":"2024-01-30T08:09:56.184512+0000","last_clean":"2024-01-30T08:09:56.184512+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:09:56.184512+0000","last_undegraded":"2024-01-30T08:09:56.184512+0000","last_fullsized":"2024-01-30T08:09:56.184512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.867208+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:09:54.867208+0000","last_peered":"2024-01-30T08:09:54.867208+0000","last_clean":"2024-01-30T08:09:54.867208+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:09:54.867208+0000","last_undegraded":"2024-01-30T08:09:54.867208+0000","last_fullsized":"2024-01-30T08:09:54.867208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866671+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:09:54.866671+0000","last_peered":"2024-01-30T08:09:54.866671+0000","last_clean":"2024-01-30T08:09:54.866671+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:09:54.866671+0000","last_undegraded":"2024-01-30T08:09:54.866671+0000","last_fullsized":"2024-01-30T08:09:54.866671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866042+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:09:54.866042+0000","last_peered":"2024-01-30T08:09:54.866042+0000","last_clean":"2024-01-30T08:09:54.866042+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:09:54.866042+0000","last_undegraded":"2024-01-30T08:09:54.866042+0000","last_fullsized":"2024-01-30T08:09:54.866042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183449+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:09:56.183449+0000","last_peered":"2024-01-30T08:09:56.183449+0000","last_clean":"2024-01-30T08:09:56.183449+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:09:56.183449+0000","last_undegraded":"2024-01-30T08:09:56.183449+0000","last_fullsized":"2024-01-30T08:09:56.183449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:54.866145+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:09:54.866145+0000","last_peered":"2024-01-30T08:09:54.866145+0000","last_clean":"2024-01-30T08:09:54.866145+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:09:54.866145+0000","last_undegraded":"2024-01-30T08:09:54.866145+0000","last_fullsized":"2024-01-30T08:09:54.866145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.061352+0000","last_change":"2024-01-30T08:09:53.893858+0000","last_active":"2024-01-30T08:09:56.061352+0000","last_peered":"2024-01-30T08:09:56.061352+0000","last_clean":"2024-01-30T08:09:56.061352+0000","last_became_active":"2024-01-30T08:09:53.893613+0000","last_became_peered":"2024-01-30T08:09:53.893613+0000","last_unstale":"2024-01-30T08:09:56.061352+0000","last_undegraded":"2024-01-30T08:09:56.061352+0000","last_fullsized":"2024-01-30T08:09:56.061352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:09.834509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183453+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:09:56.183453+0000","last_peered":"2024-01-30T08:09:56.183453+0000","last_clean":"2024-01-30T08:09:56.183453+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:09:56.183453+0000","last_undegraded":"2024-01-30T08:09:56.183453+0000","last_fullsized":"2024-01-30T08:09:56.183453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-30T08:09:56.183229+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:09:56.183229+0000","last_peered":"2024-01-30T08:09:56.183229+0000","last_clean":"2024-01-30T08:09:56.183229+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:09:56.183229+0000","last_undegraded":"2024-01-30T08:09:56.183229+0000","last_fullsized":"2024-01-30T08:09:56.183229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":784003,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.66800000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.56899999999999995}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.874}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.83699999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.627},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.85799999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":192535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.441},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.59099999999999997}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.57199999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.41599999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":192557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.82299999999999995}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.88200000000000001}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.92300000000000004}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91000000000000003}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.84099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":462848,"data_stored":193599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.52900000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.878}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85599999999999998}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.745}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.79400000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":192023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.502},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.442}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41399999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.378},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45400000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.623},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59399999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":192043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.53800000000000003}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.434}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.748},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":192065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.79800000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.98399999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.121},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.872}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0720000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":782355,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.153},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.91100000000000003}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.012}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.1819999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:02.993 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-30T08:10:02.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-30T08:10:03.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f82e00640 1 Processor -- start 2024-01-30T08:10:03.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f82e00640 1 -- start start 2024-01-30T08:10:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f82e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f7c0c50d0 0x7f1f7c156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f82e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f82e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c0c8a50 con 0x7f1f7c0c5c90 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f82e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c0c7070 con 0x7f1f7c0c50d0 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f82e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0c8d30 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f80e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1f7c0c5c90 0x7f1f7c0c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39370/0 (socket says 172.21.15.50:39370) 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f80e00640 1 -- 172.21.15.50:0/3320637998 learned_addr learned my addr 172.21.15.50:0/3320637998 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7b400640 1 --2- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7be00640 1 --2- 172.21.15.50:0/3320637998 >> v2:172.21.15.125:3300/0 conn(0x7f1f7c0c50d0 0x7f1f7c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7aa00640 1 -- 172.21.15.50:0/3320637998 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823229296 0 0) 0x7f1f7c0c8a50 con 0x7f1f7c0c5c90 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7aa00640 1 -- 172.21.15.50:0/3320637998 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f5c003530 con 0x7f1f7c0c5c90 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7be00640 1 -- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c7ae0 msgr2=0x7f1f7c1566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7be00640 1 --2- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7be00640 1 -- 172.21.15.50:0/3320637998 >> v1:172.21.15.50:6789/0 conn(0x7f1f7c0c5c90 legacy=0x7f1f7c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7be00640 1 -- 172.21.15.50:0/3320637998 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0c66d0 con 0x7f1f7c0c50d0 2024-01-30T08:10:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.177+0000 7f1f7b400640 1 --2- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f7be00640 1 --2- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 0x7f1f7c156190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097c0 tx=0x7f1f6c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8876dd3dc594c3cc server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:03.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f7aa00640 1 -- 172.21.15.50:0/3320637998 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0ac620 con 0x7f1f7c0c50d0 2024-01-30T08:10:03.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f7aa00640 1 -- 172.21.15.50:0/3320637998 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0ac780 con 0x7f1f7c0c50d0 2024-01-30T08:10:03.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f7aa00640 1 -- 172.21.15.50:0/3320637998 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0acaf0 con 0x7f1f7c0c50d0 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 -- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 msgr2=0x7f1f7c156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 0x7f1f7c156190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097c0 tx=0x7f1f6c01c3c0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 -- 172.21.15.50:0/3320637998 shutdown_connections 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3320637998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 0x7f1f7c156190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 -- 172.21.15.50:0/3320637998 >> 172.21.15.50:0/3320637998 conn(0x7f1f7c0727c0 msgr2=0x7f1f7c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 -- 172.21.15.50:0/3320637998 shutdown_connections 2024-01-30T08:10:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.181+0000 7f1f82e00640 1 -- 172.21.15.50:0/3320637998 wait complete. 2024-01-30T08:10:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 Processor -- start 2024-01-30T08:10:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 -- start start 2024-01-30T08:10:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 0x7f1f7c1f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c5c90 0x7f1f7c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0abe80 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c152230 con 0x7f1f7c0c50d0 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c1f16e0 con 0x7f1f7c0c5c90 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1ed9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35720/0 (socket says 172.21.15.50:35720) 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 -- 172.21.15.50:0/3540830616 learned_addr learned my addr 172.21.15.50:0/3540830616 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f7be00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 0x7f1f7c1f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f7b400640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c5c90 0x7f1f7c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 -- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c5c90 msgr2=0x7f1f7c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c5c90 0x7f1f7c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 -- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 msgr2=0x7f1f7c1f0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 0x7f1f7c1f0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 -- 172.21.15.50:0/3540830616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64009420 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f80e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1ed9a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400cb70 tx=0x7f1f7400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f73e00640 1 -- 172.21.15.50:0/3540830616 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400ad40 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f73e00640 1 -- 172.21.15.50:0/3540830616 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74012400 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f73e00640 1 -- 172.21.15.50:0/3540830616 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400aea0 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c009420 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.185+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c0aac90 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.189+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c074a20 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.189+0000 7f1f73e00640 1 -- 172.21.15.50:0/3540830616 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1f74007070 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.189+0000 7f1f73e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f54066500 0x7f1f540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.189+0000 7f1f73e00640 1 -- 172.21.15.50:0/3540830616 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1f74083fb0 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.189+0000 7f1f7be00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f54066500 0x7f1f540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.193+0000 7f1f7be00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f54066500 0x7f1f540689c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0ae000 tx=0x7f1f6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.193+0000 7f1f73e00640 1 -- 172.21.15.50:0/3540830616 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1f740511b0 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.409+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1f7c0c1ed0 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.409+0000 7f1f73e00640 1 -- 172.21.15.50:0/3540830616 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1f740170e0 con 0x7f1f7c0c7ae0 2024-01-30T08:10:03.413 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-01-30T08:10:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYrrhlySttEhAA25eE5QwNAjdOZsKcoh9Fhw== 2024-01-30T08:10:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-01-30T08:10:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-01-30T08:10:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-30T08:10:03.414 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-01-30T08:10:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f54066500 msgr2=0x7f1f540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f54066500 0x7f1f540689c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0ae000 tx=0x7f1f6c008040 comp rx=0 tx=0).stop 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f7c0c7ae0 msgr2=0x7f1f7c1ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1ed9a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400cb70 tx=0x7f1f7400a430 comp rx=0 tx=0).stop 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 shutdown_connections 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1f54066500 0x7f1f540689c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f7c0c7ae0 0x7f1f7c1ed9a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f7c0c5c90 0x7f1f7c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 --2- 172.21.15.50:0/3540830616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f7c0c50d0 0x7f1f7c1f0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 >> 172.21.15.50:0/3540830616 conn(0x7f1f7c0727c0 msgr2=0x7f1f7c0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 shutdown_connections 2024-01-30T08:10:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.413+0000 7f1f82e00640 1 -- 172.21.15.50:0/3540830616 wait complete. 2024-01-30T08:10:03.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.573+0000 7fb879a00640 1 Processor -- start 2024-01-30T08:10:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb879a00640 1 -- start start 2024-01-30T08:10:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb879a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb87406de40 0x7fb87406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb879a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb874152f00 con 0x7fb8740c4310 2024-01-30T08:10:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb879a00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8741525f0 con 0x7fb874153390 2024-01-30T08:10:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb879a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8740a7680 con 0x7fb87406de40 2024-01-30T08:10:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb8740c4310 0x7fb874155be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39382/0 (socket says 172.21.15.50:39382) 2024-01-30T08:10:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 -- 172.21.15.50:0/3095909137 learned_addr learned my addr 172.21.15.50:0/3095909137 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb872a00640 1 --2- 172.21.15.50:0/3095909137 >> v2:172.21.15.125:3300/0 conn(0x7fb87406de40 0x7fb87406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173059662 0 0) 0x7fb874152f00 con 0x7fb8740c4310 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb854003530 con 0x7fb8740c4310 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2643085449 0 0) 0x7fb854003530 con 0x7fb8740c4310 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 >> v2:172.21.15.125:3300/0 conn(0x7fb87406de40 msgr2=0x7fb87406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 --2- 172.21.15.50:0/3095909137 >> v2:172.21.15.125:3300/0 conn(0x7fb87406de40 0x7fb87406e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 >> v1:172.21.15.125:6789/0 conn(0x7fb874153390 legacy=0x7fb8740a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8741528b0 con 0x7fb8740c4310 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fb86c001a00 con 0x7fb8740c4310 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 >> v1:172.21.15.50:6789/0 conn(0x7fb8740c4310 legacy=0x7fb874155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb854003980 0x7fb854003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8540047d0 0x7fb854004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb85400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740a7680 con 0x7fb8540052b0 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85400c180 con 0x7fb8540047d0 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85400c340 con 0x7fb854003980 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb85400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb872a00640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb854003980 0x7fb854003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb872000640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8540047d0 0x7fb854004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 -- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb854003980 msgr2=0x7fb854003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb854003980 0x7fb854003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 -- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8540047d0 msgr2=0x7fb854004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8540047d0 0x7fb854004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb873400640 1 -- 172.21.15.50:0/3095909137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854003530 con 0x7fb8540052b0 2024-01-30T08:10:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.577+0000 7fb872000640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8540047d0 0x7fb854004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:03.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb873400640 1 -- 172.21.15.50:0/3095909137 reap_dead start 2024-01-30T08:10:03.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb873400640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb85400b990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb8740c4710 tx=0x7fb86c01d270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3c83084c8bf8fe server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:03.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0072d0 con 0x7fb8540052b0 2024-01-30T08:10:03.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c0a8070 con 0x7fb8540052b0 2024-01-30T08:10:03.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb871600640 1 -- 172.21.15.50:0/3095909137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c007690 con 0x7fb8540052b0 2024-01-30T08:10:03.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb879a00640 1 -- 172.21.15.50:0/3095909137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 msgr2=0x7fb85400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb879a00640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb85400b990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb8740c4710 tx=0x7fb86c01d270 comp rx=0 tx=0).stop 2024-01-30T08:10:03.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb879a00640 1 -- 172.21.15.50:0/3095909137 shutdown_connections 2024-01-30T08:10:03.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb879a00640 1 --2- 172.21.15.50:0/3095909137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb85400b990 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb879a00640 1 -- 172.21.15.50:0/3095909137 >> 172.21.15.50:0/3095909137 conn(0x7fb8740c4830 msgr2=0x7fb8740c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:03.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb879a00640 1 -- 172.21.15.50:0/3095909137 shutdown_connections 2024-01-30T08:10:03.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.581+0000 7fb879a00640 1 -- 172.21.15.50:0/3095909137 wait complete. 2024-01-30T08:10:03.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 Processor -- start 2024-01-30T08:10:03.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 -- start start 2024-01-30T08:10:03.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb8741ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87406d620 0x7fb8741510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874146760 0x7fb8741f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740bf040 con 0x7fb8540052b0 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740c08d0 con 0x7fb874146760 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740c0dc0 con 0x7fb87406d620 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb8741ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb8741ed1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35736/0 (socket says 172.21.15.50:35736) 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 -- 172.21.15.50:0/1417757999 learned_addr learned my addr 172.21.15.50:0/1417757999 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872000640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87406d620 0x7fb8741510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb873400640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874146760 0x7fb8741f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 -- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87406d620 msgr2=0x7fb8741510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87406d620 0x7fb8741510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 -- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874146760 msgr2=0x7fb8741f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874146760 0x7fb8741f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 -- 172.21.15.50:0/1417757999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740c1320 con 0x7fb8540052b0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb873400640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874146760 0x7fb8741f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb872a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb8741ed1e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb864011960 tx=0x7fb864011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb86aa00640 1 -- 172.21.15.50:0/1417757999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400faf0 con 0x7fb8540052b0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb86aa00640 1 -- 172.21.15.50:0/1417757999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400fc50 con 0x7fb8540052b0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8740c0ae0 con 0x7fb8540052b0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb86aa00640 1 -- 172.21.15.50:0/1417757999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864014440 con 0x7fb8540052b0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.585+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8741ed720 con 0x7fb8540052b0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.589+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb874074a20 con 0x7fb8540052b0 2024-01-30T08:10:03.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.589+0000 7fb86aa00640 1 -- 172.21.15.50:0/1417757999 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb86401d400 con 0x7fb8540052b0 2024-01-30T08:10:03.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.589+0000 7fb86aa00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb84c066500 0x7fb84c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:03.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.589+0000 7fb86aa00640 1 -- 172.21.15.50:0/1417757999 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8640847f0 con 0x7fb8540052b0 2024-01-30T08:10:03.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.589+0000 7fb872000640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb84c066500 0x7fb84c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:03.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.589+0000 7fb872000640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb84c066500 0x7fb84c0689c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8740a9f50 tx=0x7fb85c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:03.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.593+0000 7fb86aa00640 1 -- 172.21.15.50:0/1417757999 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb8640518b0 con 0x7fb8540052b0 2024-01-30T08:10:03.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb87406ec60 con 0x7fb8540052b0 2024-01-30T08:10:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb86aa00640 1 -- 172.21.15.50:0/1417757999 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fb864054ed0 con 0x7fb8540052b0 2024-01-30T08:10:03.791 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:03.791 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5170,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:09:53.316367+0000","modified":"2024-01-30T08:09:56.334652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1837689837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1837689837},{"type":"v1","addr":"172.21.15.50:6835","nonce":1837689837}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-30T08:10:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2024-01-30T08:10:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb84c066500 msgr2=0x7fb84c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb84c066500 0x7fb84c0689c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8740a9f50 tx=0x7fb85c009040 comp rx=0 tx=0).stop 2024-01-30T08:10:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 msgr2=0x7fb8741ed1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb8741ed1e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb864011960 tx=0x7fb864011e20 comp rx=0 tx=0).stop 2024-01-30T08:10:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 shutdown_connections 2024-01-30T08:10:03.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb874146760 0x7fb8741f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb84c066500 0x7fb84c0689c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb87406d620 0x7fb8741510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 --2- 172.21.15.50:0/1417757999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540052b0 0x7fb8741ed1e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 >> 172.21.15.50:0/1417757999 conn(0x7fb8740c4830 msgr2=0x7fb8740c5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.789+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 shutdown_connections 2024-01-30T08:10:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:03.793+0000 7fb879a00640 1 -- 172.21.15.50:0/1417757999 wait complete. 2024-01-30T08:10:04.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-30T08:09:53.316367+0000', 'modified': '2024-01-30T08:09:56.334652+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5214': {'gid': 5214, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/1837689837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 1837689837}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 1837689837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-30T08:10:04.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-30T08:10:04.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-30T08:10:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd019c00640 1 Processor -- start 2024-01-30T08:10:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd019c00640 1 -- start start 2024-01-30T08:10:04.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd019c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd014151e20 0x7fd01406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd019c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd01406de20 0x7fd01415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd019c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd014155680 con 0x7fd0140c3a10 2024-01-30T08:10:04.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd019c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd014072a80 con 0x7fd01406de20 2024-01-30T08:10:04.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd019c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0141553a0 con 0x7fd014151e20 2024-01-30T08:10:04.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd012000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd0140c3a10 0x7fd014157c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39392/0 (socket says 172.21.15.50:39392) 2024-01-30T08:10:04.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.357+0000 7fd012000640 1 -- 172.21.15.50:0/4074342996 learned_addr learned my addr 172.21.15.50:0/4074342996 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:04.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd013400640 1 --2- 172.21.15.50:0/4074342996 >> v2:172.21.15.125:3300/0 conn(0x7fd01406de20 0x7fd01415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd012a00640 1 --2- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd014151e20 0x7fd01406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd011600640 1 -- 172.21.15.50:0/4074342996 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034181395 0 0) 0x7fd014155680 con 0x7fd0140c3a10 2024-01-30T08:10:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd011600640 1 -- 172.21.15.50:0/4074342996 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff4003530 con 0x7fd0140c3a10 2024-01-30T08:10:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd013400640 1 -- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd014151e20 msgr2=0x7fd01406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd013400640 1 --2- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd014151e20 0x7fd01406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd013400640 1 -- 172.21.15.50:0/4074342996 >> v1:172.21.15.50:6789/0 conn(0x7fd0140c3a10 legacy=0x7fd014157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd013400640 1 -- 172.21.15.50:0/4074342996 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140c05c0 con 0x7fd01406de20 2024-01-30T08:10:04.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd012a00640 1 --2- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd014151e20 0x7fd01406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd013400640 1 --2- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 0x7fd01415eff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009d90 tx=0x7fd00c01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11faff16a3169419 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd011600640 1 -- 172.21.15.50:0/4074342996 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0a6700 con 0x7fd01406de20 2024-01-30T08:10:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd011600640 1 -- 172.21.15.50:0/4074342996 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c0a6860 con 0x7fd01406de20 2024-01-30T08:10:04.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.361+0000 7fd011600640 1 -- 172.21.15.50:0/4074342996 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0a6bf0 con 0x7fd01406de20 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 msgr2=0x7fd01415eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 --2- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 0x7fd01415eff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009d90 tx=0x7fd00c01c830 comp rx=0 tx=0).stop 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- 172.21.15.50:0/4074342996 shutdown_connections 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 --2- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 0x7fd01415eff0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 --2- 172.21.15.50:0/4074342996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd014151e20 0x7fd01406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- 172.21.15.50:0/4074342996 >> 172.21.15.50:0/4074342996 conn(0x7fd0140c5f10 msgr2=0x7fd0140c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- 172.21.15.50:0/4074342996 shutdown_connections 2024-01-30T08:10:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- 172.21.15.50:0/4074342996 wait complete. 2024-01-30T08:10:04.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 Processor -- start 2024-01-30T08:10:04.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- start start 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 0x7fd0140ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0140c3a10 0x7fd0141f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd014151e20 0x7fd0141f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0141f12b0 con 0x7fd014151e20 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140a5cf0 con 0x7fd01406de20 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.365+0000 7fd019c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0141f1520 con 0x7fd0140c3a10 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd014151e20 0x7fd0141f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd014151e20 0x7fd0141f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35742/0 (socket says 172.21.15.50:35742) 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 -- 172.21.15.50:0/340146620 learned_addr learned my addr 172.21.15.50:0/340146620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd012a00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 0x7fd0140ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd012000640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0140c3a10 0x7fd0141f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 -- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0140c3a10 msgr2=0x7fd0141f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0140c3a10 0x7fd0141f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 -- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 msgr2=0x7fd0140ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 0x7fd0140ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 -- 172.21.15.50:0/340146620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009420 con 0x7fd014151e20 2024-01-30T08:10:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd013400640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd014151e20 0x7fd0141f0d70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b0040 tx=0x7fd00c0195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd00aa00640 1 -- 172.21.15.50:0/340146620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0b8630 con 0x7fd014151e20 2024-01-30T08:10:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd00aa00640 1 -- 172.21.15.50:0/340146620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c0b87b0 con 0x7fd014151e20 2024-01-30T08:10:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd00aa00640 1 -- 172.21.15.50:0/340146620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0b8b60 con 0x7fd014151e20 2024-01-30T08:10:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c009a70 con 0x7fd014151e20 2024-01-30T08:10:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.369+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0140bae80 con 0x7fd014151e20 2024-01-30T08:10:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd00aa00640 1 -- 172.21.15.50:0/340146620 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd00c0b8cc0 con 0x7fd014151e20 2024-01-30T08:10:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 Processor -- start 2024-01-30T08:10:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd00aa00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfec066500 0x7fcfec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 -- start start 2024-01-30T08:10:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd00aa00640 1 -- 172.21.15.50:0/340146620 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd00c0aa070 con 0x7fd014151e20 2024-01-30T08:10:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfec066500 0x7fcfec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2c5c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c5ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5d1f0 0x55bca2ca6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2ac8720 con 0x55bca2c5c8d0 2024-01-30T08:10:04.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2ab6d70 con 0x55bca2c5d1f0 2024-01-30T08:10:04.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bca2ab42a0 con 0x55bca2c5bfb0 2024-01-30T08:10:04.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfec066500 0x7fcfec0689c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd0140a6760 tx=0x7fcffc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c5ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c5ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35760/0 (socket says 172.21.15.50:35760) 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd013400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5d1f0 0x55bca2ca6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 -- 172.21.15.50:0/3891723244 learned_addr learned my addr 172.21.15.50:0/3891723244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012a00640 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2c5c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 -- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 msgr2=0x55bca2c5c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2c5c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 -- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5d1f0 msgr2=0x55bca2ca6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5d1f0 0x55bca2ca6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 -- 172.21.15.50:0/3891723244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca27a6890 con 0x55bca2c5c8d0 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012a00640 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2c5c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd013400640 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5d1f0 0x55bca2ca6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.373+0000 7fd012000640 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c5ccb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd0140c3e10 tx=0x7fcffc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e0df49d144c607 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd003400640 1 -- 172.21.15.50:0/3891723244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00fe70 con 0x55bca2c5c8d0 2024-01-30T08:10:04.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd003400640 1 -- 172.21.15.50:0/3891723244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc015bf0 con 0x55bca2c5c8d0 2024-01-30T08:10:04.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd003400640 1 -- 172.21.15.50:0/3891723244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc020400 con 0x55bca2c5c8d0 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3891723244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 msgr2=0x55bca2c5ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c5ccb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd0140c3e10 tx=0x7fcffc000ee0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3891723244 shutdown_connections 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5d1f0 0x55bca2ca6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c5ccb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3891723244 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2c5c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3891723244 >> 172.21.15.50:0/3891723244 conn(0x55bca2c9a270 msgr2=0x55bca2c9c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3891723244 shutdown_connections 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3891723244 wait complete. 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- start start 2024-01-30T08:10:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 Processor -- start 2024-01-30T08:10:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2c64b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c61b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c62070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2aafb90 con 0x55bca2c5c8d0 2024-01-30T08:10:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2a6c4c0 con 0x55bca2c5bfb0 2024-01-30T08:10:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bca2a6ae10 con 0x55bca2c5d1f0 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd01d0fa000 10 client.0 _ll_register_callbacks cb 0x55bca2a65be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c61b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c61b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35764/0 (socket says 172.21.15.50:35764) 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 -- 172.21.15.50:0/1608969273 learned_addr learned my addr 172.21.15.50:0/1608969273 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012a00640 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2c64b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd013400640 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c62070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 -- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 msgr2=0x55bca2c62070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c62070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 -- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 msgr2=0x55bca2c64b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2c64b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.377+0000 7fd012000640 1 -- 172.21.15.50:0/1608969273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0040098d0 con 0x55bca2c5c8d0 2024-01-30T08:10:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd012000640 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c61b30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0068a0 tx=0x7fcffc0010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fada1a44221580 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 1 -- 172.21.15.50:0/1608969273 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc020cc0 con 0x55bca2c5c8d0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 1 -- 172.21.15.50:0/1608969273 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcffc020e20 con 0x55bca2c5c8d0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bca2a35e30 con 0x55bca2c5c8d0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 1 -- 172.21.15.50:0/1608969273 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcffc02c480 con 0x55bca2c5c8d0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 10 client.5418 fetch_fsmap learned FSMap version 18 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7fd0140bae80 con 0x55bca2c5c8d0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 1 -- 172.21.15.50:0/1608969273 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bca2a35e30 con 0x55bca2c5c8d0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 1 -- 172.21.15.50:0/1608969273 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcffc012070 con 0x55bca2c5c8d0 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 10 client.5418 fetch_fsmap finished waiting for FSMap version 18 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 10 client.5418 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 20 client.5418 populate_metadata read hostname 'smithi050' 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2c98ef0 0x55bca2c992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 4 client.5418 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-30T08:10:04.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 --> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bca2adcbd0 con 0x55bca2c98ef0 2024-01-30T08:10:04.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd012a00640 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2c98ef0 0x55bca2c992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd012a00640 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2c98ef0 0x55bca2c992d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd492ee9aa64c95 server_cookie=300e64cd41bfc58 in_seq=0 out_seq=0 2024-01-30T08:10:04.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 10 client.5418 ms_handle_connect on v2:172.21.15.50:6834/1837689837 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 1 -- 172.21.15.50:0/1608969273 <== mds.0 v2:172.21.15.50:6834/1837689837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bca2adcbd0 con 0x55bca2c98ef0 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 10 client.5418 handle_command_reply: tid=0 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 client.5418 shutdown 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 msgr2=0x55bca2c61b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c61b30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0068a0 tx=0x7fcffc0010b0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 shutdown_connections 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2c98ef0 0x55bca2c992d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c62070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c61b30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fcffbe00640 0 client.5418 ms_handle_reset on v2:172.21.15.50:6834/1837689837 2024-01-30T08:10:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/1608969273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2c64b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 >> 172.21.15.50:0/1608969273 conn(0x55bca2c9a270 msgr2=0x55bca2c5b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 shutdown_connections 2024-01-30T08:10:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 1 -- 172.21.15.50:0/1608969273 wait complete. 2024-01-30T08:10:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.381+0000 7fd01d0fa000 20 client.5418 trim_cache size 0 max 16384 2024-01-30T08:10:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.397+0000 7fd01d0fa000 1 Processor -- start 2024-01-30T08:10:04.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.397+0000 7fd01d0fa000 1 -- start start 2024-01-30T08:10:04.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2ca2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c61e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2767940 con 0x55bca2c5c8d0 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2ab77c0 con 0x55bca2c5bfb0 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bca2ab66a0 con 0x55bca2c5d1f0 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35776/0 (socket says 172.21.15.50:35776) 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 -- 172.21.15.50:0/3040542077 learned_addr learned my addr 172.21.15.50:0/3040542077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012a00640 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2ca2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd013400640 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c61e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 -- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 msgr2=0x55bca2c61e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c61e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 -- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 msgr2=0x55bca2ca2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2ca2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 -- 172.21.15.50:0/3040542077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff4003530 con 0x55bca2c5c8d0 2024-01-30T08:10:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd012000640 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c618e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00f8f0 tx=0x7fcffc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6150b92c741516 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd002a00640 1 -- 172.21.15.50:0/3040542077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc02c480 con 0x55bca2c5c8d0 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd002a00640 1 -- 172.21.15.50:0/3040542077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc02c700 con 0x55bca2c5c8d0 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd002a00640 1 -- 172.21.15.50:0/3040542077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc02c870 con 0x55bca2c5c8d0 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3040542077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 msgr2=0x55bca2c618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c618e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00f8f0 tx=0x7fcffc01d000 comp rx=0 tx=0).stop 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3040542077 shutdown_connections 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5d1f0 0x55bca2c61e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5c8d0 0x55bca2c618e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/3040542077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5bfb0 0x55bca2ca2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3040542077 >> 172.21.15.50:0/3040542077 conn(0x55bca2c9a270 msgr2=0x55bca2cb6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3040542077 shutdown_connections 2024-01-30T08:10:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- 172.21.15.50:0/3040542077 wait complete. 2024-01-30T08:10:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 -- start start 2024-01-30T08:10:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.401+0000 7fd01d0fa000 1 Processor -- start 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2d00de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5c8d0 0x55bca2d01320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5d1f0 0x55bca2cb1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2aaea20 con 0x55bca2c5d1f0 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca2aad3a0 con 0x55bca2c5c8d0 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bca2ab85c0 con 0x55bca2c5bfb0 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 10 client.0 _ll_register_callbacks cb 0x55bca2c44470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5d1f0 0x55bca2cb1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5d1f0 0x55bca2cb1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35784/0 (socket says 172.21.15.50:35784) 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 -- 172.21.15.50:0/839220033 learned_addr learned my addr 172.21.15.50:0/839220033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:04.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd012000640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5c8d0 0x55bca2d01320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd012a00640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2d00de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 -- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 msgr2=0x55bca2d00de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2d00de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 -- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5c8d0 msgr2=0x55bca2d01320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5c8d0 0x55bca2d01320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 -- 172.21.15.50:0/839220033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0140bae80 con 0x55bca2c5d1f0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd012000640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5c8d0 0x55bca2d01320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd013400640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5d1f0 0x55bca2cb1110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b8fd0 tx=0x7fd00c0ec8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4b442b25a71986 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 1 -- 172.21.15.50:0/839220033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0bc070 con 0x55bca2c5d1f0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 1 -- 172.21.15.50:0/839220033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd00c0f8520 con 0x55bca2c5d1f0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bca2a63640 con 0x55bca2c5d1f0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 1 -- 172.21.15.50:0/839220033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd00c0f4120 con 0x55bca2c5d1f0 2024-01-30T08:10:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 10 client.5424 fetch_fsmap learned FSMap version 18 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55bca2a6fb80 con 0x55bca2c5d1f0 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 1 -- 172.21.15.50:0/839220033 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bca2a63640 con 0x55bca2c5d1f0 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 1 -- 172.21.15.50:0/839220033 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd00c005d20 con 0x55bca2c5d1f0 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 10 client.5424 fetch_fsmap finished waiting for FSMap version 18 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 10 client.5424 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 20 client.5424 populate_metadata read hostname 'smithi050' 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2cb1a70 0x55bca2cb1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 4 client.5424 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 --> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bca2aa8a20 con 0x55bca2cb1a70 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd012a00640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2cb1a70 0x55bca2cb1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd012a00640 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2cb1a70 0x55bca2cb1e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e69d78fd3e95d40 server_cookie=a9ceef50fa4a5bc9 in_seq=0 out_seq=0 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 10 client.5424 ms_handle_connect on v2:172.21.15.50:6834/1837689837 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 1 -- 172.21.15.50:0/839220033 <== mds.0 v2:172.21.15.50:6834/1837689837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55bca2aa8a20 con 0x55bca2cb1a70 2024-01-30T08:10:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fcffbe00640 10 client.5424 handle_command_reply: tid=0 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 client.5424 shutdown 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5d1f0 msgr2=0x55bca2cb1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.405+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5d1f0 0x55bca2cb1110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b8fd0 tx=0x7fd00c0ec8a0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 shutdown_connections 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:6834/1837689837,v1:172.21.15.50:6835/1837689837] conn(0x55bca2cb1a70 0x55bca2cb1e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bca2c5c8d0 0x55bca2d01320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bca2c5d1f0 0x55bca2cb1110 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 --2- 172.21.15.50:0/839220033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55bca2c5bfb0 0x55bca2d00de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fcffbe00640 0 client.5424 ms_handle_reset on v2:172.21.15.50:6834/1837689837 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 >> 172.21.15.50:0/839220033 conn(0x55bca2c9a270 msgr2=0x55bca2cac770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 shutdown_connections 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 1 -- 172.21.15.50:0/839220033 wait complete. 2024-01-30T08:10:04.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd01d0fa000 20 client.5424 trim_cache size 0 max 16384 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "d5419c7a-21ba-491f-86e9-4d6001549d1c", 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5214, 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 10.483517667999999, 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 18, 2024-01-30T08:10:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 39, 2024-01-30T08:10:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 39, 2024-01-30T08:10:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 18.356744723999999 2024-01-30T08:10:04.415 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfec066500 msgr2=0x7fcfec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfec066500 0x7fcfec0689c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd0140a6760 tx=0x7fcffc009040 comp rx=0 tx=0).stop 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd014151e20 msgr2=0x7fd0141f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd014151e20 0x7fd0141f0d70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b0040 tx=0x7fd00c0195d0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 shutdown_connections 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcfec066500 0x7fcfec0689c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd014151e20 0x7fd0141f0d70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0140c3a10 0x7fd0141f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 --2- 172.21.15.50:0/340146620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd01406de20 0x7fd0140ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 >> 172.21.15.50:0/340146620 conn(0x7fd0140c5f10 msgr2=0x7fd0140bf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 shutdown_connections 2024-01-30T08:10:04.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.409+0000 7fd019c00640 1 -- 172.21.15.50:0/340146620 wait complete. 2024-01-30T08:10:04.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-30T08:10:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.569+0000 7fda76c00640 1 Processor -- start 2024-01-30T08:10:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda76c00640 1 -- start start 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda76c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda700c1de0 0x7fda701559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda76c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda700c3ed0 con 0x7fda700c0ee0 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda76c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7006bca0 con 0x7fda7014fbf0 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda76c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda700a5520 con 0x7fda700c1de0 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda74c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda700c1de0 0x7fda701559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda74c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda700c1de0 0x7fda701559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35790/0 (socket says 172.21.15.50:35790) 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda74c00640 1 -- 172.21.15.50:0/3868311275 learned_addr learned my addr 172.21.15.50:0/3868311275 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda6f400640 1 --1- 172.21.15.50:0/3868311275 >> v1:172.21.15.50:6789/0 conn(0x7fda700c0ee0 0x7fda7006a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39408/0 (socket says 172.21.15.50:39408) 2024-01-30T08:10:04.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda74c00640 1 -- 172.21.15.50:0/3868311275 >> v1:172.21.15.125:6789/0 conn(0x7fda7014fbf0 legacy=0x7fda700a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda74c00640 1 -- 172.21.15.50:0/3868311275 >> v1:172.21.15.50:6789/0 conn(0x7fda700c0ee0 legacy=0x7fda7006a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda74c00640 1 -- 172.21.15.50:0/3868311275 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7006bef0 con 0x7fda700c1de0 2024-01-30T08:10:04.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.573+0000 7fda6ea00640 1 -- 172.21.15.50:0/3868311275 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277566177 0 0) 0x7fda700c3ed0 con 0x7fda700c0ee0 2024-01-30T08:10:04.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda74c00640 1 --2- 172.21.15.50:0/3868311275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda701559c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda68009e50 tx=0x7fda6801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181b012f496a009c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda6ea00640 1 -- 172.21.15.50:0/3868311275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda680a57d0 con 0x7fda700c1de0 2024-01-30T08:10:04.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda6ea00640 1 -- 172.21.15.50:0/3868311275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda680a5930 con 0x7fda700c1de0 2024-01-30T08:10:04.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda6ea00640 1 -- 172.21.15.50:0/3868311275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda680a5cc0 con 0x7fda700c1de0 2024-01-30T08:10:04.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 -- 172.21.15.50:0/3868311275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 msgr2=0x7fda701559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 --2- 172.21.15.50:0/3868311275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda701559c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda68009e50 tx=0x7fda6801c8f0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 -- 172.21.15.50:0/3868311275 shutdown_connections 2024-01-30T08:10:04.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 --2- 172.21.15.50:0/3868311275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda701559c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 -- 172.21.15.50:0/3868311275 >> 172.21.15.50:0/3868311275 conn(0x7fda700c5b50 msgr2=0x7fda700c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 -- 172.21.15.50:0/3868311275 shutdown_connections 2024-01-30T08:10:04.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 -- 172.21.15.50:0/3868311275 wait complete. 2024-01-30T08:10:04.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 Processor -- start 2024-01-30T08:10:04.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.577+0000 7fda76c00640 1 -- start start 2024-01-30T08:10:04.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda700c0ee0 0x7fda700a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda7014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7014fbf0 0x7fda7014e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda701519f0 con 0x7fda700c1de0 2024-01-30T08:10:04.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda700c0ca0 con 0x7fda7014fbf0 2024-01-30T08:10:04.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda701eef00 con 0x7fda700c0ee0 2024-01-30T08:10:04.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda7014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda7014e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35792/0 (socket says 172.21.15.50:35792) 2024-01-30T08:10:04.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 -- 172.21.15.50:0/16788019 learned_addr learned my addr 172.21.15.50:0/16788019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:04.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6fe00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda700c0ee0 0x7fda700a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda74c00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7014fbf0 0x7fda7014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 -- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda700c0ee0 msgr2=0x7fda700a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda700c0ee0 0x7fda700a6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 -- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7014fbf0 msgr2=0x7fda7014e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7014fbf0 0x7fda7014e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 -- 172.21.15.50:0/16788019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68009b30 con 0x7fda700c1de0 2024-01-30T08:10:04.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda6f400640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda7014e450 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c410 tx=0x7fda5800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda67e00640 1 -- 172.21.15.50:0/16788019 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580074e0 con 0x7fda700c1de0 2024-01-30T08:10:04.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda67e00640 1 -- 172.21.15.50:0/16788019 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58007640 con 0x7fda700c1de0 2024-01-30T08:10:04.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda67e00640 1 -- 172.21.15.50:0/16788019 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58004a30 con 0x7fda700c1de0 2024-01-30T08:10:04.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda701ef1e0 con 0x7fda700c1de0 2024-01-30T08:10:04.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7014dfc0 con 0x7fda700c1de0 2024-01-30T08:10:04.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.581+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda70151ba0 con 0x7fda700c1de0 2024-01-30T08:10:04.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.585+0000 7fda67e00640 1 -- 172.21.15.50:0/16788019 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fda58004b90 con 0x7fda700c1de0 2024-01-30T08:10:04.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.585+0000 7fda67e00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fda48066500 0x7fda480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:04.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.585+0000 7fda67e00640 1 -- 172.21.15.50:0/16788019 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fda58083cd0 con 0x7fda700c1de0 2024-01-30T08:10:04.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.585+0000 7fda6fe00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fda48066500 0x7fda480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:04.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.585+0000 7fda6fe00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fda48066500 0x7fda480689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda70155960 tx=0x7fda60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:04.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.589+0000 7fda67e00640 1 -- 172.21.15.50:0/16788019 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fda70151ba0 con 0x7fda700c1de0 2024-01-30T08:10:04.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fda70074a20 con 0x7fda700c1de0 2024-01-30T08:10:04.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda67e00640 1 -- 172.21.15.50:0/16788019 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fda58050ed0 con 0x7fda700c1de0 2024-01-30T08:10:04.790 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-30T08:10:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fda48066500 msgr2=0x7fda480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fda48066500 0x7fda480689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda70155960 tx=0x7fda60009040 comp rx=0 tx=0).stop 2024-01-30T08:10:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 msgr2=0x7fda7014e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:04.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda7014e450 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c410 tx=0x7fda5800c8d0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 shutdown_connections 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda7014fbf0 0x7fda7014e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fda48066500 0x7fda480689c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda700c1de0 0x7fda7014e450 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 --2- 172.21.15.50:0/16788019 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fda700c0ee0 0x7fda700a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 >> 172.21.15.50:0/16788019 conn(0x7fda700c5b50 msgr2=0x7fda700c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 shutdown_connections 2024-01-30T08:10:04.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:04.789+0000 7fda76c00640 1 -- 172.21.15.50:0/16788019 wait complete. 2024-01-30T08:10:04.812 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-30T08:10:04.812 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-30T08:10:04.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-01-30T08:10:04.812 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-30T08:10:04.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:04.812 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-30T08:10:04.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-30T08:10:04.813 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-30T08:10:04.813 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:10:04.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:04.813 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-01-30T08:10:04.822 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-30T08:10:04.822 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-30T08:10:04.822 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-01-30T08:10:04.822 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-30T08:10:04.823 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42406sec preferred_lft 42406sec 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:71:66:23:2b brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-30T08:10:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:04.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:04.826 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-30T08:10:04.887 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-01-30T08:10:04.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:04.889 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-01-30T08:10:04.943 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-01-30T08:10:04.943 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-30T08:10:04.944 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-30T08:10:04.944 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-30T08:10:04.944 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-30T08:10:04.944 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-30T08:10:04.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:04.944 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:10:04.944 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:10:04.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-30T08:10:04.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-30T08:10:04.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-30T08:10:04.945 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:10:05.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.035 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-01-30T08:10:05.044 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-30T08:10:05.045 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:10:05.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-01-30T08:10:05.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:05.108 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:05.157 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:10:05.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:05.158 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:05.208 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-30T08:10:05.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:10:05.299 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:10:05.299 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-30T08:10:05.299 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:10:05.315 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:10:05.315 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-30T08:10:05.315 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:10:05.315 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:05.315 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:05.324 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-30T08:10:05.325 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-30T08:10:05.325 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:10:05.325 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:05.325 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:05.325 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790" 2024-01-30T08:10:05.325 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790:/ 2024-01-30T08:10:05.325 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d5419c7a-21ba-491f-86e9-4d6001549d1c" will pass to kernel 2024-01-30T08:10:05.328 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-30T08:10:05.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:05.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.350 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:10:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:client5371 2024-01-30T08:10:05.410 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:05.410 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:05.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-30T08:10:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.645+0000 7f976ee00640 1 Processor -- start 2024-01-30T08:10:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ee00640 1 -- start start 2024-01-30T08:10:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ee00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f976806ab20 0x7f976815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ee00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680c40c0 con 0x7f97680c4b60 2024-01-30T08:10:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ee00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976806af50 con 0x7f976806a740 2024-01-30T08:10:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ee00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97680aa350 con 0x7f976806ab20 2024-01-30T08:10:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ce00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f976806ab20 0x7f976815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f9767400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f97680c4b60 0x7f97680a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39412/0 (socket says 172.21.15.50:39412) 2024-01-30T08:10:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f9767400640 1 -- 172.21.15.50:0/96615594 learned_addr learned my addr 172.21.15.50:0/96615594 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ce00640 1 -- 172.21.15.50:0/96615594 >> v1:172.21.15.125:6789/0 conn(0x7f976806a740 legacy=0x7f97680c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ce00640 1 -- 172.21.15.50:0/96615594 >> v1:172.21.15.50:6789/0 conn(0x7f97680c4b60 legacy=0x7f97680a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:05.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f976ce00640 1 -- 172.21.15.50:0/96615594 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680aa070 con 0x7f976806ab20 2024-01-30T08:10:05.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.649+0000 7f9766a00640 1 -- 172.21.15.50:0/96615594 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389550818 0 0) 0x7f97680c40c0 con 0x7f97680c4b60 2024-01-30T08:10:05.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ce00640 1 --2- 172.21.15.50:0/96615594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806ab20 0x7f976815fa60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9760009d90 tx=0x7f976001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45c907d00b48154 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:05.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f9766a00640 1 -- 172.21.15.50:0/96615594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5870 con 0x7f976806ab20 2024-01-30T08:10:05.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f9766a00640 1 -- 172.21.15.50:0/96615594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600a59d0 con 0x7f976806ab20 2024-01-30T08:10:05.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f9766a00640 1 -- 172.21.15.50:0/96615594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5d60 con 0x7f976806ab20 2024-01-30T08:10:05.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 -- 172.21.15.50:0/96615594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806ab20 msgr2=0x7f976815fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:05.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 --2- 172.21.15.50:0/96615594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806ab20 0x7f976815fa60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9760009d90 tx=0x7f976001c8c0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 -- 172.21.15.50:0/96615594 shutdown_connections 2024-01-30T08:10:05.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 --2- 172.21.15.50:0/96615594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806ab20 0x7f976815fa60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 -- 172.21.15.50:0/96615594 >> 172.21.15.50:0/96615594 conn(0x7f97680c5b50 msgr2=0x7f97680c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:05.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 -- 172.21.15.50:0/96615594 shutdown_connections 2024-01-30T08:10:05.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 -- 172.21.15.50:0/96615594 wait complete. 2024-01-30T08:10:05.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 Processor -- start 2024-01-30T08:10:05.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.653+0000 7f976ee00640 1 -- start start 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806a740 0x7f976806dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f976806ab20 0x7f976806c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97680c4b60 0x7f97681f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97681f1790 con 0x7f976806a740 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768159e90 con 0x7f97680c4b60 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97681582d0 con 0x7f976806ab20 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806a740 0x7f976806dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806a740 0x7f976806dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35812/0 (socket says 172.21.15.50:35812) 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 -- 172.21.15.50:0/3379169710 learned_addr learned my addr 172.21.15.50:0/3379169710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767400640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f976806ab20 0x7f976806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ce00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97680c4b60 0x7f97681f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 -- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f976806ab20 msgr2=0x7f976806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f976806ab20 0x7f976806c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 -- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97680c4b60 msgr2=0x7f97681f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:05.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97680c4b60 0x7f97681f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 -- 172.21.15.50:0/3379169710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009a70 con 0x7f976806a740 2024-01-30T08:10:05.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f9767e00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806a740 0x7f976806dc10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f975800c3f0 tx=0x7f975800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f975fe00640 1 -- 172.21.15.50:0/3379169710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580052d0 con 0x7f976806a740 2024-01-30T08:10:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f975fe00640 1 -- 172.21.15.50:0/3379169710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758005430 con 0x7f976806a740 2024-01-30T08:10:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97681585b0 con 0x7f976806a740 2024-01-30T08:10:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f975fe00640 1 -- 172.21.15.50:0/3379169710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758003840 con 0x7f976806a740 2024-01-30T08:10:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9768153e50 con 0x7f976806a740 2024-01-30T08:10:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.657+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9768074a20 con 0x7f976806a740 2024-01-30T08:10:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.661+0000 7f975fe00640 1 -- 172.21.15.50:0/3379169710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f97580039a0 con 0x7f976806a740 2024-01-30T08:10:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.661+0000 7f975fe00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9740066500 0x7f97400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.661+0000 7f975fe00640 1 -- 172.21.15.50:0/3379169710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9758083470 con 0x7f976806a740 2024-01-30T08:10:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.661+0000 7f9767400640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9740066500 0x7f97400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.661+0000 7f9767400640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9740066500 0x7f97400689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f976814d920 tx=0x7f9750007240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:05.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.665+0000 7f975fe00640 1 -- 172.21.15.50:0/3379169710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9758050670 con 0x7f976806a740 2024-01-30T08:10:05.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.857+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f976806b3f0 con 0x7f976806a740 2024-01-30T08:10:05.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.857+0000 7f975fe00640 1 -- 172.21.15.50:0/3379169710 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9758053c90 con 0x7f976806a740 2024-01-30T08:10:05.860 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9740066500 msgr2=0x7f97400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9740066500 0x7f97400689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f976814d920 tx=0x7f9750007240 comp rx=0 tx=0).stop 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806a740 msgr2=0x7f976806dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806a740 0x7f976806dc10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f975800c3f0 tx=0x7f975800c8b0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 shutdown_connections 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97680c4b60 0x7f97681f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9740066500 0x7f97400689c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f976806ab20 0x7f976806c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 --2- 172.21.15.50:0/3379169710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f976806a740 0x7f976806dc10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 >> 172.21.15.50:0/3379169710 conn(0x7f97680c5b50 msgr2=0x7f97680c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 shutdown_connections 2024-01-30T08:10:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:05.861+0000 7f976ee00640 1 -- 172.21.15.50:0/3379169710 wait complete. 2024-01-30T08:10:05.882 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-30T08:10:05.882 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-30T08:10:05.883 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2024-01-30T08:10:05.883 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-30T08:10:05.883 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:05.883 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-30T08:10:05.883 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-30T08:10:05.883 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-30T08:10:05.883 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:10:05.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.883 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:05.894 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-30T08:10:05.895 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:a8:fd:47:70 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:05.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.896 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-30T08:10:05.953 INFO:teuthology.orchestra.run.smithi125.stdout:1 2024-01-30T08:10:05.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:05.955 DEBUG:teuthology.orchestra.run.smithi125:> route 2024-01-30T08:10:06.010 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2024-01-30T08:10:06.010 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-30T08:10:06.010 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-30T08:10:06.010 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-30T08:10:06.010 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-30T08:10:06.010 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-30T08:10:06.011 INFO:teuthology.orchestra.run.smithi125.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:10:06.011 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:10:06.011 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:10:06.011 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-30T08:10:06.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:06.011 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-01-30T08:10:06.011 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-01-30T08:10:06.011 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-30T08:10:06.011 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-30T08:10:06.011 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-30T08:10:06.011 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-01-30T08:10:06.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:06.102 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-01-30T08:10:06.110 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-30T08:10:06.111 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:10:06.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:06.111 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2024-01-30T08:10:06.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:06.175 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:06.227 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:10:06.227 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:06.227 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:06.278 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-30T08:10:06.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:06.278 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:10:06.368 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:10:06.369 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-30T08:10:06.369 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:10:06.384 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:10:06.384 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-30T08:10:06.385 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:10:06.385 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:06.385 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:06.393 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-30T08:10:06.394 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-30T08:10:06.394 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:10:06.394 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:06.394 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:06.394 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790" 2024-01-30T08:10:06.394 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790:/ 2024-01-30T08:10:06.394 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=d5419c7a-21ba-491f-86e9-4d6001549d1c" will pass to kernel 2024-01-30T08:10:06.398 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-30T08:10:06.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:06.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:06.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:06.417 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:10:06.474 INFO:teuthology.orchestra.run.smithi125.stdout:client5042 2024-01-30T08:10:06.474 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:06.474 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:06.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-30T08:10:06.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e7b600640 1 Processor -- start 2024-01-30T08:10:06.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e7b600640 1 -- start start 2024-01-30T08:10:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740c4810 0x7f1e740c0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e7b600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e740bb980 0x7f1e74154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e7b600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e740a80a0 con 0x7f1e740bca00 2024-01-30T08:10:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e7b600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e740c1bd0 con 0x7f1e740bb980 2024-01-30T08:10:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e7b600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740c3ff0 con 0x7f1e740c4810 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e79600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e740bb980 0x7f1e74154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e79600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e740bb980 0x7f1e74154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35824/0 (socket says 172.21.15.50:35824) 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e79600640 1 -- 172.21.15.50:0/213168443 learned_addr learned my addr 172.21.15.50:0/213168443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e78c00640 1 --2- 172.21.15.50:0/213168443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740c4810 0x7f1e740c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e79600640 1 -- 172.21.15.50:0/213168443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740c4810 msgr2=0x7f1e740c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e79600640 1 --2- 172.21.15.50:0/213168443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740c4810 0x7f1e740c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e79600640 1 -- 172.21.15.50:0/213168443 >> v1:172.21.15.125:6789/0 conn(0x7f1e740bca00 legacy=0x7f1e740c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.669+0000 7f1e79600640 1 -- 172.21.15.50:0/213168443 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740a7770 con 0x7f1e740bb980 2024-01-30T08:10:06.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e79600640 1 --2- 172.21.15.50:0/213168443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740bb980 0x7f1e74154b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e50 tx=0x7f1e6c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f25f3792c998d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:06.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e73400640 1 -- 172.21.15.50:0/213168443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0a5680 con 0x7f1e740bb980 2024-01-30T08:10:06.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e73400640 1 -- 172.21.15.50:0/213168443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0a57e0 con 0x7f1e740bb980 2024-01-30T08:10:06.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e73400640 1 -- 172.21.15.50:0/213168443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0a5b70 con 0x7f1e740bb980 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 -- 172.21.15.50:0/213168443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740bb980 msgr2=0x7f1e74154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 --2- 172.21.15.50:0/213168443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740bb980 0x7f1e74154b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e50 tx=0x7f1e6c01c950 comp rx=0 tx=0).stop 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 -- 172.21.15.50:0/213168443 shutdown_connections 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 --2- 172.21.15.50:0/213168443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740bb980 0x7f1e74154b10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 --2- 172.21.15.50:0/213168443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740c4810 0x7f1e740c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 -- 172.21.15.50:0/213168443 >> 172.21.15.50:0/213168443 conn(0x7f1e740c5f10 msgr2=0x7f1e740c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 -- 172.21.15.50:0/213168443 shutdown_connections 2024-01-30T08:10:06.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.673+0000 7f1e7b600640 1 -- 172.21.15.50:0/213168443 wait complete. 2024-01-30T08:10:06.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 Processor -- start 2024-01-30T08:10:06.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 -- start start 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740bb980 0x7f1e740ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e740bca00 0x7f1e7414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740c4810 0x7f1e7415f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740aa890 con 0x7f1e740c4810 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740ab000 con 0x7f1e740bca00 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741f11c0 con 0x7f1e740bb980 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740c4810 0x7f1e7415f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740c4810 0x7f1e7415f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35828/0 (socket says 172.21.15.50:35828) 2024-01-30T08:10:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e78c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740bb980 0x7f1e740ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 -- 172.21.15.50:0/2475814770 learned_addr learned my addr 172.21.15.50:0/2475814770 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e73e00640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e740bca00 0x7f1e7414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 -- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740bb980 msgr2=0x7f1e740ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740bb980 0x7f1e740ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 -- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e740bca00 msgr2=0x7f1e7414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e740bca00 0x7f1e7414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 -- 172.21.15.50:0/2475814770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009b30 con 0x7f1e740c4810 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e79600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740c4810 0x7f1e7415f4e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c01a580 tx=0x7f1e6c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e70c00640 1 -- 172.21.15.50:0/2475814770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0b8670 con 0x7f1e740c4810 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e70c00640 1 -- 172.21.15.50:0/2475814770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0b87d0 con 0x7f1e740c4810 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e741f14a0 con 0x7f1e740c4810 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e70c00640 1 -- 172.21.15.50:0/2475814770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0b8b40 con 0x7f1e740c4810 2024-01-30T08:10:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.677+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7415bb00 con 0x7f1e740c4810 2024-01-30T08:10:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.681+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e740aad20 con 0x7f1e740c4810 2024-01-30T08:10:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.681+0000 7f1e70c00640 1 -- 172.21.15.50:0/2475814770 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1e6c0b8ca0 con 0x7f1e740c4810 2024-01-30T08:10:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.681+0000 7f1e70c00640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1e4c066500 0x7f1e4c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.681+0000 7f1e70c00640 1 -- 172.21.15.50:0/2475814770 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e6c11f320 con 0x7f1e740c4810 2024-01-30T08:10:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.681+0000 7f1e78c00640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1e4c066500 0x7f1e4c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:06.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.681+0000 7f1e78c00640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1e4c066500 0x7f1e4c0689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e740bd0e0 tx=0x7f1e64009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.685+0000 7f1e70c00640 1 -- 172.21.15.50:0/2475814770 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1e740aad20 con 0x7f1e740c4810 2024-01-30T08:10:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.897+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f1e740aad20 con 0x7f1e740c4810 2024-01-30T08:10:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.897+0000 7f1e70c00640 1 -- 172.21.15.50:0/2475814770 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7f1e740aad20 con 0x7f1e740c4810 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1e4c066500 msgr2=0x7f1e4c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1e4c066500 0x7f1e4c0689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e740bd0e0 tx=0x7f1e64009190 comp rx=0 tx=0).stop 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740c4810 msgr2=0x7f1e7415f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740c4810 0x7f1e7415f4e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c01a580 tx=0x7f1e6c0196f0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 shutdown_connections 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e740bca00 0x7f1e7414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1e4c066500 0x7f1e4c0689c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e740c4810 0x7f1e7415f4e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 --2- 172.21.15.50:0/2475814770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e740bb980 0x7f1e740ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 >> 172.21.15.50:0/2475814770 conn(0x7f1e740c5f10 msgr2=0x7f1e7414c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:06.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 shutdown_connections 2024-01-30T08:10:06.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:06.901+0000 7f1e7b600640 1 -- 172.21.15.50:0/2475814770 wait complete. 2024-01-30T08:10:06.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.061+0000 7ff1cdc00640 1 Processor -- start 2024-01-30T08:10:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.061+0000 7ff1cdc00640 1 -- start start 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1cdc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1c80c1840 0x7ff1c80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1cdc00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1c80c5650 0x7ff1c80a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1cdc00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c80a8cf0 con 0x7ff1c80c4760 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1cdc00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c8072a30 con 0x7ff1c80c1840 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1cdc00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c80a8f40 con 0x7ff1c80c5650 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1c80c1840 0x7ff1c80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1c80c1840 0x7ff1c80a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35830/0 (socket says 172.21.15.50:35830) 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6a00640 1 -- 172.21.15.50:0/2988927303 learned_addr learned my addr 172.21.15.50:0/2988927303 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6000640 1 --2- 172.21.15.50:0/2988927303 >> v2:172.21.15.125:3300/0 conn(0x7ff1c80c5650 0x7ff1c80a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6a00640 1 -- 172.21.15.50:0/2988927303 >> v2:172.21.15.125:3300/0 conn(0x7ff1c80c5650 msgr2=0x7ff1c80a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6a00640 1 --2- 172.21.15.50:0/2988927303 >> v2:172.21.15.125:3300/0 conn(0x7ff1c80c5650 0x7ff1c80a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6a00640 1 -- 172.21.15.50:0/2988927303 >> v1:172.21.15.125:6789/0 conn(0x7ff1c80c4760 legacy=0x7ff1c806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.065+0000 7ff1c6a00640 1 -- 172.21.15.50:0/2988927303 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c8072cd0 con 0x7ff1c80c1840 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1c6a00640 1 --2- 172.21.15.50:0/2988927303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c1840 0x7ff1c80a4d50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80729c0 tx=0x7ff1b801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7796e13c46e0d3e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1c5600640 1 -- 172.21.15.50:0/2988927303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80ad680 con 0x7ff1c80c1840 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1c5600640 1 -- 172.21.15.50:0/2988927303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b80ad7e0 con 0x7ff1c80c1840 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1c5600640 1 -- 172.21.15.50:0/2988927303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80adb70 con 0x7ff1c80c1840 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 -- 172.21.15.50:0/2988927303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c1840 msgr2=0x7ff1c80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/2988927303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c1840 0x7ff1c80a4d50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80729c0 tx=0x7ff1b801c3e0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 -- 172.21.15.50:0/2988927303 shutdown_connections 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/2988927303 >> v2:172.21.15.125:3300/0 conn(0x7ff1c80c5650 0x7ff1c80a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/2988927303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c1840 0x7ff1c80a4d50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 -- 172.21.15.50:0/2988927303 >> 172.21.15.50:0/2988927303 conn(0x7ff1c80c5b50 msgr2=0x7ff1c80c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 -- 172.21.15.50:0/2988927303 shutdown_connections 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 -- 172.21.15.50:0/2988927303 wait complete. 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 Processor -- start 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.069+0000 7ff1cdc00640 1 -- start start 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80c1840 0x7ff1c81f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1c80c4760 0x7ff1c815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c5650 0x7ff1c8147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c814fe30 con 0x7ff1c80c5650 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c81f1610 con 0x7ff1c80c1840 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c814d120 con 0x7ff1c80c4760 2024-01-30T08:10:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c5650 0x7ff1c8147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c6a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80c1840 0x7ff1c81f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c6000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1c80c4760 0x7ff1c815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c5650 0x7ff1c8147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35840/0 (socket says 172.21.15.50:35840) 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 -- 172.21.15.50:0/1002374237 learned_addr learned my addr 172.21.15.50:0/1002374237 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c6a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80c1840 0x7ff1c81f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:39954/0 (socket says 172.21.15.50:39954) 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 -- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1c80c4760 msgr2=0x7ff1c815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1c80c4760 0x7ff1c815a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 -- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80c1840 msgr2=0x7ff1c81f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80c1840 0x7ff1c81f0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 -- 172.21.15.50:0/1002374237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80094d0 con 0x7ff1c80c5650 2024-01-30T08:10:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c6000640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1c80c4760 0x7ff1c815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1c7400640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c5650 0x7ff1c8147910 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000c730 tx=0x7ff1c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1bea00640 1 -- 172.21.15.50:0/1002374237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0003b80 con 0x7ff1c80c5650 2024-01-30T08:10:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1bea00640 1 -- 172.21.15.50:0/1002374237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0003ce0 con 0x7ff1c80c5650 2024-01-30T08:10:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1bea00640 1 -- 172.21.15.50:0/1002374237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000aa30 con 0x7ff1c80c5650 2024-01-30T08:10:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c814d400 con 0x7ff1c80c5650 2024-01-30T08:10:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c81ed140 con 0x7ff1c80c5650 2024-01-30T08:10:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.073+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c81ed330 con 0x7ff1c80c5650 2024-01-30T08:10:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.077+0000 7ff1bea00640 1 -- 172.21.15.50:0/1002374237 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff1c000ab90 con 0x7ff1c80c5650 2024-01-30T08:10:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.077+0000 7ff1bea00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1a0066500 0x7ff1a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.077+0000 7ff1bea00640 1 -- 172.21.15.50:0/1002374237 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff1c0083d00 con 0x7ff1c80c5650 2024-01-30T08:10:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.077+0000 7ff1c6a00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1a0066500 0x7ff1a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.077+0000 7ff1c6a00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1a0066500 0x7ff1a00689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80af000 tx=0x7ff1b80a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.081+0000 7ff1bea00640 1 -- 172.21.15.50:0/1002374237 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff1c0050e70 con 0x7ff1c80c5650 2024-01-30T08:10:07.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.245+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1c8074a20 con 0x7ff1c80c5650 2024-01-30T08:10:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.245+0000 7ff1bea00640 1 -- 172.21.15.50:0/1002374237 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16775 (secure 0 0 0) 0x7ff1c0054490 con 0x7ff1c80c5650 2024-01-30T08:10:07.248 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:07.248 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:09:54.862108+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1a0066500 msgr2=0x7ff1a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1a0066500 0x7ff1a00689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80af000 tx=0x7ff1b80a7000 comp rx=0 tx=0).stop 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c5650 msgr2=0x7ff1c8147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c5650 0x7ff1c8147910 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000c730 tx=0x7ff1c000cbf0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 shutdown_connections 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff1a0066500 0x7ff1a00689c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80c5650 0x7ff1c8147910 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff1c80c4760 0x7ff1c815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 --2- 172.21.15.50:0/1002374237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c80c1840 0x7ff1c81f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 >> 172.21.15.50:0/1002374237 conn(0x7ff1c80c5b50 msgr2=0x7ff1c80a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:07.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 shutdown_connections 2024-01-30T08:10:07.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.249+0000 7ff1cdc00640 1 -- 172.21.15.50:0/1002374237 wait complete. 2024-01-30T08:10:07.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:09:51.121360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:09:52.315187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:10:07.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:10:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033c600640 1 Processor -- start 2024-01-30T08:10:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033c600640 1 -- start start 2024-01-30T08:10:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033c600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0334155500 0x7f03340c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033c600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0334158b70 con 0x7f033406f6a0 2024-01-30T08:10:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033c600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0334157f60 con 0x7f033406f240 2024-01-30T08:10:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033c600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033406fb10 con 0x7f0334155500 2024-01-30T08:10:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033a600640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f033406f6a0 0x7f03340c1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39418/0 (socket says 172.21.15.50:39418) 2024-01-30T08:10:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f033a600640 1 -- 172.21.15.50:0/3029292624 learned_addr learned my addr 172.21.15.50:0/3029292624 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f0339c00640 1 --2- 172.21.15.50:0/3029292624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0334155500 0x7f03340c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f0333e00640 1 -- 172.21.15.50:0/3029292624 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021014523 0 0) 0x7f0334158b70 con 0x7f033406f6a0 2024-01-30T08:10:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f0333e00640 1 -- 172.21.15.50:0/3029292624 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0314003530 con 0x7f033406f6a0 2024-01-30T08:10:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.413+0000 7f0333e00640 1 -- 172.21.15.50:0/3029292624 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093907185 0 0) 0x7f0334157f60 con 0x7f033406f240 2024-01-30T08:10:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0333e00640 1 -- 172.21.15.50:0/3029292624 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0334158b70 con 0x7f033406f240 2024-01-30T08:10:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0339c00640 1 -- 172.21.15.50:0/3029292624 >> v1:172.21.15.125:6789/0 conn(0x7f033406f240 legacy=0x7f03340c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0339c00640 1 -- 172.21.15.50:0/3029292624 >> v1:172.21.15.50:6789/0 conn(0x7f033406f6a0 legacy=0x7f03340c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0339c00640 1 -- 172.21.15.50:0/3029292624 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334158240 con 0x7f0334155500 2024-01-30T08:10:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0339c00640 1 --2- 172.21.15.50:0/3029292624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0334155500 0x7f03340c85e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03240097f0 tx=0x7f032401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff55791e8bb3b802 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0333e00640 1 -- 172.21.15.50:0/3029292624 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240ab600 con 0x7f0334155500 2024-01-30T08:10:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0333e00640 1 -- 172.21.15.50:0/3029292624 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03240a7050 con 0x7f0334155500 2024-01-30T08:10:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f0333e00640 1 -- 172.21.15.50:0/3029292624 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240ab980 con 0x7f0334155500 2024-01-30T08:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f033c600640 1 -- 172.21.15.50:0/3029292624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0334155500 msgr2=0x7f03340c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.417+0000 7f033c600640 1 --2- 172.21.15.50:0/3029292624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0334155500 0x7f03340c85e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03240097f0 tx=0x7f032401c370 comp rx=0 tx=0).stop 2024-01-30T08:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- 172.21.15.50:0/3029292624 shutdown_connections 2024-01-30T08:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 --2- 172.21.15.50:0/3029292624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0334155500 0x7f03340c85e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- 172.21.15.50:0/3029292624 >> 172.21.15.50:0/3029292624 conn(0x7f03340727c0 msgr2=0x7f033406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- 172.21.15.50:0/3029292624 shutdown_connections 2024-01-30T08:10:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- 172.21.15.50:0/3029292624 wait complete. 2024-01-30T08:10:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 Processor -- start 2024-01-30T08:10:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- start start 2024-01-30T08:10:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033406f240 0x7f03340c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f033406f6a0 0x7f03341eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0334155500 0x7f03341ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334152510 con 0x7f033406f240 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340aa560 con 0x7f0334155500 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033c600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340a79d0 con 0x7f033406f6a0 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033406f240 0x7f03340c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033406f240 0x7f03340c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35854/0 (socket says 172.21.15.50:35854) 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 -- 172.21.15.50:0/4013430259 learned_addr learned my addr 172.21.15.50:0/4013430259 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033a600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0334155500 0x7f03341ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339200640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f033406f6a0 0x7f03341eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 -- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f033406f6a0 msgr2=0x7f03341eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f033406f6a0 0x7f03341eca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 -- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0334155500 msgr2=0x7f03341ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0334155500 0x7f03341ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f0339c00640 1 -- 172.21.15.50:0/4013430259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009420 con 0x7f033406f240 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.421+0000 7f033a600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0334155500 0x7f03341ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0339c00640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033406f240 0x7f03340c3090 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f03240097f0 tx=0x7f0324019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0331600640 1 -- 172.21.15.50:0/4013430259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240b5470 con 0x7f033406f240 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0331600640 1 -- 172.21.15.50:0/4013430259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03240b5610 con 0x7f033406f240 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03340aa7b0 con 0x7f033406f240 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0331600640 1 -- 172.21.15.50:0/4013430259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240b59c0 con 0x7f033406f240 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0334152130 con 0x7f033406f240 2024-01-30T08:10:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0334074a20 con 0x7f033406f240 2024-01-30T08:10:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0331600640 1 -- 172.21.15.50:0/4013430259 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f03240b2040 con 0x7f033406f240 2024-01-30T08:10:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0331600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f030c066500 0x7f030c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0331600640 1 -- 172.21.15.50:0/4013430259 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f032411e3c0 con 0x7f033406f240 2024-01-30T08:10:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.425+0000 7f0339200640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f030c066500 0x7f030c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.429+0000 7f0339200640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f030c066500 0x7f030c0689c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f033415f360 tx=0x7f031c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.429+0000 7f0331600640 1 -- 172.21.15.50:0/4013430259 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f03240eb510 con 0x7f033406f240 2024-01-30T08:10:07.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.589+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03340c83c0 con 0x7f033406f240 2024-01-30T08:10:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.589+0000 7f0331600640 1 -- 172.21.15.50:0/4013430259 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03240b0020 con 0x7f033406f240 2024-01-30T08:10:07.593 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:10:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f030c066500 msgr2=0x7f030c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f030c066500 0x7f030c0689c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f033415f360 tx=0x7f031c009040 comp rx=0 tx=0).stop 2024-01-30T08:10:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033406f240 msgr2=0x7f03340c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033406f240 0x7f03340c3090 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f03240097f0 tx=0x7f0324019110 comp rx=0 tx=0).stop 2024-01-30T08:10:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 shutdown_connections 2024-01-30T08:10:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0334155500 0x7f03341ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f030c066500 0x7f030c0689c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f033406f6a0 0x7f03341eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 --2- 172.21.15.50:0/4013430259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033406f240 0x7f03340c3090 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 >> 172.21.15.50:0/4013430259 conn(0x7f03340727c0 msgr2=0x7f0334073640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 shutdown_connections 2024-01-30T08:10:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.593+0000 7f033c600640 1 -- 172.21.15.50:0/4013430259 wait complete. 2024-01-30T08:10:07.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:10:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f5ac00640 1 Processor -- start 2024-01-30T08:10:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f5ac00640 1 -- start start 2024-01-30T08:10:07.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f5ac00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f540c50d0 0x7f2f54156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f5ac00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f540c5c90 0x7f2f541566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f5ac00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f540c8a50 con 0x7f2f540c7ae0 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f5ac00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f540c7070 con 0x7f2f540c50d0 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f5ac00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f540c8d30 con 0x7f2f540c5c90 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f540c50d0 0x7f2f54156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2f540c7ae0 0x7f2f540c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39424/0 (socket says 172.21.15.50:39424) 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f540c50d0 0x7f2f54156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35858/0 (socket says 172.21.15.50:35858) 2024-01-30T08:10:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53400640 1 -- 172.21.15.50:0/3378677800 learned_addr learned my addr 172.21.15.50:0/3378677800 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f58c00640 1 --2- 172.21.15.50:0/3378677800 >> v2:172.21.15.125:3300/0 conn(0x7f2f540c5c90 0x7f2f541566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53e00640 1 -- 172.21.15.50:0/3378677800 >> v2:172.21.15.125:3300/0 conn(0x7f2f540c5c90 msgr2=0x7f2f541566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53e00640 1 --2- 172.21.15.50:0/3378677800 >> v2:172.21.15.125:3300/0 conn(0x7f2f540c5c90 0x7f2f541566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53e00640 1 -- 172.21.15.50:0/3378677800 >> v1:172.21.15.50:6789/0 conn(0x7f2f540c7ae0 legacy=0x7f2f540c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f52a00640 1 -- 172.21.15.50:0/3378677800 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91479445 0 0) 0x7f2f540c8a50 con 0x7f2f540c7ae0 2024-01-30T08:10:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.757+0000 7f2f53e00640 1 -- 172.21.15.50:0/3378677800 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f540c66d0 con 0x7f2f540c50d0 2024-01-30T08:10:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f53e00640 1 --2- 172.21.15.50:0/3378677800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c50d0 0x7f2f54156190 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2f5406ec50 tx=0x7f2f4401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fd585c49764d41 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f52a00640 1 -- 172.21.15.50:0/3378677800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f440ac600 con 0x7f2f540c50d0 2024-01-30T08:10:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f52a00640 1 -- 172.21.15.50:0/3378677800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f440a8050 con 0x7f2f540c50d0 2024-01-30T08:10:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f52a00640 1 -- 172.21.15.50:0/3378677800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f440ac980 con 0x7f2f540c50d0 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 -- 172.21.15.50:0/3378677800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c50d0 msgr2=0x7f2f54156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/3378677800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c50d0 0x7f2f54156190 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2f5406ec50 tx=0x7f2f4401c3a0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 -- 172.21.15.50:0/3378677800 shutdown_connections 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/3378677800 >> v2:172.21.15.125:3300/0 conn(0x7f2f540c5c90 0x7f2f541566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/3378677800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c50d0 0x7f2f54156190 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 -- 172.21.15.50:0/3378677800 >> 172.21.15.50:0/3378677800 conn(0x7f2f540727c0 msgr2=0x7f2f5406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 -- 172.21.15.50:0/3378677800 shutdown_connections 2024-01-30T08:10:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.761+0000 7f2f5ac00640 1 -- 172.21.15.50:0/3378677800 wait complete. 2024-01-30T08:10:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 Processor -- start 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 -- start start 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f540c50d0 0x7f2f540a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c5c90 0x7f2f540aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f540c7ae0 0x7f2f540ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541ee140 con 0x7f2f540c5c90 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f540ab990 con 0x7f2f540c7ae0 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5414f8f0 con 0x7f2f540c50d0 2024-01-30T08:10:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c5c90 0x7f2f540aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c5c90 0x7f2f540aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35862/0 (socket says 172.21.15.50:35862) 2024-01-30T08:10:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 -- 172.21.15.50:0/1325777939 learned_addr learned my addr 172.21.15.50:0/1325777939 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53e00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f540c50d0 0x7f2f540a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f58c00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f540c7ae0 0x7f2f540ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 -- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f540c50d0 msgr2=0x7f2f540a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f540c50d0 0x7f2f540a8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 -- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f540c7ae0 msgr2=0x7f2f540ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f540c7ae0 0x7f2f540ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 -- 172.21.15.50:0/1325777939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009420 con 0x7f2f540c5c90 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f53400640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c5c90 0x7f2f540aaf10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00c480 tx=0x7f2f3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f4be00640 1 -- 172.21.15.50:0/1325777939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0074e0 con 0x7f2f540c5c90 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f4be00640 1 -- 172.21.15.50:0/1325777939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c007660 con 0x7f2f540c5c90 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f4be00640 1 -- 172.21.15.50:0/1325777939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c004a30 con 0x7f2f540c5c90 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5414eb30 con 0x7f2f540c5c90 2024-01-30T08:10:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5414f0f0 con 0x7f2f540c5c90 2024-01-30T08:10:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.765+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f54074a20 con 0x7f2f540c5c90 2024-01-30T08:10:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.769+0000 7f2f4be00640 1 -- 172.21.15.50:0/1325777939 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2f3c004b90 con 0x7f2f540c5c90 2024-01-30T08:10:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.769+0000 7f2f4be00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f2c066500 0x7f2f2c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.769+0000 7f2f4be00640 1 -- 172.21.15.50:0/1325777939 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2f3c0830b0 con 0x7f2f540c5c90 2024-01-30T08:10:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.769+0000 7f2f53e00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f2c066500 0x7f2f2c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.769+0000 7f2f53e00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f2c066500 0x7f2f2c0689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2f440ae000 tx=0x7f2f440a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.773+0000 7f2f4be00640 1 -- 172.21.15.50:0/1325777939 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2f3c050350 con 0x7f2f540c5c90 2024-01-30T08:10:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f54150260 con 0x7f2f540c5c90 2024-01-30T08:10:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f4be00640 1 -- 172.21.15.50:0/1325777939 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f3c053970 con 0x7f2f540c5c90 2024-01-30T08:10:07.934 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f2c066500 msgr2=0x7f2f2c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f2c066500 0x7f2f2c0689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2f440ae000 tx=0x7f2f440a7000 comp rx=0 tx=0).stop 2024-01-30T08:10:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c5c90 msgr2=0x7f2f540aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c5c90 0x7f2f540aaf10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00c480 tx=0x7f2f3c00c940 comp rx=0 tx=0).stop 2024-01-30T08:10:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 shutdown_connections 2024-01-30T08:10:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f540c7ae0 0x7f2f540ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f2c066500 0x7f2f2c0689c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f540c5c90 0x7f2f540aaf10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 --2- 172.21.15.50:0/1325777939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f540c50d0 0x7f2f540a8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 >> 172.21.15.50:0/1325777939 conn(0x7f2f540727c0 msgr2=0x7f2f5415c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 shutdown_connections 2024-01-30T08:10:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:07.933+0000 7f2f5ac00640 1 -- 172.21.15.50:0/1325777939 wait complete. 2024-01-30T08:10:07.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:10:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.097+0000 7fb9e2000640 1 Processor -- start 2024-01-30T08:10:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.097+0000 7fb9e2000640 1 -- start start 2024-01-30T08:10:08.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9e2000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9dc0c3c50 0x7fb9dc0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9e2000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc06c4c0 con 0x7fb9dc06bfe0 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9e2000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0c0550 con 0x7fb9dc072b60 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9e2000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc0c07c0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9dbe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9dc0c3c50 0x7fb9dc0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9daa00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9dc06bfe0 0x7fb9dc0c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39432/0 (socket says 172.21.15.50:39432) 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9daa00640 1 -- 172.21.15.50:0/3105926963 learned_addr learned my addr 172.21.15.50:0/3105926963 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9dbe00640 1 -- 172.21.15.50:0/3105926963 >> v1:172.21.15.125:6789/0 conn(0x7fb9dc072b60 legacy=0x7fb9dc0a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9dbe00640 1 -- 172.21.15.50:0/3105926963 >> v1:172.21.15.50:6789/0 conn(0x7fb9dc06bfe0 legacy=0x7fb9dc0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9dbe00640 1 -- 172.21.15.50:0/3105926963 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0c0aa0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.101+0000 7fb9da000640 1 -- 172.21.15.50:0/3105926963 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595228022 0 0) 0x7fb9dc06c4c0 con 0x7fb9dc06bfe0 2024-01-30T08:10:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9dbe00640 1 --2- 172.21.15.50:0/3105926963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc0c19b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009d90 tx=0x7fb9d401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22256ba804e8bce3 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9da000640 1 -- 172.21.15.50:0/3105926963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40a5970 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9da000640 1 -- 172.21.15.50:0/3105926963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40a5ad0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9da000640 1 -- 172.21.15.50:0/3105926963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40a5e60 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 -- 172.21.15.50:0/3105926963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 msgr2=0x7fb9dc0c19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3105926963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc0c19b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009d90 tx=0x7fb9d401c890 comp rx=0 tx=0).stop 2024-01-30T08:10:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 -- 172.21.15.50:0/3105926963 shutdown_connections 2024-01-30T08:10:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3105926963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc0c19b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 -- 172.21.15.50:0/3105926963 >> 172.21.15.50:0/3105926963 conn(0x7fb9dc0c5b30 msgr2=0x7fb9dc0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 -- 172.21.15.50:0/3105926963 shutdown_connections 2024-01-30T08:10:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 -- 172.21.15.50:0/3105926963 wait complete. 2024-01-30T08:10:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 Processor -- start 2024-01-30T08:10:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.105+0000 7fb9e2000640 1 -- start start 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9dc06bfe0 0x7fb9dc0a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9dc072b60 0x7fb9dc0a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0ab5d0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc14a560 con 0x7fb9dc06bfe0 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc14a230 con 0x7fb9dc072b60 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35892/0 (socket says 172.21.15.50:35892) 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 -- 172.21.15.50:0/3370335490 learned_addr learned my addr 172.21.15.50:0/3370335490 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9db400640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9dc06bfe0 0x7fb9dc0a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9daa00640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9dc072b60 0x7fb9dc0a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 -- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9dc072b60 msgr2=0x7fb9dc0a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9dc072b60 0x7fb9dc0a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 -- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9dc06bfe0 msgr2=0x7fb9dc0a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9dc06bfe0 0x7fb9dc0a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 -- 172.21.15.50:0/3370335490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4009a70 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9dbe00640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc150480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40b0040 tx=0x7fb9d4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9d3400640 1 -- 172.21.15.50:0/3370335490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40ade40 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9d3400640 1 -- 172.21.15.50:0/3370335490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40b9450 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc1f08c0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9d3400640 1 -- 172.21.15.50:0/3370335490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40b9800 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc0c15c0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.109+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc14a6f0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.113+0000 7fb9d3400640 1 -- 172.21.15.50:0/3370335490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb9d40b9960 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.113+0000 7fb9d3400640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb9b4066500 0x7fb9b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.113+0000 7fb9d3400640 1 -- 172.21.15.50:0/3370335490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb9d411f880 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.113+0000 7fb9db400640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb9b4066500 0x7fb9b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.113+0000 7fb9db400640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb9b4066500 0x7fb9b40689c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007fd0 tx=0x7fb9cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.117+0000 7fb9d3400640 1 -- 172.21.15.50:0/3370335490 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb9d40ecab0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.277+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9dc074a20 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.277+0000 7fb9d3400640 1 -- 172.21.15.50:0/3370335490 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9d40f00d0 con 0x7fb9dc0c3c50 2024-01-30T08:10:08.280 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb9b4066500 msgr2=0x7fb9b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb9b4066500 0x7fb9b40689c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007fd0 tx=0x7fb9cc009040 comp rx=0 tx=0).stop 2024-01-30T08:10:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 msgr2=0x7fb9dc150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc150480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40b0040 tx=0x7fb9d4019630 comp rx=0 tx=0).stop 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 shutdown_connections 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb9b4066500 0x7fb9b40689c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9dc0c3c50 0x7fb9dc150480 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9dc072b60 0x7fb9dc0a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 --2- 172.21.15.50:0/3370335490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9dc06bfe0 0x7fb9dc0a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 >> 172.21.15.50:0/3370335490 conn(0x7fb9dc0c5b30 msgr2=0x7fb9dc0bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 shutdown_connections 2024-01-30T08:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.281+0000 7fb9e2000640 1 -- 172.21.15.50:0/3370335490 wait complete. 2024-01-30T08:10:08.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-30T08:10:08.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd56c200640 1 Processor -- start 2024-01-30T08:10:08.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd56c200640 1 -- start start 2024-01-30T08:10:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd56c200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd56406de40 0x7fd5640a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd56c200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5640c7b40 con 0x7fd56406e220 2024-01-30T08:10:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd56c200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd564155730 con 0x7fd5641584a0 2024-01-30T08:10:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd56c200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5640a7770 con 0x7fd56406de40 2024-01-30T08:10:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd568e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd56406e220 0x7fd564157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39440/0 (socket says 172.21.15.50:39440) 2024-01-30T08:10:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd568e00640 1 -- 172.21.15.50:0/1371922903 learned_addr learned my addr 172.21.15.50:0/1371922903 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd569800640 1 --2- 172.21.15.50:0/1371922903 >> v2:172.21.15.125:3300/0 conn(0x7fd56406de40 0x7fd5640a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd563e00640 1 -- 172.21.15.50:0/1371922903 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245223800 0 0) 0x7fd54c001120 con 0x7fd56406e220 2024-01-30T08:10:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd563e00640 1 -- 172.21.15.50:0/1371922903 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd544003530 con 0x7fd56406e220 2024-01-30T08:10:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd563e00640 1 -- 172.21.15.50:0/1371922903 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391140342 0 0) 0x7fd544003530 con 0x7fd56406e220 2024-01-30T08:10:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd569800640 1 -- 172.21.15.50:0/1371922903 >> v1:172.21.15.125:6789/0 conn(0x7fd5641584a0 legacy=0x7fd56415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd569800640 1 -- 172.21.15.50:0/1371922903 >> v1:172.21.15.50:6789/0 conn(0x7fd56406e220 legacy=0x7fd564157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.445+0000 7fd569800640 1 -- 172.21.15.50:0/1371922903 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56406ec20 con 0x7fd56406de40 2024-01-30T08:10:08.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd569800640 1 --2- 172.21.15.50:0/1371922903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406de40 0x7fd5640a7120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097c0 tx=0x7fd55401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c20cf2c6b7fd186a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd563e00640 1 -- 172.21.15.50:0/1371922903 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c001810 con 0x7fd56406de40 2024-01-30T08:10:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd563e00640 1 -- 172.21.15.50:0/1371922903 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5540a7050 con 0x7fd56406de40 2024-01-30T08:10:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd563e00640 1 -- 172.21.15.50:0/1371922903 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540ab620 con 0x7fd56406de40 2024-01-30T08:10:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd56c200640 1 -- 172.21.15.50:0/1371922903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406de40 msgr2=0x7fd5640a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd56c200640 1 --2- 172.21.15.50:0/1371922903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406de40 0x7fd5640a7120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097c0 tx=0x7fd55401c3a0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd56c200640 1 -- 172.21.15.50:0/1371922903 shutdown_connections 2024-01-30T08:10:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd56c200640 1 --2- 172.21.15.50:0/1371922903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406de40 0x7fd5640a7120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd56c200640 1 -- 172.21.15.50:0/1371922903 >> 172.21.15.50:0/1371922903 conn(0x7fd5640c4830 msgr2=0x7fd5640c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd56c200640 1 -- 172.21.15.50:0/1371922903 shutdown_connections 2024-01-30T08:10:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.449+0000 7fd56c200640 1 -- 172.21.15.50:0/1371922903 wait complete. 2024-01-30T08:10:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 Processor -- start 2024-01-30T08:10:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 -- start start 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd56406de40 0x7fd564157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406e220 0x7fd5640ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5641584a0 0x7fd5640ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd564155310 con 0x7fd56406de40 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5641f1b60 con 0x7fd56406e220 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5641f0ee0 con 0x7fd5641584a0 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd56406de40 0x7fd564157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd56406de40 0x7fd564157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35894/0 (socket says 172.21.15.50:35894) 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 -- 172.21.15.50:0/2906424664 learned_addr learned my addr 172.21.15.50:0/2906424664 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd568e00640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406e220 0x7fd5640ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56a200640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5641584a0 0x7fd5640ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 -- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5641584a0 msgr2=0x7fd5640ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5641584a0 0x7fd5640ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 -- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406e220 msgr2=0x7fd5640ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406e220 0x7fd5640ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 -- 172.21.15.50:0/2906424664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009420 con 0x7fd56406de40 2024-01-30T08:10:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd569800640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd56406de40 0x7fd564157250 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd5540ae040 tx=0x7fd554019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd561600640 1 -- 172.21.15.50:0/2906424664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554004220 con 0x7fd56406de40 2024-01-30T08:10:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd561600640 1 -- 172.21.15.50:0/2906424664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd554004380 con 0x7fd56406de40 2024-01-30T08:10:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd561600640 1 -- 172.21.15.50:0/2906424664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554003820 con 0x7fd56406de40 2024-01-30T08:10:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5641f11c0 con 0x7fd56406de40 2024-01-30T08:10:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.453+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5641f1780 con 0x7fd56406de40 2024-01-30T08:10:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.457+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56406e640 con 0x7fd56406de40 2024-01-30T08:10:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.457+0000 7fd561600640 1 -- 172.21.15.50:0/2906424664 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd5540b2040 con 0x7fd56406de40 2024-01-30T08:10:08.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.457+0000 7fd561600640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd53c066500 0x7fd53c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.457+0000 7fd561600640 1 -- 172.21.15.50:0/2906424664 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd55411e010 con 0x7fd56406de40 2024-01-30T08:10:08.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.457+0000 7fd568e00640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd53c066500 0x7fd53c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.457+0000 7fd568e00640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd53c066500 0x7fd53c0689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd564157c50 tx=0x7fd54c001280 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.461+0000 7fd561600640 1 -- 172.21.15.50:0/2906424664 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd5540eb2b0 con 0x7fd56406de40 2024-01-30T08:10:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd564074a20 con 0x7fd56406de40 2024-01-30T08:10:08.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd561600640 1 -- 172.21.15.50:0/2906424664 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+207 (secure 0 0 0) 0x7fd5540b00e0 con 0x7fd56406de40 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 5, 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "cephfs_metadata" 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-01-30T08:10:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 6, 2024-01-30T08:10:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "cephfs_data" 2024-01-30T08:10:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-01-30T08:10:08.628 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd53c066500 msgr2=0x7fd53c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd53c066500 0x7fd53c0689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd564157c50 tx=0x7fd54c001280 comp rx=0 tx=0).stop 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd56406de40 msgr2=0x7fd564157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd56406de40 0x7fd564157250 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd5540ae040 tx=0x7fd554019140 comp rx=0 tx=0).stop 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 shutdown_connections 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56406e220 0x7fd5640ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd53c066500 0x7fd53c0689c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5641584a0 0x7fd5640ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 --2- 172.21.15.50:0/2906424664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd56406de40 0x7fd564157250 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 >> 172.21.15.50:0/2906424664 conn(0x7fd5640c4830 msgr2=0x7fd5640a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 shutdown_connections 2024-01-30T08:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.625+0000 7fd56c200640 1 -- 172.21.15.50:0/2906424664 wait complete. 2024-01-30T08:10:08.649 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-30T08:10:08.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-30T08:10:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77f1e00640 1 Processor -- start 2024-01-30T08:10:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77f1e00640 1 -- start start 2024-01-30T08:10:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0a70d0 0x7f77ec0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77f1e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77ec0c4420 0x7f77ec0c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77f1e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ec1535e0 con 0x7f77ec06e1f0 2024-01-30T08:10:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77f1e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ec06f2e0 con 0x7f77ec0c4420 2024-01-30T08:10:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77f1e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec152a60 con 0x7f77ec0a70d0 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eb400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77ec0c4420 0x7f77ec0c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eb400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77ec0c4420 0x7f77ec0c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35896/0 (socket says 172.21.15.50:35896) 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eb400640 1 -- 172.21.15.50:0/2501482542 learned_addr learned my addr 172.21.15.50:0/2501482542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eaa00640 1 --2- 172.21.15.50:0/2501482542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0a70d0 0x7f77ec0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eb400640 1 -- 172.21.15.50:0/2501482542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0a70d0 msgr2=0x7f77ec0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eb400640 1 --2- 172.21.15.50:0/2501482542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0a70d0 0x7f77ec0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eb400640 1 -- 172.21.15.50:0/2501482542 >> v1:172.21.15.50:6789/0 conn(0x7f77ec06e1f0 legacy=0x7f77ec14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77eb400640 1 -- 172.21.15.50:0/2501482542 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec152d40 con 0x7f77ec0c4420 2024-01-30T08:10:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.793+0000 7f77e9600640 1 -- 172.21.15.50:0/2501482542 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941746706 0 0) 0x7f77ec1535e0 con 0x7f77ec06e1f0 2024-01-30T08:10:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77eb400640 1 --2- 172.21.15.50:0/2501482542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0c4420 0x7f77ec0c48b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009e50 tx=0x7f77e401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0725e9ce77c2081 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77e9600640 1 -- 172.21.15.50:0/2501482542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40a5730 con 0x7f77ec0c4420 2024-01-30T08:10:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77e9600640 1 -- 172.21.15.50:0/2501482542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e40a5890 con 0x7f77ec0c4420 2024-01-30T08:10:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77e9600640 1 -- 172.21.15.50:0/2501482542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40a5c20 con 0x7f77ec0c4420 2024-01-30T08:10:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 -- 172.21.15.50:0/2501482542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0c4420 msgr2=0x7f77ec0c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 --2- 172.21.15.50:0/2501482542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0c4420 0x7f77ec0c48b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009e50 tx=0x7f77e401c980 comp rx=0 tx=0).stop 2024-01-30T08:10:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 -- 172.21.15.50:0/2501482542 shutdown_connections 2024-01-30T08:10:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 --2- 172.21.15.50:0/2501482542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0c4420 0x7f77ec0c48b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 --2- 172.21.15.50:0/2501482542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0a70d0 0x7f77ec0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 -- 172.21.15.50:0/2501482542 >> 172.21.15.50:0/2501482542 conn(0x7f77ec0a9a80 msgr2=0x7f77ec0a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 -- 172.21.15.50:0/2501482542 shutdown_connections 2024-01-30T08:10:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.797+0000 7f77f1e00640 1 -- 172.21.15.50:0/2501482542 wait complete. 2024-01-30T08:10:08.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 Processor -- start 2024-01-30T08:10:08.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 -- start start 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ec06e1f0 0x7f77ec0a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0a70d0 0x7f77ec1ec820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0c4420 0x7f77ec1ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec1481d0 con 0x7f77ec0a70d0 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec1f0bf0 con 0x7f77ec06e1f0 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec147ef0 con 0x7f77ec0c4420 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77ea000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0a70d0 0x7f77ec1ec820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ec06e1f0 0x7f77ec0a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77ea000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0a70d0 0x7f77ec1ec820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35910/0 (socket says 172.21.15.50:35910) 2024-01-30T08:10:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77ea000640 1 -- 172.21.15.50:0/3916845854 learned_addr learned my addr 172.21.15.50:0/3916845854 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eb400640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0c4420 0x7f77ec1ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eaa00640 1 -- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0c4420 msgr2=0x7f77ec1ecd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eaa00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0c4420 0x7f77ec1ecd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eaa00640 1 -- 172.21.15.50:0/3916845854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0a70d0 msgr2=0x7f77ec1ec820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eaa00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0a70d0 0x7f77ec1ec820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eaa00640 1 -- 172.21.15.50:0/3916845854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4009b30 con 0x7f77ec06e1f0 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77eaa00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ec06e1f0 0x7f77ec0a8ca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e870 tx=0x7f77dc00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77e3400640 1 -- 172.21.15.50:0/3916845854 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0095d0 con 0x7f77ec06e1f0 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77e3400640 1 -- 172.21.15.50:0/3916845854 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00c940 con 0x7f77ec06e1f0 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77e3400640 1 -- 172.21.15.50:0/3916845854 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00ccb0 con 0x7f77ec06e1f0 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.801+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ec1efe30 con 0x7f77ec06e1f0 2024-01-30T08:10:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.805+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec1f03f0 con 0x7f77ec06e1f0 2024-01-30T08:10:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.805+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ec074a20 con 0x7f77ec06e1f0 2024-01-30T08:10:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.805+0000 7f77e3400640 1 -- 172.21.15.50:0/3916845854 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f77dc013470 con 0x7f77ec06e1f0 2024-01-30T08:10:08.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.805+0000 7f77e3400640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f77c4066530 0x7f77c40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:08.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.805+0000 7f77e3400640 1 -- 172.21.15.50:0/3916845854 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f77dc084470 con 0x7f77ec06e1f0 2024-01-30T08:10:08.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.805+0000 7f77ea000640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f77c4066530 0x7f77c40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.809+0000 7f77ea000640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f77c4066530 0x7f77c40689f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77ec15c9f0 tx=0x7f77d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.813+0000 7f77e3400640 1 -- 172.21.15.50:0/3916845854 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f77dc051670 con 0x7f77ec06e1f0 2024-01-30T08:10:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:08.973+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f77ec0c7190 con 0x7f77ec06e1f0 2024-01-30T08:10:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.869+0000 7f77e3400640 1 -- 172.21.15.50:0/3916845854 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v40) v1 ==== 140+0+0 (secure 0 0 0) 0x7f77dc054c90 con 0x7f77ec06e1f0 2024-01-30T08:10:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs2_metadata' created 2024-01-30T08:10:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f77c4066530 msgr2=0x7f77c40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f77c4066530 0x7f77c40689f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77ec15c9f0 tx=0x7f77d4009040 comp rx=0 tx=0).stop 2024-01-30T08:10:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ec06e1f0 msgr2=0x7f77ec0a8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ec06e1f0 0x7f77ec0a8ca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e870 tx=0x7f77dc00ed30 comp rx=0 tx=0).stop 2024-01-30T08:10:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 shutdown_connections 2024-01-30T08:10:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f77c4066530 0x7f77c40689f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ec0c4420 0x7f77ec1ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ec0a70d0 0x7f77ec1ec820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 --2- 172.21.15.50:0/3916845854 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ec06e1f0 0x7f77ec0a8ca0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 >> 172.21.15.50:0/3916845854 conn(0x7f77ec0a9a80 msgr2=0x7f77ec0c3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 shutdown_connections 2024-01-30T08:10:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:09.877+0000 7f77f1e00640 1 -- 172.21.15.50:0/3916845854 wait complete. 2024-01-30T08:10:09.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-30T08:10:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8ab600640 1 Processor -- start 2024-01-30T08:10:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8ab600640 1 -- start start 2024-01-30T08:10:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8ab600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a4155500 0x7fd8a40c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8ab600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8a406f6a0 0x7fd8a40c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8ab600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a4158b70 con 0x7fd8a406f240 2024-01-30T08:10:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8ab600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a406fb10 con 0x7fd8a406f6a0 2024-01-30T08:10:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8ab600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4157f60 con 0x7fd8a4155500 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a9600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8a406f6a0 0x7fd8a40c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a4155500 0x7fd8a40c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a9600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8a406f6a0 0x7fd8a40c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48146/0 (socket says 172.21.15.50:48146) 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a9600640 1 -- 172.21.15.50:0/1974823033 learned_addr learned my addr 172.21.15.50:0/1974823033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a9600640 1 -- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a4155500 msgr2=0x7fd8a40c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a9600640 1 --2- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a4155500 0x7fd8a40c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a9600640 1 -- 172.21.15.50:0/1974823033 >> v1:172.21.15.125:6789/0 conn(0x7fd8a406f240 legacy=0x7fd8a40c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a9600640 1 -- 172.21.15.50:0/1974823033 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a4158240 con 0x7fd8a406f6a0 2024-01-30T08:10:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.061+0000 7fd8a8c00640 1 --2- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a4155500 0x7fd8a40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8a9600640 1 --2- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 0x7fd8a40c1910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009e50 tx=0x7fd89c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d12d4aba24582ed1 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8a3400640 1 -- 172.21.15.50:0/1974823033 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0a5780 con 0x7fd8a406f6a0 2024-01-30T08:10:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8a3400640 1 -- 172.21.15.50:0/1974823033 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c0a58e0 con 0x7fd8a406f6a0 2024-01-30T08:10:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8a3400640 1 -- 172.21.15.50:0/1974823033 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0a5c70 con 0x7fd8a406f6a0 2024-01-30T08:10:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 -- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 msgr2=0x7fd8a40c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:10.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 --2- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 0x7fd8a40c1910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009e50 tx=0x7fd89c01c8c0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 -- 172.21.15.50:0/1974823033 shutdown_connections 2024-01-30T08:10:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 --2- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 0x7fd8a40c1910 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 --2- 172.21.15.50:0/1974823033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a4155500 0x7fd8a40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 -- 172.21.15.50:0/1974823033 >> 172.21.15.50:0/1974823033 conn(0x7fd8a40727c0 msgr2=0x7fd8a406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 -- 172.21.15.50:0/1974823033 shutdown_connections 2024-01-30T08:10:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.065+0000 7fd8ab600640 1 -- 172.21.15.50:0/1974823033 wait complete. 2024-01-30T08:10:10.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 Processor -- start 2024-01-30T08:10:10.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 -- start start 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a406f240 0x7fd8a40ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 0x7fd8a414f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8a4155500 0x7fd8a414f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a41f0e40 con 0x7fd8a4155500 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40aa250 con 0x7fd8a406f6a0 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8ab600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a415da30 con 0x7fd8a406f240 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8a4155500 0x7fd8a414f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8a4155500 0x7fd8a414f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49144/0 (socket says 172.21.15.50:49144) 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 -- 172.21.15.50:0/3472324490 learned_addr learned my addr 172.21.15.50:0/3472324490 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a8c00640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a406f240 0x7fd8a40ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a3e00640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 0x7fd8a414f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 -- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a406f240 msgr2=0x7fd8a40ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a406f240 0x7fd8a40ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 -- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 msgr2=0x7fd8a414f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 0x7fd8a414f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 -- 172.21.15.50:0/3472324490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009420 con 0x7fd8a4155500 2024-01-30T08:10:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.069+0000 7fd8a9600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8a4155500 0x7fd8a414f650 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd89c01a4f0 tx=0x7fd89c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8a0c00640 1 -- 172.21.15.50:0/3472324490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0b8670 con 0x7fd8a4155500 2024-01-30T08:10:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8a0c00640 1 -- 172.21.15.50:0/3472324490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c0b87d0 con 0x7fd8a4155500 2024-01-30T08:10:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8a0c00640 1 -- 172.21.15.50:0/3472324490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0b8b80 con 0x7fd8a4155500 2024-01-30T08:10:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c009b30 con 0x7fd8a4155500 2024-01-30T08:10:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a415dc80 con 0x7fd8a4155500 2024-01-30T08:10:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a40aa3e0 con 0x7fd8a4155500 2024-01-30T08:10:10.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8a0c00640 1 -- 172.21.15.50:0/3472324490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd89c0b8ce0 con 0x7fd8a4155500 2024-01-30T08:10:10.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8a0c00640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd87c066500 0x7fd87c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:10.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8a0c00640 1 -- 172.21.15.50:0/3472324490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fd89c11f7f0 con 0x7fd8a4155500 2024-01-30T08:10:10.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.073+0000 7fd8a8c00640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd87c066500 0x7fd87c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:10.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.077+0000 7fd8a8c00640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd87c066500 0x7fd87c0689c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40ab320 tx=0x7fd894009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.077+0000 7fd8a0c00640 1 -- 172.21.15.50:0/3472324490 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd8a40aa3e0 con 0x7fd8a4155500 2024-01-30T08:10:10.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.237+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd8a40aa3e0 con 0x7fd8a4155500 2024-01-30T08:10:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.868+0000 7fd8a0c00640 1 -- 172.21.15.50:0/3472324490 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v41) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd8a40aa3e0 con 0x7fd8a4155500 2024-01-30T08:10:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs2_data' created 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd87c066500 msgr2=0x7fd87c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd87c066500 0x7fd87c0689c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40ab320 tx=0x7fd894009190 comp rx=0 tx=0).stop 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8a4155500 msgr2=0x7fd8a414f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8a4155500 0x7fd8a414f650 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd89c01a4f0 tx=0x7fd89c019660 comp rx=0 tx=0).stop 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 shutdown_connections 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8a406f6a0 0x7fd8a414f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd87c066500 0x7fd87c0689c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8a4155500 0x7fd8a414f650 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 --2- 172.21.15.50:0/3472324490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8a406f240 0x7fd8a40ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.872+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 >> 172.21.15.50:0/3472324490 conn(0x7fd8a40727c0 msgr2=0x7fd8a406c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.876+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 shutdown_connections 2024-01-30T08:10:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:10.876+0000 7fd8ab600640 1 -- 172.21.15.50:0/3472324490 wait complete. 2024-01-30T08:10:10.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-30T08:10:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f177b600640 1 Processor -- start 2024-01-30T08:10:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f177b600640 1 -- start start 2024-01-30T08:10:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f177b600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f177406f240 0x7f177406f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f177b600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17740c1200 0x7f17740c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f177b600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1774158b70 con 0x7f1774155500 2024-01-30T08:10:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f177b600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17740c8cf0 con 0x7f17740c1200 2024-01-30T08:10:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f177b600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1774157f60 con 0x7f177406f240 2024-01-30T08:10:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1778c00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1774155500 0x7f17740c85e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53328/0 (socket says 172.21.15.50:53328) 2024-01-30T08:10:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1778c00640 1 -- 172.21.15.50:0/1296899348 learned_addr learned my addr 172.21.15.50:0/1296899348 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1779600640 1 --2- 172.21.15.50:0/1296899348 >> v2:172.21.15.50:3300/0 conn(0x7f17740c1200 0x7f17740c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1773e00640 1 --2- 172.21.15.50:0/1296899348 >> v2:172.21.15.125:3300/0 conn(0x7f177406f240 0x7f177406f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1773400640 1 -- 172.21.15.50:0/1296899348 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412112258 0 0) 0x7f1774158b70 con 0x7f1774155500 2024-01-30T08:10:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1773400640 1 -- 172.21.15.50:0/1296899348 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1754003530 con 0x7f1774155500 2024-01-30T08:10:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1779600640 1 -- 172.21.15.50:0/1296899348 >> v2:172.21.15.125:3300/0 conn(0x7f177406f240 msgr2=0x7f177406f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1779600640 1 --2- 172.21.15.50:0/1296899348 >> v2:172.21.15.125:3300/0 conn(0x7f177406f240 0x7f177406f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1779600640 1 -- 172.21.15.50:0/1296899348 >> v1:172.21.15.50:6789/0 conn(0x7f1774155500 legacy=0x7f17740c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.068+0000 7f1779600640 1 -- 172.21.15.50:0/1296899348 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774158240 con 0x7f17740c1200 2024-01-30T08:10:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f1779600640 1 --2- 172.21.15.50:0/1296899348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17740c1200 0x7f17740c1630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1774071f80 tx=0x7f176c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656b40d8b331385b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f1773400640 1 -- 172.21.15.50:0/1296899348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0a5790 con 0x7f17740c1200 2024-01-30T08:10:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f1773400640 1 -- 172.21.15.50:0/1296899348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0a58f0 con 0x7f17740c1200 2024-01-30T08:10:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f1773400640 1 -- 172.21.15.50:0/1296899348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0a5c80 con 0x7f17740c1200 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f177b600640 1 -- 172.21.15.50:0/1296899348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17740c1200 msgr2=0x7f17740c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f177b600640 1 --2- 172.21.15.50:0/1296899348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17740c1200 0x7f17740c1630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1774071f80 tx=0x7f176c01c7c0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f177b600640 1 -- 172.21.15.50:0/1296899348 shutdown_connections 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f177b600640 1 --2- 172.21.15.50:0/1296899348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17740c1200 0x7f17740c1630 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f177b600640 1 --2- 172.21.15.50:0/1296899348 >> v2:172.21.15.125:3300/0 conn(0x7f177406f240 0x7f177406f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f177b600640 1 -- 172.21.15.50:0/1296899348 >> 172.21.15.50:0/1296899348 conn(0x7f17740727c0 msgr2=0x7f177406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.072+0000 7f177b600640 1 -- 172.21.15.50:0/1296899348 shutdown_connections 2024-01-30T08:10:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 -- 172.21.15.50:0/1296899348 wait complete. 2024-01-30T08:10:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 Processor -- start 2024-01-30T08:10:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 -- start start 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177406f240 0x7f17740a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17740c1200 0x7f177414cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1774155500 0x7f17741f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740a7160 con 0x7f177406f240 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740ab080 con 0x7f17740c1200 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740ac170 con 0x7f1774155500 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177406f240 0x7f17740a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177406f240 0x7f17740a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49162/0 (socket says 172.21.15.50:49162) 2024-01-30T08:10:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 -- 172.21.15.50:0/4031254876 learned_addr learned my addr 172.21.15.50:0/4031254876 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1773e00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17740c1200 0x7f177414cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1779600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1774155500 0x7f17741f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 -- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1774155500 msgr2=0x7f17741f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1774155500 0x7f17741f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 -- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17740c1200 msgr2=0x7f177414cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17740c1200 0x7f177414cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 -- 172.21.15.50:0/4031254876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c009a70 con 0x7f177406f240 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1773e00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17740c1200 0x7f177414cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1779600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1774155500 0x7f17741f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1778c00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177406f240 0x7f17740a9f90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f176400c3f0 tx=0x7f176400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f1770c00640 1 -- 172.21.15.50:0/4031254876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764005cf0 con 0x7f177406f240 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.076+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17740ac9f0 con 0x7f177406f240 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.080+0000 7f1770c00640 1 -- 172.21.15.50:0/4031254876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764005e50 con 0x7f177406f240 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.080+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17740a6e80 con 0x7f177406f240 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.080+0000 7f1770c00640 1 -- 172.21.15.50:0/4031254876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640072d0 con 0x7f177406f240 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.080+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17440052a0 con 0x7f177406f240 2024-01-30T08:10:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.080+0000 7f1770c00640 1 -- 172.21.15.50:0/4031254876 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1764007430 con 0x7f177406f240 2024-01-30T08:10:11.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.080+0000 7f1770c00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f174c066500 0x7f174c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:11.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.080+0000 7f1770c00640 1 -- 172.21.15.50:0/4031254876 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f1764083d30 con 0x7f177406f240 2024-01-30T08:10:11.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.084+0000 7f1773e00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f174c066500 0x7f174c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:11.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.084+0000 7f1773e00640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f174c066500 0x7f174c0689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f17740c4650 tx=0x7f175c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.084+0000 7f1770c00640 1 -- 172.21.15.50:0/4031254876 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1764050c30 con 0x7f177406f240 2024-01-30T08:10:11.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.280+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f1744005550 con 0x7f177406f240 2024-01-30T08:10:11.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.884+0000 7f1770c00640 1 -- 172.21.15.50:0/4031254876 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 175+0+0 (secure 0 0 0) 0x7f1764054250 con 0x7f177406f240 2024-01-30T08:10:11.888 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 7 and data pool 8 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f174c066500 msgr2=0x7f174c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f174c066500 0x7f174c0689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f17740c4650 tx=0x7f175c008040 comp rx=0 tx=0).stop 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177406f240 msgr2=0x7f17740a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177406f240 0x7f17740a9f90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f176400c3f0 tx=0x7f176400c8b0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 shutdown_connections 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17740c1200 0x7f177414cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f174c066500 0x7f174c0689c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1774155500 0x7f17741f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 --2- 172.21.15.50:0/4031254876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f177406f240 0x7f17740a9f90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.888+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 >> 172.21.15.50:0/4031254876 conn(0x7f17740727c0 msgr2=0x7f177406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.892+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 shutdown_connections 2024-01-30T08:10:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:11.892+0000 7f177b600640 1 -- 172.21.15.50:0/4031254876 wait complete. 2024-01-30T08:10:11.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:12.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.088+0000 7f9d47800640 1 Processor -- start 2024-01-30T08:10:12.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.088+0000 7f9d47800640 1 -- start start 2024-01-30T08:10:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d47800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d401584a0 0x7f9d4006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d47800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d400c7b40 con 0x7f9d400a7120 2024-01-30T08:10:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d47800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d40155730 con 0x7f9d4006de40 2024-01-30T08:10:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d47800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d400a7770 con 0x7f9d401584a0 2024-01-30T08:10:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d45800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d401584a0 0x7f9d4006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d3fe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9d400a7120 0x7f9d4015d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53342/0 (socket says 172.21.15.50:53342) 2024-01-30T08:10:12.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d3fe00640 1 -- 172.21.15.50:0/2013912875 learned_addr learned my addr 172.21.15.50:0/2013912875 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:12.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d45800640 1 -- 172.21.15.50:0/2013912875 >> v1:172.21.15.125:6789/0 conn(0x7f9d4006de40 legacy=0x7f9d40157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d45800640 1 -- 172.21.15.50:0/2013912875 >> v1:172.21.15.50:6789/0 conn(0x7f9d400a7120 legacy=0x7f9d4015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.092+0000 7f9d45800640 1 -- 172.21.15.50:0/2013912875 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4006ec20 con 0x7f9d401584a0 2024-01-30T08:10:12.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d45800640 1 --2- 172.21.15.50:0/2013912875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d401584a0 0x7f9d4006e220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bde037f0a12bdf server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d3f400640 1 -- 172.21.15.50:0/2013912875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380a5810 con 0x7f9d401584a0 2024-01-30T08:10:12.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d3f400640 1 -- 172.21.15.50:0/2013912875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d380a5970 con 0x7f9d401584a0 2024-01-30T08:10:12.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d3f400640 1 -- 172.21.15.50:0/2013912875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380a5d00 con 0x7f9d401584a0 2024-01-30T08:10:12.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 -- 172.21.15.50:0/2013912875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d401584a0 msgr2=0x7f9d4006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 --2- 172.21.15.50:0/2013912875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d401584a0 0x7f9d4006e220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3801c950 comp rx=0 tx=0).stop 2024-01-30T08:10:12.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 -- 172.21.15.50:0/2013912875 shutdown_connections 2024-01-30T08:10:12.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 --2- 172.21.15.50:0/2013912875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d401584a0 0x7f9d4006e220 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 -- 172.21.15.50:0/2013912875 >> 172.21.15.50:0/2013912875 conn(0x7f9d400c4830 msgr2=0x7f9d400c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:12.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 -- 172.21.15.50:0/2013912875 shutdown_connections 2024-01-30T08:10:12.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 -- 172.21.15.50:0/2013912875 wait complete. 2024-01-30T08:10:12.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 Processor -- start 2024-01-30T08:10:12.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.096+0000 7f9d47800640 1 -- start start 2024-01-30T08:10:12.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4006de40 0x7f9d40156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a7120 0x7f9d40157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d401584a0 0x7f9d400a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40155310 con 0x7f9d4006de40 2024-01-30T08:10:12.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40152110 con 0x7f9d401584a0 2024-01-30T08:10:12.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400a9500 con 0x7f9d400a7120 2024-01-30T08:10:12.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4006de40 0x7f9d40156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4006de40 0x7f9d40156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49184/0 (socket says 172.21.15.50:49184) 2024-01-30T08:10:12.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 -- 172.21.15.50:0/1117302913 learned_addr learned my addr 172.21.15.50:0/1117302913 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:12.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d45800640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d401584a0 0x7f9d400a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d3fe00640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a7120 0x7f9d40157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 -- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a7120 msgr2=0x7f9d40157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a7120 0x7f9d40157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 -- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d401584a0 msgr2=0x7f9d400a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d401584a0 0x7f9d400a7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 -- 172.21.15.50:0/1117302913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009a70 con 0x7f9d4006de40 2024-01-30T08:10:12.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d44e00640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4006de40 0x7f9d40156c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c500 tx=0x7f9d3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d3cc00640 1 -- 172.21.15.50:0/1117302913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30005220 con 0x7f9d4006de40 2024-01-30T08:10:12.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d3cc00640 1 -- 172.21.15.50:0/1117302913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30005380 con 0x7f9d4006de40 2024-01-30T08:10:12.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d400a8fd0 con 0x7f9d4006de40 2024-01-30T08:10:12.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d3cc00640 1 -- 172.21.15.50:0/1117302913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30007270 con 0x7f9d4006de40 2024-01-30T08:10:12.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d401ee740 con 0x7f9d4006de40 2024-01-30T08:10:12.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d400a9320 con 0x7f9d4006de40 2024-01-30T08:10:12.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.100+0000 7f9d3cc00640 1 -- 172.21.15.50:0/1117302913 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9d300073d0 con 0x7f9d4006de40 2024-01-30T08:10:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.104+0000 7f9d3cc00640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d18066500 0x7f9d180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.104+0000 7f9d3cc00640 1 -- 172.21.15.50:0/1117302913 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9d300834f0 con 0x7f9d4006de40 2024-01-30T08:10:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.104+0000 7f9d3fe00640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d18066500 0x7f9d180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.104+0000 7f9d3fe00640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d18066500 0x7f9d180689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d40149900 tx=0x7f9d28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.108+0000 7f9d3cc00640 1 -- 172.21.15.50:0/1117302913 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9d30050310 con 0x7f9d4006de40 2024-01-30T08:10:12.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.268+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d40155730 con 0x7f9d4006de40 2024-01-30T08:10:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.268+0000 7f9d3cc00640 1 -- 172.21.15.50:0/1117302913 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20504 (secure 0 0 0) 0x7f9d40155730 con 0x7f9d4006de40 2024-01-30T08:10:12.271 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:12.272 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:11.284027+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.268+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d18066500 msgr2=0x7f9d180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.268+0000 7f9d47800640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d18066500 0x7f9d180689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d40149900 tx=0x7f9d28009040 comp rx=0 tx=0).stop 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.268+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4006de40 msgr2=0x7f9d40156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.268+0000 7f9d47800640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4006de40 0x7f9d40156c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c500 tx=0x7f9d3000c9c0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 shutdown_connections 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d401584a0 0x7f9d400a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d18066500 0x7f9d180689c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d400a7120 0x7f9d40157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 --2- 172.21.15.50:0/1117302913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4006de40 0x7f9d40156c40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 >> 172.21.15.50:0/1117302913 conn(0x7f9d400c4830 msgr2=0x7f9d4014d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 shutdown_connections 2024-01-30T08:10:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.272+0000 7f9d47800640 1 -- 172.21.15.50:0/1117302913 wait complete. 2024-01-30T08:10:12.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e2a00640 1 Processor -- start 2024-01-30T08:10:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e2a00640 1 -- start start 2024-01-30T08:10:12.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e2a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd7dc0c0080 0x7fd7dc06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e2a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc06c6e0 con 0x7fd7dc152230 2024-01-30T08:10:12.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e2a00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc154b40 con 0x7fd7dc0c63e0 2024-01-30T08:10:12.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e2a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7dc154e20 con 0x7fd7dc0c0080 2024-01-30T08:10:12.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e0a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd7dc152230 0x7fd7dc071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53352/0 (socket says 172.21.15.50:53352) 2024-01-30T08:10:12.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e0a00640 1 -- 172.21.15.50:0/807040308 learned_addr learned my addr 172.21.15.50:0/807040308 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7dbe00640 1 --2- 172.21.15.50:0/807040308 >> v2:172.21.15.125:3300/0 conn(0x7fd7dc0c0080 0x7fd7dc06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677638939 0 0) 0x7fd7dc06c6e0 con 0x7fd7dc152230 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7bc003530 con 0x7fd7dc152230 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2402147467 0 0) 0x7fd7bc003530 con 0x7fd7dc152230 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 >> v2:172.21.15.125:3300/0 conn(0x7fd7dc0c0080 msgr2=0x7fd7dc06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 --2- 172.21.15.50:0/807040308 >> v2:172.21.15.125:3300/0 conn(0x7fd7dc0c0080 0x7fd7dc06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 >> v1:172.21.15.125:6789/0 conn(0x7fd7dc0c63e0 legacy=0x7fd7dc151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc155100 con 0x7fd7dc152230 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fd7d4001a00 con 0x7fd7dc152230 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7dbe00640 1 --2- 172.21.15.50:0/807040308 >> v2:172.21.15.125:3300/0 conn(0x7fd7dc0c0080 0x7fd7dc06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 >> v1:172.21.15.50:6789/0 conn(0x7fd7dc152230 legacy=0x7fd7dc071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc003980 0x7fd7bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0047d0 0x7fd7bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7bc005190 0x7fd7bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc154e20 con 0x7fd7bc0047d0 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc00c030 con 0x7fd7bc005190 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc00c1f0 con 0x7fd7bc003980 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7db400640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0047d0 0x7fd7bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7dbe00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc003980 0x7fd7bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.432+0000 7fd7e0a00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7bc005190 0x7fd7bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7db400640 1 -- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc003980 msgr2=0x7fd7bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7db400640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc003980 0x7fd7bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7db400640 1 -- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7bc005190 msgr2=0x7fd7bc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7db400640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7bc005190 0x7fd7bc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7db400640 1 -- 172.21.15.50:0/807040308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc003530 con 0x7fd7bc0047d0 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7e0a00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7bc005190 0x7fd7bc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7e0a00640 1 -- 172.21.15.50:0/807040308 reap_dead start 2024-01-30T08:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7db400640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0047d0 0x7fd7bc004c50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4001780 tx=0x7fd7c401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c635eccce53e24 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40a4ea0 con 0x7fd7bc0047d0 2024-01-30T08:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c40a7050 con 0x7fd7bc0047d0 2024-01-30T08:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.436+0000 7fd7daa00640 1 -- 172.21.15.50:0/807040308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40052d0 con 0x7fd7bc0047d0 2024-01-30T08:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- 172.21.15.50:0/807040308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0047d0 msgr2=0x7fd7bc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0047d0 0x7fd7bc004c50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4001780 tx=0x7fd7c401c3e0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- 172.21.15.50:0/807040308 shutdown_connections 2024-01-30T08:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/807040308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0047d0 0x7fd7bc004c50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- 172.21.15.50:0/807040308 >> 172.21.15.50:0/807040308 conn(0x7fd7dc0a9590 msgr2=0x7fd7dc0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- 172.21.15.50:0/807040308 shutdown_connections 2024-01-30T08:10:12.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- 172.21.15.50:0/807040308 wait complete. 2024-01-30T08:10:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 Processor -- start 2024-01-30T08:10:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- start start 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc0047d0 0x7fd7dc1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc0aa710 0x7fd7dc0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc14f970 0x7fd7dc14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1dd3d0 con 0x7fd7dc0aa710 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1db220 con 0x7fd7dc14f970 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7e2a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc0aaf20 con 0x7fd7bc0047d0 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7db400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc0aa710 0x7fd7dc0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7db400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc0aa710 0x7fd7dc0abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49206/0 (socket says 172.21.15.50:49206) 2024-01-30T08:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.440+0000 7fd7db400640 1 -- 172.21.15.50:0/799388636 learned_addr learned my addr 172.21.15.50:0/799388636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7dbe00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc0047d0 0x7fd7dc1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7e0a00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc14f970 0x7fd7dc14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7db400640 1 -- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc0047d0 msgr2=0x7fd7dc1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7db400640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc0047d0 0x7fd7dc1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7db400640 1 -- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc14f970 msgr2=0x7fd7dc14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7db400640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc14f970 0x7fd7dc14fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7db400640 1 -- 172.21.15.50:0/799388636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc0ab200 con 0x7fd7dc0aa710 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7db400640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc0aa710 0x7fd7dc0abb30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd7c401c210 tx=0x7fd7bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7d3e00640 1 -- 172.21.15.50:0/799388636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4003dc0 con 0x7fd7dc0aa710 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7d3e00640 1 -- 172.21.15.50:0/799388636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c40a4ea0 con 0x7fd7dc0aa710 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7d3e00640 1 -- 172.21.15.50:0/799388636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4007270 con 0x7fd7dc0aa710 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc0ab4e0 con 0x7fd7dc0aa710 2024-01-30T08:10:12.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7dc0ac070 con 0x7fd7dc0aa710 2024-01-30T08:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7dc074a20 con 0x7fd7dc0aa710 2024-01-30T08:10:12.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.444+0000 7fd7d3e00640 1 -- 172.21.15.50:0/799388636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd7c40073d0 con 0x7fd7dc0aa710 2024-01-30T08:10:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.448+0000 7fd7d3e00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7b4066530 0x7fd7b40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.448+0000 7fd7d3e00640 1 -- 172.21.15.50:0/799388636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd7c411e5a0 con 0x7fd7dc0aa710 2024-01-30T08:10:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.448+0000 7fd7dbe00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7b4066530 0x7fd7b40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.448+0000 7fd7dbe00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7b4066530 0x7fd7b40689f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0093f0 tx=0x7fd7cc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.452+0000 7fd7d3e00640 1 -- 172.21.15.50:0/799388636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd7c40eb5a0 con 0x7fd7dc0aa710 2024-01-30T08:10:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.612+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7dc072050 con 0x7fd7dc0aa710 2024-01-30T08:10:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.612+0000 7fd7d3e00640 1 -- 172.21.15.50:0/799388636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20504 (secure 0 0 0) 0x7fd7c4007a40 con 0x7fd7dc0aa710 2024-01-30T08:10:12.615 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:12.615 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:11.284027+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.612+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7b4066530 msgr2=0x7fd7b40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.612+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7b4066530 0x7fd7b40689f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0093f0 tx=0x7fd7cc009190 comp rx=0 tx=0).stop 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.612+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc0aa710 msgr2=0x7fd7dc0abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.612+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc0aa710 0x7fd7dc0abb30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd7c401c210 tx=0x7fd7bc005800 comp rx=0 tx=0).stop 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 shutdown_connections 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc14f970 0x7fd7dc14fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd7b4066530 0x7fd7b40689f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc0aa710 0x7fd7dc0abb30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/799388636 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd7bc0047d0 0x7fd7dc1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 >> 172.21.15.50:0/799388636 conn(0x7fd7dc0a9590 msgr2=0x7fd7dc0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 shutdown_connections 2024-01-30T08:10:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.616+0000 7fd7e2a00640 1 -- 172.21.15.50:0/799388636 wait complete. 2024-01-30T08:10:12.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-30T08:10:12.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d8da00640 1 Processor -- start 2024-01-30T08:10:12.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d8da00640 1 -- start start 2024-01-30T08:10:12.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d8da00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d8806f240 0x7f9d8806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d8da00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d880c1200 0x7f9d880c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d8da00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d88158b70 con 0x7f9d88155500 2024-01-30T08:10:12.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d8da00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d880c8cf0 con 0x7f9d8806f240 2024-01-30T08:10:12.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d8da00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88157f60 con 0x7f9d880c1200 2024-01-30T08:10:12.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d86000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d8806f240 0x7f9d8806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d86000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d8806f240 0x7f9d8806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49212/0 (socket says 172.21.15.50:49212) 2024-01-30T08:10:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d86000640 1 -- 172.21.15.50:0/3979000431 learned_addr learned my addr 172.21.15.50:0/3979000431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d87400640 1 --2- 172.21.15.50:0/3979000431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d880c1200 0x7f9d880c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d86000640 1 -- 172.21.15.50:0/3979000431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d880c1200 msgr2=0x7f9d880c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d86000640 1 --2- 172.21.15.50:0/3979000431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d880c1200 0x7f9d880c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d86000640 1 -- 172.21.15.50:0/3979000431 >> v1:172.21.15.125:6789/0 conn(0x7f9d88155500 legacy=0x7f9d880c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d86000640 1 -- 172.21.15.50:0/3979000431 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88158240 con 0x7f9d8806f240 2024-01-30T08:10:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.780+0000 7f9d87400640 1 --2- 172.21.15.50:0/3979000431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d880c1200 0x7f9d880c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:12.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d86000640 1 --2- 172.21.15.50:0/3979000431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d8806f240 0x7f9d8806f6d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009870 tx=0x7f9d7001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e34693b6d027cd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d85600640 1 -- 172.21.15.50:0/3979000431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700ab600 con 0x7f9d8806f240 2024-01-30T08:10:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d85600640 1 -- 172.21.15.50:0/3979000431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d700a7050 con 0x7f9d8806f240 2024-01-30T08:10:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d85600640 1 -- 172.21.15.50:0/3979000431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700ab980 con 0x7f9d8806f240 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 -- 172.21.15.50:0/3979000431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d8806f240 msgr2=0x7f9d8806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 --2- 172.21.15.50:0/3979000431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d8806f240 0x7f9d8806f6d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009870 tx=0x7f9d7001c3b0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 -- 172.21.15.50:0/3979000431 shutdown_connections 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 --2- 172.21.15.50:0/3979000431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d880c1200 0x7f9d880c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 --2- 172.21.15.50:0/3979000431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d8806f240 0x7f9d8806f6d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 -- 172.21.15.50:0/3979000431 >> 172.21.15.50:0/3979000431 conn(0x7f9d880727c0 msgr2=0x7f9d8806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 -- 172.21.15.50:0/3979000431 shutdown_connections 2024-01-30T08:10:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.784+0000 7f9d8da00640 1 -- 172.21.15.50:0/3979000431 wait complete. 2024-01-30T08:10:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 Processor -- start 2024-01-30T08:10:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 -- start start 2024-01-30T08:10:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8806f240 0x7f9d880aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d880c1200 0x7f9d881ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d88155500 0x7f9d881573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880ab3a0 con 0x7f9d88155500 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880acfc0 con 0x7f9d880c1200 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881ecb80 con 0x7f9d8806f240 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d88155500 0x7f9d881573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d88155500 0x7f9d881573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49218/0 (socket says 172.21.15.50:49218) 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 -- 172.21.15.50:0/887157951 learned_addr learned my addr 172.21.15.50:0/887157951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d86000640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d880c1200 0x7f9d881ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d86a00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8806f240 0x7f9d880aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 -- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8806f240 msgr2=0x7f9d880aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8806f240 0x7f9d880aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 -- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d880c1200 msgr2=0x7f9d881ed2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d880c1200 0x7f9d881ed2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 -- 172.21.15.50:0/887157951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700094d0 con 0x7f9d88155500 2024-01-30T08:10:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d87400640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d88155500 0x7f9d881573f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000cd50 tx=0x7f9d8000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d7ea00640 1 -- 172.21.15.50:0/887157951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000f680 con 0x7f9d88155500 2024-01-30T08:10:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d7ea00640 1 -- 172.21.15.50:0/887157951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8000f800 con 0x7f9d88155500 2024-01-30T08:10:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d88151430 con 0x7f9d88155500 2024-01-30T08:10:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d7ea00640 1 -- 172.21.15.50:0/887157951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000fbb0 con 0x7f9d88155500 2024-01-30T08:10:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.788+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d880aca00 con 0x7f9d88155500 2024-01-30T08:10:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.792+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88074a20 con 0x7f9d88155500 2024-01-30T08:10:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.792+0000 7f9d7ea00640 1 -- 172.21.15.50:0/887157951 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9d8000b040 con 0x7f9d88155500 2024-01-30T08:10:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.792+0000 7f9d7ea00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d60066500 0x7f9d600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.792+0000 7f9d7ea00640 1 -- 172.21.15.50:0/887157951 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9d80084bd0 con 0x7f9d88155500 2024-01-30T08:10:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.792+0000 7f9d86a00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d60066500 0x7f9d600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.792+0000 7f9d86a00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d60066500 0x7f9d600689c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d780098e0 tx=0x7f9d78009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.796+0000 7f9d7ea00640 1 -- 172.21.15.50:0/887157951 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9d80051a80 con 0x7f9d88155500 2024-01-30T08:10:12.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:12.996+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9d880c83c0 con 0x7f9d88155500 2024-01-30T08:10:13.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d7ea00640 1 -- 172.21.15.50:0/887157951 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 119+0+0 (secure 0 0 0) 0x7f9d800550a0 con 0x7f9d88155500 2024-01-30T08:10:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d60066500 msgr2=0x7f9d600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d60066500 0x7f9d600689c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d780098e0 tx=0x7f9d78009060 comp rx=0 tx=0).stop 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d88155500 msgr2=0x7f9d881573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d88155500 0x7f9d881573f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000cd50 tx=0x7f9d8000a650 comp rx=0 tx=0).stop 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 shutdown_connections 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d880c1200 0x7f9d881ed2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9d60066500 0x7f9d600689c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d88155500 0x7f9d881573f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 --2- 172.21.15.50:0/887157951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9d8806f240 0x7f9d880aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 >> 172.21.15.50:0/887157951 conn(0x7f9d880727c0 msgr2=0x7f9d8806c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 shutdown_connections 2024-01-30T08:10:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:13.920+0000 7f9d8da00640 1 -- 172.21.15.50:0/887157951 wait complete. 2024-01-30T08:10:13.949 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-30T08:10:13.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-30T08:10:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8ca5200640 1 Processor -- start 2024-01-30T08:10:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8ca5200640 1 -- start start 2024-01-30T08:10:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8ca5200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ca0155500 0x7f8ca00c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8ca5200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca0158b70 con 0x7f8ca006f240 2024-01-30T08:10:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8ca5200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca0157f60 con 0x7f8ca006f6d0 2024-01-30T08:10:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8ca5200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca006fae0 con 0x7f8ca0155500 2024-01-30T08:10:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9d400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8ca006f240 0x7f8ca00c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53354/0 (socket says 172.21.15.50:53354) 2024-01-30T08:10:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9d400640 1 -- 172.21.15.50:0/3082811320 learned_addr learned my addr 172.21.15.50:0/3082811320 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9de00640 1 --2- 172.21.15.50:0/3082811320 >> v2:172.21.15.125:3300/0 conn(0x7f8ca0155500 0x7f8ca00c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9ca00640 1 -- 172.21.15.50:0/3082811320 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789357976 0 0) 0x7f8ca0158b70 con 0x7f8ca006f240 2024-01-30T08:10:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9ca00640 1 -- 172.21.15.50:0/3082811320 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c80003530 con 0x7f8ca006f240 2024-01-30T08:10:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9de00640 1 -- 172.21.15.50:0/3082811320 >> v1:172.21.15.125:6789/0 conn(0x7f8ca006f6d0 legacy=0x7f8ca00c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9de00640 1 -- 172.21.15.50:0/3082811320 >> v1:172.21.15.50:6789/0 conn(0x7f8ca006f240 legacy=0x7f8ca00c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.096+0000 7f8c9de00640 1 -- 172.21.15.50:0/3082811320 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0158240 con 0x7f8ca0155500 2024-01-30T08:10:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.100+0000 7f8c9de00640 1 --2- 172.21.15.50:0/3082811320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 0x7f8ca00c85e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006fc20 tx=0x7f8c9001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c33da49ffb12cf02 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.100+0000 7f8c9ca00640 1 -- 172.21.15.50:0/3082811320 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900ab600 con 0x7f8ca0155500 2024-01-30T08:10:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.100+0000 7f8c9ca00640 1 -- 172.21.15.50:0/3082811320 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c900a7050 con 0x7f8ca0155500 2024-01-30T08:10:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.100+0000 7f8c9ca00640 1 -- 172.21.15.50:0/3082811320 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900ab980 con 0x7f8ca0155500 2024-01-30T08:10:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.100+0000 7f8ca5200640 1 -- 172.21.15.50:0/3082811320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 msgr2=0x7f8ca00c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.100+0000 7f8ca5200640 1 --2- 172.21.15.50:0/3082811320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 0x7f8ca00c85e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006fc20 tx=0x7f8c9001c330 comp rx=0 tx=0).stop 2024-01-30T08:10:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- 172.21.15.50:0/3082811320 shutdown_connections 2024-01-30T08:10:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 --2- 172.21.15.50:0/3082811320 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 0x7f8ca00c85e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- 172.21.15.50:0/3082811320 >> 172.21.15.50:0/3082811320 conn(0x7f8ca00727c0 msgr2=0x7f8ca006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- 172.21.15.50:0/3082811320 shutdown_connections 2024-01-30T08:10:14.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- 172.21.15.50:0/3082811320 wait complete. 2024-01-30T08:10:14.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 Processor -- start 2024-01-30T08:10:14.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- start start 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca006f240 0x7f8ca00c1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ca006f6d0 0x7f8ca014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 0x7f8ca0150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00aa320 con 0x7f8ca006f240 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca01efee0 con 0x7f8ca0155500 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8ca5200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca01f01c0 con 0x7f8ca006f6d0 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca006f240 0x7f8ca00c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca006f240 0x7f8ca00c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49230/0 (socket says 172.21.15.50:49230) 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 -- 172.21.15.50:0/389690437 learned_addr learned my addr 172.21.15.50:0/389690437 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9d400640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ca006f6d0 0x7f8ca014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9e800640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 0x7f8ca0150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 -- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ca006f6d0 msgr2=0x7f8ca014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:14.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ca006f6d0 0x7f8ca014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 -- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 msgr2=0x7f8ca0150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:14.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 0x7f8ca0150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 -- 172.21.15.50:0/389690437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90009420 con 0x7f8ca006f240 2024-01-30T08:10:14.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.104+0000 7f8c9de00640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca006f240 0x7f8ca00c1490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c900ae040 tx=0x7f8c900190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8c96000640 1 -- 172.21.15.50:0/389690437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900b4410 con 0x7f8ca006f240 2024-01-30T08:10:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8c96000640 1 -- 172.21.15.50:0/389690437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c900b4570 con 0x7f8ca006f240 2024-01-30T08:10:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8c96000640 1 -- 172.21.15.50:0/389690437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900b4900 con 0x7f8ca006f240 2024-01-30T08:10:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca01f04a0 con 0x7f8ca006f240 2024-01-30T08:10:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca01f0a60 con 0x7f8ca006f240 2024-01-30T08:10:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca01f0300 con 0x7f8ca006f240 2024-01-30T08:10:14.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8c96000640 1 -- 172.21.15.50:0/389690437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8c900b2040 con 0x7f8ca006f240 2024-01-30T08:10:14.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8c96000640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8c78066550 0x7f8c78068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:14.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8c96000640 1 -- 172.21.15.50:0/389690437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8c9011e2a0 con 0x7f8ca006f240 2024-01-30T08:10:14.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.108+0000 7f8c9d400640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8c78066550 0x7f8c78068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:14.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.112+0000 7f8c9d400640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8c78066550 0x7f8c78068a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00c8690 tx=0x7f8c88007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:14.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.112+0000 7f8c96000640 1 -- 172.21.15.50:0/389690437 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8ca01f0300 con 0x7f8ca006f240 2024-01-30T08:10:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.308+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8ca01f0300 con 0x7f8ca006f240 2024-01-30T08:10:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.920+0000 7f8c96000640 1 -- 172.21.15.50:0/389690437 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8ca01f0300 con 0x7f8ca006f240 2024-01-30T08:10:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8c78066550 msgr2=0x7f8c78068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8c78066550 0x7f8c78068a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00c8690 tx=0x7f8c88007d40 comp rx=0 tx=0).stop 2024-01-30T08:10:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca006f240 msgr2=0x7f8ca00c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca006f240 0x7f8ca00c1490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c900ae040 tx=0x7f8c900190d0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 shutdown_connections 2024-01-30T08:10:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ca0155500 0x7f8ca0150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8c78066550 0x7f8c78068a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ca006f6d0 0x7f8ca014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 --2- 172.21.15.50:0/389690437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca006f240 0x7f8ca00c1490 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 >> 172.21.15.50:0/389690437 conn(0x7f8ca00727c0 msgr2=0x7f8ca00c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 shutdown_connections 2024-01-30T08:10:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:14.924+0000 7f8ca5200640 1 -- 172.21.15.50:0/389690437 wait complete. 2024-01-30T08:10:14.950 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-30T08:10:14.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.092+0000 7f1d13200640 1 Processor -- start 2024-01-30T08:10:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.092+0000 7f1d13200640 1 -- start start 2024-01-30T08:10:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d13200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d0c152e40 0x7f1d0c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d13200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d13200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0c072580 con 0x7f1d0c06c390 2024-01-30T08:10:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d13200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0c06afb0 con 0x7f1d0c152e40 2024-01-30T08:10:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d13200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c06f450 con 0x7f1d0c06a740 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0b400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d0c152e40 0x7f1d0c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d11c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0be00640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1d0c06c390 0x7f1d0c14f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:51860/0 (socket says 172.21.15.50:51860) 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d11c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:35312/0 (socket says 172.21.15.50:35312) 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0be00640 1 -- 172.21.15.50:0/1333372940 learned_addr learned my addr 172.21.15.50:0/1333372940 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0b400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d0c152e40 0x7f1d0c071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48238/0 (socket says 172.21.15.50:48238) 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0b400640 1 -- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 msgr2=0x7f1d0c072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0b400640 1 --2- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0b400640 1 -- 172.21.15.50:0/1333372940 >> v1:172.21.15.125:6789/0 conn(0x7f1d0c06c390 legacy=0x7f1d0c14f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0aa00640 1 -- 172.21.15.50:0/1333372940 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479574078 0 0) 0x7f1d0c072580 con 0x7f1d0c06c390 2024-01-30T08:10:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d0b400640 1 -- 172.21.15.50:0/1333372940 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c153340 con 0x7f1d0c152e40 2024-01-30T08:10:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.096+0000 7f1d11c00640 1 --2- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d0b400640 1 --2- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c071b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40097c0 tx=0x7f1cf401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45bed9ef52b19a39 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d0aa00640 1 -- 172.21.15.50:0/1333372940 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40ac620 con 0x7f1d0c152e40 2024-01-30T08:10:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d0aa00640 1 -- 172.21.15.50:0/1333372940 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf40ac780 con 0x7f1d0c152e40 2024-01-30T08:10:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d0aa00640 1 -- 172.21.15.50:0/1333372940 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40acb10 con 0x7f1d0c152e40 2024-01-30T08:10:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 -- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 msgr2=0x7f1d0c071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 --2- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c071b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40097c0 tx=0x7f1cf401c3c0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 -- 172.21.15.50:0/1333372940 shutdown_connections 2024-01-30T08:10:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 --2- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 --2- 172.21.15.50:0/1333372940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c071b00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 -- 172.21.15.50:0/1333372940 >> 172.21.15.50:0/1333372940 conn(0x7f1d0c0c74a0 msgr2=0x7f1d0c0c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 -- 172.21.15.50:0/1333372940 shutdown_connections 2024-01-30T08:10:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 -- 172.21.15.50:0/1333372940 wait complete. 2024-01-30T08:10:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 Processor -- start 2024-01-30T08:10:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.100+0000 7f1d13200640 1 -- start start 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c06c390 0x7f1d0c13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c13f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0ac400 con 0x7f1d0c06c390 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0ab6e0 con 0x7f1d0c152e40 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0aba60 con 0x7f1d0c06a740 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c06c390 0x7f1d0c13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c06c390 0x7f1d0c13f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49240/0 (socket says 172.21.15.50:49240) 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 -- 172.21.15.50:0/1290119864 learned_addr learned my addr 172.21.15.50:0/1290119864 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0be00640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d11c00640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 -- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 msgr2=0x7f1d0c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 -- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 msgr2=0x7f1d0c13f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c13f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 -- 172.21.15.50:0/1290119864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04009a70 con 0x7f1d0c06c390 2024-01-30T08:10:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d11c00640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d0b400640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c06c390 0x7f1d0c13f300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4019ff0 tx=0x7f1cf401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d03e00640 1 -- 172.21.15.50:0/1290119864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40b8450 con 0x7f1d0c06c390 2024-01-30T08:10:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d03e00640 1 -- 172.21.15.50:0/1290119864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf40b85d0 con 0x7f1d0c06c390 2024-01-30T08:10:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d03e00640 1 -- 172.21.15.50:0/1290119864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40b8980 con 0x7f1d0c06c390 2024-01-30T08:10:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf4009420 con 0x7f1d0c06c390 2024-01-30T08:10:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c0ac020 con 0x7f1d0c06c390 2024-01-30T08:10:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.104+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c06f8c0 con 0x7f1d0c06c390 2024-01-30T08:10:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.108+0000 7f1d03e00640 1 -- 172.21.15.50:0/1290119864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1cf40aa070 con 0x7f1d0c06c390 2024-01-30T08:10:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.108+0000 7f1d03e00640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1ce4066500 0x7f1ce40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.108+0000 7f1d03e00640 1 -- 172.21.15.50:0/1290119864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1cf411e8a0 con 0x7f1d0c06c390 2024-01-30T08:10:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.108+0000 7f1d0be00640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1ce4066500 0x7f1ce40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.108+0000 7f1d0be00640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1ce4066500 0x7f1ce40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc007fd0 tx=0x7f1cfc007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.112+0000 7f1d03e00640 1 -- 172.21.15.50:0/1290119864 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1d0c06f8c0 con 0x7f1d0c06c390 2024-01-30T08:10:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d0c06f8c0 con 0x7f1d0c06c390 2024-01-30T08:10:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d03e00640 1 -- 172.21.15.50:0/1290119864 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f1d0c06f8c0 con 0x7f1d0c06c390 2024-01-30T08:10:15.308 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:15.308 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:09:53.316367+0000","modified":"2024-01-30T08:09:56.334652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1837689837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1837689837},{"type":"v1","addr":"172.21.15.50:6835","nonce":1837689837}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:15.308 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-01-30T08:10:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1ce4066500 msgr2=0x7f1ce40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1ce4066500 0x7f1ce40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc007fd0 tx=0x7f1cfc007d60 comp rx=0 tx=0).stop 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c06c390 msgr2=0x7f1d0c13f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c06c390 0x7f1d0c13f300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4019ff0 tx=0x7f1cf401ac00 comp rx=0 tx=0).stop 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 shutdown_connections 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c152e40 0x7f1d0c13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1ce4066500 0x7f1ce40689c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c06c390 0x7f1d0c13f300 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 --2- 172.21.15.50:0/1290119864 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d0c06a740 0x7f1d0c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 >> 172.21.15.50:0/1290119864 conn(0x7f1d0c0c74a0 msgr2=0x7f1d0c0c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 shutdown_connections 2024-01-30T08:10:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.304+0000 7f1d13200640 1 -- 172.21.15.50:0/1290119864 wait complete. 2024-01-30T08:10:15.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:15.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13f7400640 1 Processor -- start 2024-01-30T08:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13f7400640 1 -- start start 2024-01-30T08:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13f7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13f00c1840 0x7f13f00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13f7400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f00a8cf0 con 0x7f13f00c5650 2024-01-30T08:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13f7400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f0072a30 con 0x7f13f00c4760 2024-01-30T08:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13f7400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f00a8f40 con 0x7f13f00c1840 2024-01-30T08:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13f4a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13f00c1840 0x7f13f00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13efe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13f00c5650 0x7f13f006cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53364/0 (socket says 172.21.15.50:53364) 2024-01-30T08:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.468+0000 7f13efe00640 1 -- 172.21.15.50:0/1655817903 learned_addr learned my addr 172.21.15.50:0/1655817903 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13f4a00640 1 -- 172.21.15.50:0/1655817903 >> v1:172.21.15.125:6789/0 conn(0x7f13f00c4760 legacy=0x7f13f006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13f4a00640 1 -- 172.21.15.50:0/1655817903 >> v1:172.21.15.50:6789/0 conn(0x7f13f00c5650 legacy=0x7f13f006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13f4a00640 1 -- 172.21.15.50:0/1655817903 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0072cd0 con 0x7f13f00c1840 2024-01-30T08:10:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13f4a00640 1 --2- 172.21.15.50:0/1655817903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f00a4d50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f13e00097c0 tx=0x7f13e001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea029ab6fa18e63 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13ef400640 1 -- 172.21.15.50:0/1655817903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00ab600 con 0x7f13f00c1840 2024-01-30T08:10:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13ef400640 1 -- 172.21.15.50:0/1655817903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e00a7050 con 0x7f13f00c1840 2024-01-30T08:10:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13ef400640 1 -- 172.21.15.50:0/1655817903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00ab980 con 0x7f13f00c1840 2024-01-30T08:10:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13f7400640 1 -- 172.21.15.50:0/1655817903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 msgr2=0x7f13f00a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.472+0000 7f13f7400640 1 --2- 172.21.15.50:0/1655817903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f00a4d50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f13e00097c0 tx=0x7f13e001c360 comp rx=0 tx=0).stop 2024-01-30T08:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- 172.21.15.50:0/1655817903 shutdown_connections 2024-01-30T08:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 --2- 172.21.15.50:0/1655817903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f00a4d50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- 172.21.15.50:0/1655817903 >> 172.21.15.50:0/1655817903 conn(0x7f13f00c5b50 msgr2=0x7f13f00c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- 172.21.15.50:0/1655817903 shutdown_connections 2024-01-30T08:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- 172.21.15.50:0/1655817903 wait complete. 2024-01-30T08:10:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 Processor -- start 2024-01-30T08:10:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- start start 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f01f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13f00c4760 0x7f13f01eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13f00c5650 0x7f13f0150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0151c10 con 0x7f13f00c1840 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f01f0b80 con 0x7f13f00c4760 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f7400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f01528e0 con 0x7f13f00c5650 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f01f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f01f0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49252/0 (socket says 172.21.15.50:49252) 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 -- 172.21.15.50:0/1677100409 learned_addr learned my addr 172.21.15.50:0/1677100409 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13efe00640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13f00c4760 0x7f13f01eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f5400640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13f00c5650 0x7f13f0150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 -- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13f00c5650 msgr2=0x7f13f0150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13f00c5650 0x7f13f0150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 -- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13f00c4760 msgr2=0x7f13f01eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13f00c4760 0x7f13f01eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 -- 172.21.15.50:0/1677100409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0009420 con 0x7f13f00c1840 2024-01-30T08:10:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.476+0000 7f13f4a00640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f01f0640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f13e00097c0 tx=0x7f13e0019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13ecc00640 1 -- 172.21.15.50:0/1677100409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00b4840 con 0x7f13f00c1840 2024-01-30T08:10:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13ecc00640 1 -- 172.21.15.50:0/1677100409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e00b49c0 con 0x7f13f00c1840 2024-01-30T08:10:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13ecc00640 1 -- 172.21.15.50:0/1677100409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00b4d70 con 0x7f13f00c1840 2024-01-30T08:10:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f0152320 con 0x7f13f00c1840 2024-01-30T08:10:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f01ed210 con 0x7f13f00c1840 2024-01-30T08:10:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f0074a20 con 0x7f13f00c1840 2024-01-30T08:10:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13ecc00640 1 -- 172.21.15.50:0/1677100409 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f13e00b2040 con 0x7f13f00c1840 2024-01-30T08:10:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13ecc00640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f13c8066500 0x7f13c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13ecc00640 1 -- 172.21.15.50:0/1677100409 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f13e011e5a0 con 0x7f13f00c1840 2024-01-30T08:10:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.480+0000 7f13efe00640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f13c8066500 0x7f13c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.484+0000 7f13efe00640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f13c8066500 0x7f13c80689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13f00a5b80 tx=0x7f13d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.484+0000 7f13ecc00640 1 -- 172.21.15.50:0/1677100409 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f13e00eb390 con 0x7f13f00c1840 2024-01-30T08:10:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.644+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13f014c940 con 0x7f13f00c1840 2024-01-30T08:10:15.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13ecc00640 1 -- 172.21.15.50:0/1677100409 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20491 (secure 0 0 0) 0x7f13e00ee9b0 con 0x7f13f00c1840 2024-01-30T08:10:15.651 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:15.651 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:12.907159+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:15.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f13c8066500 msgr2=0x7f13c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f13c8066500 0x7f13c80689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13f00a5b80 tx=0x7f13d8009040 comp rx=0 tx=0).stop 2024-01-30T08:10:15.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 msgr2=0x7f13f01f0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f01f0640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f13e00097c0 tx=0x7f13e0019100 comp rx=0 tx=0).stop 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 shutdown_connections 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13f00c4760 0x7f13f01eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f13c8066500 0x7f13c80689c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13f00c5650 0x7f13f0150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 --2- 172.21.15.50:0/1677100409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f00c1840 0x7f13f01f0640 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 >> 172.21.15.50:0/1677100409 conn(0x7f13f00c5b50 msgr2=0x7f13f006b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 shutdown_connections 2024-01-30T08:10:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.648+0000 7f13f7400640 1 -- 172.21.15.50:0/1677100409 wait complete. 2024-01-30T08:10:15.673 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-30T08:10:15.673 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:15.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9597800640 1 Processor -- start 2024-01-30T08:10:15.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9597800640 1 -- start start 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9597800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9597800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95900c5650 0x7f95900a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9597800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95900a8cf0 con 0x7f95900c4760 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9597800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9590072a30 con 0x7f95900c5650 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9597800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900a8f40 con 0x7f95900c1840 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9595800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95900c4760 0x7f959006cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53380/0 (socket says 172.21.15.50:53380) 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9595800640 1 -- 172.21.15.50:0/3875146187 learned_addr learned my addr 172.21.15.50:0/3875146187 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9594e00640 1 --2- 172.21.15.50:0/3875146187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f958fe00640 1 --2- 172.21.15.50:0/3875146187 >> v2:172.21.15.125:3300/0 conn(0x7f95900c5650 0x7f95900a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f958f400640 1 -- 172.21.15.50:0/3875146187 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164698936 0 0) 0x7f95900a8cf0 con 0x7f95900c4760 2024-01-30T08:10:15.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f958f400640 1 -- 172.21.15.50:0/3875146187 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9570003530 con 0x7f95900c4760 2024-01-30T08:10:15.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9594e00640 1 -- 172.21.15.50:0/3875146187 >> v2:172.21.15.125:3300/0 conn(0x7f95900c5650 msgr2=0x7f95900a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:15.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9594e00640 1 --2- 172.21.15.50:0/3875146187 >> v2:172.21.15.125:3300/0 conn(0x7f95900c5650 0x7f95900a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9594e00640 1 -- 172.21.15.50:0/3875146187 >> v1:172.21.15.50:6789/0 conn(0x7f95900c4760 legacy=0x7f959006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.812+0000 7f9594e00640 1 -- 172.21.15.50:0/3875146187 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590072cd0 con 0x7f95900c1840 2024-01-30T08:10:15.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9594e00640 1 --2- 172.21.15.50:0/3875146187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900a4d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95800097c0 tx=0x7f958001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed1a05785a5603ad server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f958f400640 1 -- 172.21.15.50:0/3875146187 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800a6040 con 0x7f95900c1840 2024-01-30T08:10:15.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f958f400640 1 -- 172.21.15.50:0/3875146187 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95800aa600 con 0x7f95900c1840 2024-01-30T08:10:15.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f958f400640 1 -- 172.21.15.50:0/3875146187 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800aa990 con 0x7f95900c1840 2024-01-30T08:10:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 -- 172.21.15.50:0/3875146187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 msgr2=0x7f95900a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 --2- 172.21.15.50:0/3875146187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900a4d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95800097c0 tx=0x7f958001c480 comp rx=0 tx=0).stop 2024-01-30T08:10:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 -- 172.21.15.50:0/3875146187 shutdown_connections 2024-01-30T08:10:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 --2- 172.21.15.50:0/3875146187 >> v2:172.21.15.125:3300/0 conn(0x7f95900c5650 0x7f95900a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 --2- 172.21.15.50:0/3875146187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900a4d50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 -- 172.21.15.50:0/3875146187 >> 172.21.15.50:0/3875146187 conn(0x7f95900c5b50 msgr2=0x7f95900c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 -- 172.21.15.50:0/3875146187 shutdown_connections 2024-01-30T08:10:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.816+0000 7f9597800640 1 -- 172.21.15.50:0/3875146187 wait complete. 2024-01-30T08:10:15.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 Processor -- start 2024-01-30T08:10:15.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 -- start start 2024-01-30T08:10:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95900c4760 0x7f959014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95900c5650 0x7f9590148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959014e2f0 con 0x7f95900c4760 2024-01-30T08:10:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590150420 con 0x7f95900c5650 2024-01-30T08:10:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959014c860 con 0x7f95900c1840 2024-01-30T08:10:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95900c4760 0x7f959014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95900c4760 0x7f959014d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49256/0 (socket says 172.21.15.50:49256) 2024-01-30T08:10:15.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 -- 172.21.15.50:0/1963172678 learned_addr learned my addr 172.21.15.50:0/1963172678 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9594e00640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9595800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95900c5650 0x7f9590148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 -- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 msgr2=0x7f95900c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 -- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95900c5650 msgr2=0x7f9590148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95900c5650 0x7f9590148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 -- 172.21.15.50:0/1963172678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580009420 con 0x7f95900c4760 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9595800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95900c5650 0x7f9590148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958fe00640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95900c4760 0x7f959014d200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f957800e930 tx=0x7f957800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958cc00640 1 -- 172.21.15.50:0/1963172678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578009690 con 0x7f95900c4760 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958cc00640 1 -- 172.21.15.50:0/1963172678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957800ca00 con 0x7f95900c4760 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f958cc00640 1 -- 172.21.15.50:0/1963172678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800cd70 con 0x7f95900c4760 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959014cb40 con 0x7f95900c4760 2024-01-30T08:10:15.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.820+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95900a74e0 con 0x7f95900c4760 2024-01-30T08:10:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.824+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9590074a20 con 0x7f95900c4760 2024-01-30T08:10:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.824+0000 7f958cc00640 1 -- 172.21.15.50:0/1963172678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9578013470 con 0x7f95900c4760 2024-01-30T08:10:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.824+0000 7f958cc00640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9568066500 0x7f95680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:15.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.824+0000 7f958cc00640 1 -- 172.21.15.50:0/1963172678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9578084620 con 0x7f95900c4760 2024-01-30T08:10:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.824+0000 7f9594e00640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9568066500 0x7f95680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.824+0000 7f9594e00640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9568066500 0x7f95680689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95800ae000 tx=0x7f95800a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:15.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.828+0000 7f958cc00640 1 -- 172.21.15.50:0/1963172678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f95780514e0 con 0x7f95900c4760 2024-01-30T08:10:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:15.988+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f959006dc30 con 0x7f9568066500 2024-01-30T08:10:16.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.000+0000 7f958cc00640 1 -- 172.21.15.50:0/1963172678 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+520017 (secure 0 0 0) 0x7f95800aa770 con 0x7f9568066500 2024-01-30T08:10:16.010 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9568066500 msgr2=0x7f95680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9568066500 0x7f95680689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95800ae000 tx=0x7f95800a7000 comp rx=0 tx=0).stop 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95900c4760 msgr2=0x7f959014d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95900c4760 0x7f959014d200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f957800e930 tx=0x7f957800edf0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 shutdown_connections 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95900c5650 0x7f9590148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9568066500 0x7f95680689c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95900c4760 0x7f959014d200 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 --2- 172.21.15.50:0/1963172678 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95900c1840 0x7f95900c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 >> 172.21.15.50:0/1963172678 conn(0x7f95900c5b50 msgr2=0x7f95900c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 shutdown_connections 2024-01-30T08:10:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.008+0000 7f9597800640 1 -- 172.21.15.50:0/1963172678 wait complete. 2024-01-30T08:10:16.030 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-01-30T08:10:15.072779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594329,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":302,"acting":302,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236596,"kb_used_data":3772,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738124,"statfs":{"total":773094113280,"available":772851838976,"internally_reserved":0,"allocated":3862528,"data_stored":2776005,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.202958"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873286+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:10:09.873286+0000","last_peered":"2024-01-30T08:10:09.873286+0000","last_clean":"2024-01-30T08:10:09.873286+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:10:09.873286+0000","last_undegraded":"2024-01-30T08:10:09.873286+0000","last_fullsized":"2024-01-30T08:10:09.873286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873025+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:10:09.873025+0000","last_peered":"2024-01-30T08:10:09.873025+0000","last_clean":"2024-01-30T08:10:09.873025+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:10:09.873025+0000","last_undegraded":"2024-01-30T08:10:09.873025+0000","last_fullsized":"2024-01-30T08:10:09.873025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903892+0000","last_change":"2024-01-30T08:09:53.888831+0000","last_active":"2024-01-30T08:10:11.903892+0000","last_peered":"2024-01-30T08:10:11.903892+0000","last_clean":"2024-01-30T08:10:11.903892+0000","last_became_active":"2024-01-30T08:09:53.888512+0000","last_became_peered":"2024-01-30T08:09:53.888512+0000","last_unstale":"2024-01-30T08:10:11.903892+0000","last_undegraded":"2024-01-30T08:10:11.903892+0000","last_fullsized":"2024-01-30T08:10:11.903892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:19.673462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929426+0000","last_change":"2024-01-30T08:10:11.925833+0000","last_active":"2024-01-30T08:10:11.929426+0000","last_peered":"2024-01-30T08:10:11.929426+0000","last_clean":"2024-01-30T08:10:11.929426+0000","last_became_active":"2024-01-30T08:10:11.925416+0000","last_became_peered":"2024-01-30T08:10:11.925416+0000","last_unstale":"2024-01-30T08:10:11.929426+0000","last_undegraded":"2024-01-30T08:10:11.929426+0000","last_fullsized":"2024-01-30T08:10:11.929426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877372+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:10:09.877372+0000","last_peered":"2024-01-30T08:10:09.877372+0000","last_clean":"2024-01-30T08:10:09.877372+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:10:09.877372+0000","last_undegraded":"2024-01-30T08:10:09.877372+0000","last_fullsized":"2024-01-30T08:10:09.877372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878738+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:10:09.878738+0000","last_peered":"2024-01-30T08:10:09.878738+0000","last_clean":"2024-01-30T08:10:09.878738+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:10:09.878738+0000","last_undegraded":"2024-01-30T08:10:09.878738+0000","last_fullsized":"2024-01-30T08:10:09.878738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:47.332748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878589+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:10:09.878589+0000","last_peered":"2024-01-30T08:10:09.878589+0000","last_clean":"2024-01-30T08:10:09.878589+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:10:09.878589+0000","last_undegraded":"2024-01-30T08:10:09.878589+0000","last_fullsized":"2024-01-30T08:10:09.878589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893805+0000","last_change":"2024-01-30T08:09:53.884011+0000","last_active":"2024-01-30T08:10:11.893805+0000","last_peered":"2024-01-30T08:10:11.893805+0000","last_clean":"2024-01-30T08:10:11.893805+0000","last_became_active":"2024-01-30T08:09:53.881881+0000","last_became_peered":"2024-01-30T08:09:53.881881+0000","last_unstale":"2024-01-30T08:10:11.893805+0000","last_undegraded":"2024-01-30T08:10:11.893805+0000","last_fullsized":"2024-01-30T08:10:11.893805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:04:50.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.872756+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:10:09.872756+0000","last_peered":"2024-01-30T08:10:09.872756+0000","last_clean":"2024-01-30T08:10:09.872756+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:10:09.872756+0000","last_undegraded":"2024-01-30T08:10:09.872756+0000","last_fullsized":"2024-01-30T08:10:09.872756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.931474+0000","last_change":"2024-01-30T08:10:11.929495+0000","last_active":"2024-01-30T08:10:11.931474+0000","last_peered":"2024-01-30T08:10:11.931474+0000","last_clean":"2024-01-30T08:10:11.931474+0000","last_became_active":"2024-01-30T08:10:11.928578+0000","last_became_peered":"2024-01-30T08:10:11.928578+0000","last_unstale":"2024-01-30T08:10:11.931474+0000","last_undegraded":"2024-01-30T08:10:11.931474+0000","last_fullsized":"2024-01-30T08:10:11.931474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905164+0000","last_change":"2024-01-30T08:09:53.887909+0000","last_active":"2024-01-30T08:10:11.905164+0000","last_peered":"2024-01-30T08:10:11.905164+0000","last_clean":"2024-01-30T08:10:11.905164+0000","last_became_active":"2024-01-30T08:09:53.887634+0000","last_became_peered":"2024-01-30T08:09:53.887634+0000","last_unstale":"2024-01-30T08:10:11.905164+0000","last_undegraded":"2024-01-30T08:10:11.905164+0000","last_fullsized":"2024-01-30T08:10:11.905164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:52.921864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896717+0000","last_change":"2024-01-30T08:09:53.883502+0000","last_active":"2024-01-30T08:10:11.896717+0000","last_peered":"2024-01-30T08:10:11.896717+0000","last_clean":"2024-01-30T08:10:11.896717+0000","last_became_active":"2024-01-30T08:09:53.883146+0000","last_became_peered":"2024-01-30T08:09:53.883146+0000","last_unstale":"2024-01-30T08:10:11.896717+0000","last_undegraded":"2024-01-30T08:10:11.896717+0000","last_fullsized":"2024-01-30T08:10:11.896717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:13.134749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896375+0000","last_change":"2024-01-30T08:09:53.883798+0000","last_active":"2024-01-30T08:10:11.896375+0000","last_peered":"2024-01-30T08:10:11.896375+0000","last_clean":"2024-01-30T08:10:11.896375+0000","last_became_active":"2024-01-30T08:09:53.883077+0000","last_became_peered":"2024-01-30T08:09:53.883077+0000","last_unstale":"2024-01-30T08:10:11.896375+0000","last_undegraded":"2024-01-30T08:10:11.896375+0000","last_fullsized":"2024-01-30T08:10:11.896375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:40.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903225+0000","last_change":"2024-01-30T08:09:53.880237+0000","last_active":"2024-01-30T08:10:11.903225+0000","last_peered":"2024-01-30T08:10:11.903225+0000","last_clean":"2024-01-30T08:10:11.903225+0000","last_became_active":"2024-01-30T08:09:53.879920+0000","last_became_peered":"2024-01-30T08:09:53.879920+0000","last_unstale":"2024-01-30T08:10:11.903225+0000","last_undegraded":"2024-01-30T08:10:11.903225+0000","last_fullsized":"2024-01-30T08:10:11.903225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:31:19.905033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930126+0000","last_change":"2024-01-30T08:10:11.928221+0000","last_active":"2024-01-30T08:10:11.930126+0000","last_peered":"2024-01-30T08:10:11.930126+0000","last_clean":"2024-01-30T08:10:11.930126+0000","last_became_active":"2024-01-30T08:10:11.924922+0000","last_became_peered":"2024-01-30T08:10:11.924922+0000","last_unstale":"2024-01-30T08:10:11.930126+0000","last_undegraded":"2024-01-30T08:10:11.930126+0000","last_fullsized":"2024-01-30T08:10:11.930126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893343+0000","last_change":"2024-01-30T08:09:53.879036+0000","last_active":"2024-01-30T08:10:11.893343+0000","last_peered":"2024-01-30T08:10:11.893343+0000","last_clean":"2024-01-30T08:10:11.893343+0000","last_became_active":"2024-01-30T08:09:53.878757+0000","last_became_peered":"2024-01-30T08:09:53.878757+0000","last_unstale":"2024-01-30T08:10:11.893343+0000","last_undegraded":"2024-01-30T08:10:11.893343+0000","last_fullsized":"2024-01-30T08:10:11.893343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:32:50.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876211+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:10:09.876211+0000","last_peered":"2024-01-30T08:10:09.876211+0000","last_clean":"2024-01-30T08:10:09.876211+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:10:09.876211+0000","last_undegraded":"2024-01-30T08:10:09.876211+0000","last_fullsized":"2024-01-30T08:10:09.876211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893908+0000","last_change":"2024-01-30T08:09:53.886393+0000","last_active":"2024-01-30T08:10:11.893908+0000","last_peered":"2024-01-30T08:10:11.893908+0000","last_clean":"2024-01-30T08:10:11.893908+0000","last_became_active":"2024-01-30T08:09:53.881749+0000","last_became_peered":"2024-01-30T08:09:53.881749+0000","last_unstale":"2024-01-30T08:10:11.893908+0000","last_undegraded":"2024-01-30T08:10:11.893908+0000","last_fullsized":"2024-01-30T08:10:11.893908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:22.523025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882884+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:10:09.882884+0000","last_peered":"2024-01-30T08:10:09.882884+0000","last_clean":"2024-01-30T08:10:09.882884+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:10:09.882884+0000","last_undegraded":"2024-01-30T08:10:09.882884+0000","last_fullsized":"2024-01-30T08:10:09.882884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.934707+0000","last_change":"2024-01-30T08:10:11.931335+0000","last_active":"2024-01-30T08:10:11.934707+0000","last_peered":"2024-01-30T08:10:11.934707+0000","last_clean":"2024-01-30T08:10:11.934707+0000","last_became_active":"2024-01-30T08:10:11.931065+0000","last_became_peered":"2024-01-30T08:10:11.931065+0000","last_unstale":"2024-01-30T08:10:11.934707+0000","last_undegraded":"2024-01-30T08:10:11.934707+0000","last_fullsized":"2024-01-30T08:10:11.934707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884985+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:10:09.884985+0000","last_peered":"2024-01-30T08:10:09.884985+0000","last_clean":"2024-01-30T08:10:09.884985+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:10:09.884985+0000","last_undegraded":"2024-01-30T08:10:09.884985+0000","last_fullsized":"2024-01-30T08:10:09.884985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925741+0000","last_change":"2024-01-30T08:10:11.911805+0000","last_active":"2024-01-30T08:10:11.925741+0000","last_peered":"2024-01-30T08:10:11.925741+0000","last_clean":"2024-01-30T08:10:11.925741+0000","last_became_active":"2024-01-30T08:10:11.911191+0000","last_became_peered":"2024-01-30T08:10:11.911191+0000","last_unstale":"2024-01-30T08:10:11.925741+0000","last_undegraded":"2024-01-30T08:10:11.925741+0000","last_fullsized":"2024-01-30T08:10:11.925741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875392+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:10:09.875392+0000","last_peered":"2024-01-30T08:10:09.875392+0000","last_clean":"2024-01-30T08:10:09.875392+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:10:09.875392+0000","last_undegraded":"2024-01-30T08:10:09.875392+0000","last_fullsized":"2024-01-30T08:10:09.875392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914789+0000","last_change":"2024-01-30T08:10:11.908732+0000","last_active":"2024-01-30T08:10:11.914789+0000","last_peered":"2024-01-30T08:10:11.914789+0000","last_clean":"2024-01-30T08:10:11.914789+0000","last_became_active":"2024-01-30T08:10:11.908460+0000","last_became_peered":"2024-01-30T08:10:11.908460+0000","last_unstale":"2024-01-30T08:10:11.914789+0000","last_undegraded":"2024-01-30T08:10:11.914789+0000","last_fullsized":"2024-01-30T08:10:11.914789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:57:12.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879678+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:10:09.879678+0000","last_peered":"2024-01-30T08:10:09.879678+0000","last_clean":"2024-01-30T08:10:09.879678+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:10:09.879678+0000","last_undegraded":"2024-01-30T08:10:09.879678+0000","last_fullsized":"2024-01-30T08:10:09.879678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875311+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:10:09.875311+0000","last_peered":"2024-01-30T08:10:09.875311+0000","last_clean":"2024-01-30T08:10:09.875311+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:10:09.875311+0000","last_undegraded":"2024-01-30T08:10:09.875311+0000","last_fullsized":"2024-01-30T08:10:09.875311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893439+0000","last_change":"2024-01-30T08:09:53.884047+0000","last_active":"2024-01-30T08:10:11.893439+0000","last_peered":"2024-01-30T08:10:11.893439+0000","last_clean":"2024-01-30T08:10:11.893439+0000","last_became_active":"2024-01-30T08:09:53.883765+0000","last_became_peered":"2024-01-30T08:09:53.883765+0000","last_unstale":"2024-01-30T08:10:11.893439+0000","last_undegraded":"2024-01-30T08:10:11.893439+0000","last_fullsized":"2024-01-30T08:10:11.893439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:54:01.174660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874229+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:10:09.874229+0000","last_peered":"2024-01-30T08:10:09.874229+0000","last_clean":"2024-01-30T08:10:09.874229+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:10:09.874229+0000","last_undegraded":"2024-01-30T08:10:09.874229+0000","last_fullsized":"2024-01-30T08:10:09.874229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924123+0000","last_change":"2024-01-30T08:10:11.917501+0000","last_active":"2024-01-30T08:10:11.924123+0000","last_peered":"2024-01-30T08:10:11.924123+0000","last_clean":"2024-01-30T08:10:11.924123+0000","last_became_active":"2024-01-30T08:10:11.917148+0000","last_became_peered":"2024-01-30T08:10:11.917148+0000","last_unstale":"2024-01-30T08:10:11.924123+0000","last_undegraded":"2024-01-30T08:10:11.924123+0000","last_fullsized":"2024-01-30T08:10:11.924123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:27.639415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883277+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:10:09.883277+0000","last_peered":"2024-01-30T08:10:09.883277+0000","last_clean":"2024-01-30T08:10:09.883277+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:10:09.883277+0000","last_undegraded":"2024-01-30T08:10:09.883277+0000","last_fullsized":"2024-01-30T08:10:09.883277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:00.220792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878429+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:10:09.878429+0000","last_peered":"2024-01-30T08:10:09.878429+0000","last_clean":"2024-01-30T08:10:09.878429+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:10:09.878429+0000","last_undegraded":"2024-01-30T08:10:09.878429+0000","last_fullsized":"2024-01-30T08:10:09.878429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:22.789462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875514+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:10:09.875514+0000","last_peered":"2024-01-30T08:10:09.875514+0000","last_clean":"2024-01-30T08:10:09.875514+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:10:09.875514+0000","last_undegraded":"2024-01-30T08:10:09.875514+0000","last_fullsized":"2024-01-30T08:10:09.875514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924583+0000","last_change":"2024-01-30T08:10:11.916385+0000","last_active":"2024-01-30T08:10:11.924583+0000","last_peered":"2024-01-30T08:10:11.924583+0000","last_clean":"2024-01-30T08:10:11.924583+0000","last_became_active":"2024-01-30T08:10:11.915981+0000","last_became_peered":"2024-01-30T08:10:11.915981+0000","last_unstale":"2024-01-30T08:10:11.924583+0000","last_undegraded":"2024-01-30T08:10:11.924583+0000","last_fullsized":"2024-01-30T08:10:11.924583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:27.251561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879137+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:10:09.879137+0000","last_peered":"2024-01-30T08:10:09.879137+0000","last_clean":"2024-01-30T08:10:09.879137+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:10:09.879137+0000","last_undegraded":"2024-01-30T08:10:09.879137+0000","last_fullsized":"2024-01-30T08:10:09.879137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875394+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:10:09.875394+0000","last_peered":"2024-01-30T08:10:09.875394+0000","last_clean":"2024-01-30T08:10:09.875394+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:10:09.875394+0000","last_undegraded":"2024-01-30T08:10:09.875394+0000","last_fullsized":"2024-01-30T08:10:09.875394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.895972+0000","last_change":"2024-01-30T08:09:53.881127+0000","last_active":"2024-01-30T08:10:11.895972+0000","last_peered":"2024-01-30T08:10:11.895972+0000","last_clean":"2024-01-30T08:10:11.895972+0000","last_became_active":"2024-01-30T08:09:53.880821+0000","last_became_peered":"2024-01-30T08:09:53.880821+0000","last_unstale":"2024-01-30T08:10:11.895972+0000","last_undegraded":"2024-01-30T08:10:11.895972+0000","last_fullsized":"2024-01-30T08:10:11.895972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:34:00.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925958+0000","last_change":"2024-01-30T08:10:11.916154+0000","last_active":"2024-01-30T08:10:11.925958+0000","last_peered":"2024-01-30T08:10:11.925958+0000","last_clean":"2024-01-30T08:10:11.925958+0000","last_became_active":"2024-01-30T08:10:11.915888+0000","last_became_peered":"2024-01-30T08:10:11.915888+0000","last_unstale":"2024-01-30T08:10:11.925958+0000","last_undegraded":"2024-01-30T08:10:11.925958+0000","last_fullsized":"2024-01-30T08:10:11.925958+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:07:31.431470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875212+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:10:09.875212+0000","last_peered":"2024-01-30T08:10:09.875212+0000","last_clean":"2024-01-30T08:10:09.875212+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:10:09.875212+0000","last_undegraded":"2024-01-30T08:10:09.875212+0000","last_fullsized":"2024-01-30T08:10:09.875212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875028+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:10:09.875028+0000","last_peered":"2024-01-30T08:10:09.875028+0000","last_clean":"2024-01-30T08:10:09.875028+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:10:09.875028+0000","last_undegraded":"2024-01-30T08:10:09.875028+0000","last_fullsized":"2024-01-30T08:10:09.875028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917333+0000","last_change":"2024-01-30T08:10:11.910891+0000","last_active":"2024-01-30T08:10:11.917333+0000","last_peered":"2024-01-30T08:10:11.917333+0000","last_clean":"2024-01-30T08:10:11.917333+0000","last_became_active":"2024-01-30T08:10:11.910551+0000","last_became_peered":"2024-01-30T08:10:11.910551+0000","last_unstale":"2024-01-30T08:10:11.917333+0000","last_undegraded":"2024-01-30T08:10:11.917333+0000","last_fullsized":"2024-01-30T08:10:11.917333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:48:29.533666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883437+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:10:09.883437+0000","last_peered":"2024-01-30T08:10:09.883437+0000","last_clean":"2024-01-30T08:10:09.883437+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:10:09.883437+0000","last_undegraded":"2024-01-30T08:10:09.883437+0000","last_fullsized":"2024-01-30T08:10:09.883437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878428+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:10:09.878428+0000","last_peered":"2024-01-30T08:10:09.878428+0000","last_clean":"2024-01-30T08:10:09.878428+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:10:09.878428+0000","last_undegraded":"2024-01-30T08:10:09.878428+0000","last_fullsized":"2024-01-30T08:10:09.878428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877696+0000","last_change":"2024-01-30T08:10:09.877696+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877696+0000","last_undegraded":"2024-01-30T08:10:09.877696+0000","last_fullsized":"2024-01-30T08:10:09.877696+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884837+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:10:09.884837+0000","last_peered":"2024-01-30T08:10:09.884837+0000","last_clean":"2024-01-30T08:10:09.884837+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:10:09.884837+0000","last_undegraded":"2024-01-30T08:10:09.884837+0000","last_fullsized":"2024-01-30T08:10:09.884837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875612+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:10:09.875612+0000","last_peered":"2024-01-30T08:10:09.875612+0000","last_clean":"2024-01-30T08:10:09.875612+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:10:09.875612+0000","last_undegraded":"2024-01-30T08:10:09.875612+0000","last_fullsized":"2024-01-30T08:10:09.875612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.926426+0000","last_change":"2024-01-30T08:10:10.907010+0000","last_active":"2024-01-30T08:10:11.926426+0000","last_peered":"2024-01-30T08:10:11.926426+0000","last_clean":"2024-01-30T08:10:11.926426+0000","last_became_active":"2024-01-30T08:10:10.906670+0000","last_became_peered":"2024-01-30T08:10:10.906670+0000","last_unstale":"2024-01-30T08:10:11.926426+0000","last_undegraded":"2024-01-30T08:10:11.926426+0000","last_fullsized":"2024-01-30T08:10:11.926426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:26.246384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879198+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:10:09.879198+0000","last_peered":"2024-01-30T08:10:09.879198+0000","last_clean":"2024-01-30T08:10:09.879198+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:10:09.879198+0000","last_undegraded":"2024-01-30T08:10:09.879198+0000","last_fullsized":"2024-01-30T08:10:09.879198+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905509+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:10:11.905509+0000","last_peered":"2024-01-30T08:10:11.905509+0000","last_clean":"2024-01-30T08:10:11.905509+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:10:11.905509+0000","last_undegraded":"2024-01-30T08:10:11.905509+0000","last_fullsized":"2024-01-30T08:10:11.905509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874376+0000","last_change":"2024-01-30T08:10:09.874376+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874376+0000","last_undegraded":"2024-01-30T08:10:09.874376+0000","last_fullsized":"2024-01-30T08:10:09.874376+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877175+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:10:09.877175+0000","last_peered":"2024-01-30T08:10:09.877175+0000","last_clean":"2024-01-30T08:10:09.877175+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:10:09.877175+0000","last_undegraded":"2024-01-30T08:10:09.877175+0000","last_fullsized":"2024-01-30T08:10:09.877175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879337+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:10:09.879337+0000","last_peered":"2024-01-30T08:10:09.879337+0000","last_clean":"2024-01-30T08:10:09.879337+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:10:09.879337+0000","last_undegraded":"2024-01-30T08:10:09.879337+0000","last_fullsized":"2024-01-30T08:10:09.879337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929867+0000","last_change":"2024-01-30T08:10:11.928520+0000","last_active":"2024-01-30T08:10:11.929867+0000","last_peered":"2024-01-30T08:10:11.929867+0000","last_clean":"2024-01-30T08:10:11.929867+0000","last_became_active":"2024-01-30T08:10:11.927399+0000","last_became_peered":"2024-01-30T08:10:11.927399+0000","last_unstale":"2024-01-30T08:10:11.929867+0000","last_undegraded":"2024-01-30T08:10:11.929867+0000","last_fullsized":"2024-01-30T08:10:11.929867+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.878291+0000","last_change":"2024-01-30T08:10:09.878291+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.878291+0000","last_undegraded":"2024-01-30T08:10:09.878291+0000","last_fullsized":"2024-01-30T08:10:09.878291+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873259+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:10:09.873259+0000","last_peered":"2024-01-30T08:10:09.873259+0000","last_clean":"2024-01-30T08:10:09.873259+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:10:09.873259+0000","last_undegraded":"2024-01-30T08:10:09.873259+0000","last_fullsized":"2024-01-30T08:10:09.873259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876778+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:10:09.876778+0000","last_peered":"2024-01-30T08:10:09.876778+0000","last_clean":"2024-01-30T08:10:09.876778+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:10:09.876778+0000","last_undegraded":"2024-01-30T08:10:09.876778+0000","last_fullsized":"2024-01-30T08:10:09.876778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873017+0000","last_change":"2024-01-30T08:10:09.873017+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873017+0000","last_undegraded":"2024-01-30T08:10:09.873017+0000","last_fullsized":"2024-01-30T08:10:09.873017+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901991+0000","last_change":"2024-01-30T08:09:53.881438+0000","last_active":"2024-01-30T08:10:11.901991+0000","last_peered":"2024-01-30T08:10:11.901991+0000","last_clean":"2024-01-30T08:10:11.901991+0000","last_became_active":"2024-01-30T08:09:53.881166+0000","last_became_peered":"2024-01-30T08:09:53.881166+0000","last_unstale":"2024-01-30T08:10:11.901991+0000","last_undegraded":"2024-01-30T08:10:11.901991+0000","last_fullsized":"2024-01-30T08:10:11.901991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:37.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893536+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:10:11.893536+0000","last_peered":"2024-01-30T08:10:11.893536+0000","last_clean":"2024-01-30T08:10:11.893536+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:10:11.893536+0000","last_undegraded":"2024-01-30T08:10:11.893536+0000","last_fullsized":"2024-01-30T08:10:11.893536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:43.172388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902051+0000","last_change":"2024-01-30T08:10:10.905030+0000","last_active":"2024-01-30T08:10:11.902051+0000","last_peered":"2024-01-30T08:10:11.902051+0000","last_clean":"2024-01-30T08:10:11.902051+0000","last_became_active":"2024-01-30T08:10:10.901186+0000","last_became_peered":"2024-01-30T08:10:10.901186+0000","last_unstale":"2024-01-30T08:10:11.902051+0000","last_undegraded":"2024-01-30T08:10:11.902051+0000","last_fullsized":"2024-01-30T08:10:11.902051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:30.092942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.894010+0000","last_change":"2024-01-30T08:09:53.881466+0000","last_active":"2024-01-30T08:10:11.894010+0000","last_peered":"2024-01-30T08:10:11.894010+0000","last_clean":"2024-01-30T08:10:11.894010+0000","last_became_active":"2024-01-30T08:09:53.880847+0000","last_became_peered":"2024-01-30T08:09:53.880847+0000","last_unstale":"2024-01-30T08:10:11.894010+0000","last_undegraded":"2024-01-30T08:10:11.894010+0000","last_fullsized":"2024-01-30T08:10:11.894010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:24:30.424249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883933+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:10:09.883933+0000","last_peered":"2024-01-30T08:10:09.883933+0000","last_clean":"2024-01-30T08:10:09.883933+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:10:09.883933+0000","last_undegraded":"2024-01-30T08:10:09.883933+0000","last_fullsized":"2024-01-30T08:10:09.883933+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.938380+0000","last_change":"2024-01-30T08:10:10.903517+0000","last_active":"2024-01-30T08:10:11.938380+0000","last_peered":"2024-01-30T08:10:11.938380+0000","last_clean":"2024-01-30T08:10:11.938380+0000","last_became_active":"2024-01-30T08:10:10.903251+0000","last_became_peered":"2024-01-30T08:10:10.903251+0000","last_unstale":"2024-01-30T08:10:11.938380+0000","last_undegraded":"2024-01-30T08:10:11.938380+0000","last_fullsized":"2024-01-30T08:10:11.938380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:26.792702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876885+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:10:09.876885+0000","last_peered":"2024-01-30T08:10:09.876885+0000","last_clean":"2024-01-30T08:10:09.876885+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:10:09.876885+0000","last_undegraded":"2024-01-30T08:10:09.876885+0000","last_fullsized":"2024-01-30T08:10:09.876885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878586+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:10:09.878586+0000","last_peered":"2024-01-30T08:10:09.878586+0000","last_clean":"2024-01-30T08:10:09.878586+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:10:09.878586+0000","last_undegraded":"2024-01-30T08:10:09.878586+0000","last_fullsized":"2024-01-30T08:10:09.878586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873024+0000","last_change":"2024-01-30T08:10:09.873024+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873024+0000","last_undegraded":"2024-01-30T08:10:09.873024+0000","last_fullsized":"2024-01-30T08:10:09.873024+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873366+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:10:09.873366+0000","last_peered":"2024-01-30T08:10:09.873366+0000","last_clean":"2024-01-30T08:10:09.873366+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:10:09.873366+0000","last_undegraded":"2024-01-30T08:10:09.873366+0000","last_fullsized":"2024-01-30T08:10:09.873366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874049+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:10:09.874049+0000","last_peered":"2024-01-30T08:10:09.874049+0000","last_clean":"2024-01-30T08:10:09.874049+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:10:09.874049+0000","last_undegraded":"2024-01-30T08:10:09.874049+0000","last_fullsized":"2024-01-30T08:10:09.874049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914866+0000","last_change":"2024-01-30T08:10:11.909037+0000","last_active":"2024-01-30T08:10:11.914866+0000","last_peered":"2024-01-30T08:10:11.914866+0000","last_clean":"2024-01-30T08:10:11.914866+0000","last_became_active":"2024-01-30T08:10:11.908779+0000","last_became_peered":"2024-01-30T08:10:11.908779+0000","last_unstale":"2024-01-30T08:10:11.914866+0000","last_undegraded":"2024-01-30T08:10:11.914866+0000","last_fullsized":"2024-01-30T08:10:11.914866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:09.368965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.882394+0000","last_change":"2024-01-30T08:10:09.882394+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.882394+0000","last_undegraded":"2024-01-30T08:10:09.882394+0000","last_fullsized":"2024-01-30T08:10:09.882394+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877623+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:10:09.877623+0000","last_peered":"2024-01-30T08:10:09.877623+0000","last_clean":"2024-01-30T08:10:09.877623+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:10:09.877623+0000","last_undegraded":"2024-01-30T08:10:09.877623+0000","last_fullsized":"2024-01-30T08:10:09.877623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:23.401989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873363+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:10:09.873363+0000","last_peered":"2024-01-30T08:10:09.873363+0000","last_clean":"2024-01-30T08:10:09.873363+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:10:09.873363+0000","last_undegraded":"2024-01-30T08:10:09.873363+0000","last_fullsized":"2024-01-30T08:10:09.873363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874771+0000","last_change":"2024-01-30T08:10:09.874771+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874771+0000","last_undegraded":"2024-01-30T08:10:09.874771+0000","last_fullsized":"2024-01-30T08:10:09.874771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882655+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:10:09.882655+0000","last_peered":"2024-01-30T08:10:09.882655+0000","last_clean":"2024-01-30T08:10:09.882655+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:10:09.882655+0000","last_undegraded":"2024-01-30T08:10:09.882655+0000","last_fullsized":"2024-01-30T08:10:09.882655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:00:52.172429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896891+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:10:11.896891+0000","last_peered":"2024-01-30T08:10:11.896891+0000","last_clean":"2024-01-30T08:10:11.896891+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:10:11.896891+0000","last_undegraded":"2024-01-30T08:10:11.896891+0000","last_fullsized":"2024-01-30T08:10:11.896891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:37.710856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881839+0000","last_change":"2024-01-30T08:10:09.881839+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881839+0000","last_undegraded":"2024-01-30T08:10:09.881839+0000","last_fullsized":"2024-01-30T08:10:09.881839+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905233+0000","last_change":"2024-01-30T08:09:53.883329+0000","last_active":"2024-01-30T08:10:11.905233+0000","last_peered":"2024-01-30T08:10:11.905233+0000","last_clean":"2024-01-30T08:10:11.905233+0000","last_became_active":"2024-01-30T08:09:53.881025+0000","last_became_peered":"2024-01-30T08:09:53.881025+0000","last_unstale":"2024-01-30T08:10:11.905233+0000","last_undegraded":"2024-01-30T08:10:11.905233+0000","last_fullsized":"2024-01-30T08:10:11.905233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:38.717964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896458+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:10:11.896458+0000","last_peered":"2024-01-30T08:10:11.896458+0000","last_clean":"2024-01-30T08:10:11.896458+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:10:11.896458+0000","last_undegraded":"2024-01-30T08:10:11.896458+0000","last_fullsized":"2024-01-30T08:10:11.896458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:51.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.920942+0000","last_change":"2024-01-30T08:10:11.914923+0000","last_active":"2024-01-30T08:10:11.920942+0000","last_peered":"2024-01-30T08:10:11.920942+0000","last_clean":"2024-01-30T08:10:11.920942+0000","last_became_active":"2024-01-30T08:10:11.914536+0000","last_became_peered":"2024-01-30T08:10:11.914536+0000","last_unstale":"2024-01-30T08:10:11.920942+0000","last_undegraded":"2024-01-30T08:10:11.920942+0000","last_fullsized":"2024-01-30T08:10:11.920942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873057+0000","last_change":"2024-01-30T08:10:09.873057+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873057+0000","last_undegraded":"2024-01-30T08:10:09.873057+0000","last_fullsized":"2024-01-30T08:10:09.873057+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875678+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:10:09.875678+0000","last_peered":"2024-01-30T08:10:09.875678+0000","last_clean":"2024-01-30T08:10:09.875678+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:10:09.875678+0000","last_undegraded":"2024-01-30T08:10:09.875678+0000","last_fullsized":"2024-01-30T08:10:09.875678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873288+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:10:09.873288+0000","last_peered":"2024-01-30T08:10:09.873288+0000","last_clean":"2024-01-30T08:10:09.873288+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:10:09.873288+0000","last_undegraded":"2024-01-30T08:10:09.873288+0000","last_fullsized":"2024-01-30T08:10:09.873288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881276+0000","last_change":"2024-01-30T08:10:09.881276+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881276+0000","last_undegraded":"2024-01-30T08:10:09.881276+0000","last_fullsized":"2024-01-30T08:10:09.881276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902146+0000","last_change":"2024-01-30T08:09:53.889988+0000","last_active":"2024-01-30T08:10:11.902146+0000","last_peered":"2024-01-30T08:10:11.902146+0000","last_clean":"2024-01-30T08:10:11.902146+0000","last_became_active":"2024-01-30T08:09:53.888579+0000","last_became_peered":"2024-01-30T08:09:53.888579+0000","last_unstale":"2024-01-30T08:10:11.902146+0000","last_undegraded":"2024-01-30T08:10:11.902146+0000","last_fullsized":"2024-01-30T08:10:11.902146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:01:50.624934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873359+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:10:09.873359+0000","last_peered":"2024-01-30T08:10:09.873359+0000","last_clean":"2024-01-30T08:10:09.873359+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:10:09.873359+0000","last_undegraded":"2024-01-30T08:10:09.873359+0000","last_fullsized":"2024-01-30T08:10:09.873359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917315+0000","last_change":"2024-01-30T08:10:11.910494+0000","last_active":"2024-01-30T08:10:11.917315+0000","last_peered":"2024-01-30T08:10:11.917315+0000","last_clean":"2024-01-30T08:10:11.917315+0000","last_became_active":"2024-01-30T08:10:11.910244+0000","last_became_peered":"2024-01-30T08:10:11.910244+0000","last_unstale":"2024-01-30T08:10:11.917315+0000","last_undegraded":"2024-01-30T08:10:11.917315+0000","last_fullsized":"2024-01-30T08:10:11.917315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:10:01.141484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874758+0000","last_change":"2024-01-30T08:10:09.874758+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874758+0000","last_undegraded":"2024-01-30T08:10:09.874758+0000","last_fullsized":"2024-01-30T08:10:09.874758+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873030+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:10:09.873030+0000","last_peered":"2024-01-30T08:10:09.873030+0000","last_clean":"2024-01-30T08:10:09.873030+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:10:09.873030+0000","last_undegraded":"2024-01-30T08:10:09.873030+0000","last_fullsized":"2024-01-30T08:10:09.873030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878696+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:10:09.878696+0000","last_peered":"2024-01-30T08:10:09.878696+0000","last_clean":"2024-01-30T08:10:09.878696+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:10:09.878696+0000","last_undegraded":"2024-01-30T08:10:09.878696+0000","last_fullsized":"2024-01-30T08:10:09.878696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.928340+0000","last_change":"2024-01-30T08:10:11.926413+0000","last_active":"2024-01-30T08:10:11.928340+0000","last_peered":"2024-01-30T08:10:11.928340+0000","last_clean":"2024-01-30T08:10:11.928340+0000","last_became_active":"2024-01-30T08:10:11.926117+0000","last_became_peered":"2024-01-30T08:10:11.926117+0000","last_unstale":"2024-01-30T08:10:11.928340+0000","last_undegraded":"2024-01-30T08:10:11.928340+0000","last_fullsized":"2024-01-30T08:10:11.928340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.935402+0000","last_change":"2024-01-30T08:10:10.908780+0000","last_active":"2024-01-30T08:10:11.935402+0000","last_peered":"2024-01-30T08:10:11.935402+0000","last_clean":"2024-01-30T08:10:11.935402+0000","last_became_active":"2024-01-30T08:10:10.907095+0000","last_became_peered":"2024-01-30T08:10:10.907095+0000","last_unstale":"2024-01-30T08:10:11.935402+0000","last_undegraded":"2024-01-30T08:10:11.935402+0000","last_fullsized":"2024-01-30T08:10:11.935402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:58.832681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883795+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:10:09.883795+0000","last_peered":"2024-01-30T08:10:09.883795+0000","last_clean":"2024-01-30T08:10:09.883795+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:10:09.883795+0000","last_undegraded":"2024-01-30T08:10:09.883795+0000","last_fullsized":"2024-01-30T08:10:09.883795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874854+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:10:09.874854+0000","last_peered":"2024-01-30T08:10:09.874854+0000","last_clean":"2024-01-30T08:10:09.874854+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:10:09.874854+0000","last_undegraded":"2024-01-30T08:10:09.874854+0000","last_fullsized":"2024-01-30T08:10:09.874854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930107+0000","last_change":"2024-01-30T08:10:11.919713+0000","last_active":"2024-01-30T08:10:11.930107+0000","last_peered":"2024-01-30T08:10:11.930107+0000","last_clean":"2024-01-30T08:10:11.930107+0000","last_became_active":"2024-01-30T08:10:11.919423+0000","last_became_peered":"2024-01-30T08:10:11.919423+0000","last_unstale":"2024-01-30T08:10:11.930107+0000","last_undegraded":"2024-01-30T08:10:11.930107+0000","last_fullsized":"2024-01-30T08:10:11.930107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873059+0000","last_change":"2024-01-30T08:10:09.873059+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873059+0000","last_undegraded":"2024-01-30T08:10:09.873059+0000","last_fullsized":"2024-01-30T08:10:09.873059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873018+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:10:09.873018+0000","last_peered":"2024-01-30T08:10:09.873018+0000","last_clean":"2024-01-30T08:10:09.873018+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:10:09.873018+0000","last_undegraded":"2024-01-30T08:10:09.873018+0000","last_fullsized":"2024-01-30T08:10:09.873018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":24,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883006+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:10:09.883006+0000","last_peered":"2024-01-30T08:10:09.883006+0000","last_clean":"2024-01-30T08:10:09.883006+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:10:09.883006+0000","last_undegraded":"2024-01-30T08:10:09.883006+0000","last_fullsized":"2024-01-30T08:10:09.883006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873701+0000","last_change":"2024-01-30T08:10:09.873701+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873701+0000","last_undegraded":"2024-01-30T08:10:09.873701+0000","last_fullsized":"2024-01-30T08:10:09.873701+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873080+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:10:09.873080+0000","last_peered":"2024-01-30T08:10:09.873080+0000","last_clean":"2024-01-30T08:10:09.873080+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:10:09.873080+0000","last_undegraded":"2024-01-30T08:10:09.873080+0000","last_fullsized":"2024-01-30T08:10:09.873080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897197+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:10:11.897197+0000","last_peered":"2024-01-30T08:10:11.897197+0000","last_clean":"2024-01-30T08:10:11.897197+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:10:11.897197+0000","last_undegraded":"2024-01-30T08:10:11.897197+0000","last_fullsized":"2024-01-30T08:10:11.897197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:36.960284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873089+0000","last_change":"2024-01-30T08:10:09.873089+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873089+0000","last_undegraded":"2024-01-30T08:10:09.873089+0000","last_fullsized":"2024-01-30T08:10:09.873089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896361+0000","last_change":"2024-01-30T08:09:53.883122+0000","last_active":"2024-01-30T08:10:11.896361+0000","last_peered":"2024-01-30T08:10:11.896361+0000","last_clean":"2024-01-30T08:10:11.896361+0000","last_became_active":"2024-01-30T08:09:53.882631+0000","last_became_peered":"2024-01-30T08:09:53.882631+0000","last_unstale":"2024-01-30T08:10:11.896361+0000","last_undegraded":"2024-01-30T08:10:11.896361+0000","last_fullsized":"2024-01-30T08:10:11.896361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:41.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877245+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:10:09.877245+0000","last_peered":"2024-01-30T08:10:09.877245+0000","last_clean":"2024-01-30T08:10:09.877245+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:10:09.877245+0000","last_undegraded":"2024-01-30T08:10:09.877245+0000","last_fullsized":"2024-01-30T08:10:09.877245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.936401+0000","last_change":"2024-01-30T08:10:10.912271+0000","last_active":"2024-01-30T08:10:11.936401+0000","last_peered":"2024-01-30T08:10:11.936401+0000","last_clean":"2024-01-30T08:10:11.936401+0000","last_became_active":"2024-01-30T08:10:10.911787+0000","last_became_peered":"2024-01-30T08:10:10.911787+0000","last_unstale":"2024-01-30T08:10:11.936401+0000","last_undegraded":"2024-01-30T08:10:11.936401+0000","last_fullsized":"2024-01-30T08:10:11.936401+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:41:52.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877087+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:10:09.877087+0000","last_peered":"2024-01-30T08:10:09.877087+0000","last_clean":"2024-01-30T08:10:09.877087+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:10:09.877087+0000","last_undegraded":"2024-01-30T08:10:09.877087+0000","last_fullsized":"2024-01-30T08:10:09.877087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879701+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:10:09.879701+0000","last_peered":"2024-01-30T08:10:09.879701+0000","last_clean":"2024-01-30T08:10:09.879701+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:10:09.879701+0000","last_undegraded":"2024-01-30T08:10:09.879701+0000","last_fullsized":"2024-01-30T08:10:09.879701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.879403+0000","last_change":"2024-01-30T08:10:09.879403+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.879403+0000","last_undegraded":"2024-01-30T08:10:09.879403+0000","last_fullsized":"2024-01-30T08:10:09.879403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879866+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:10:09.879866+0000","last_peered":"2024-01-30T08:10:09.879866+0000","last_clean":"2024-01-30T08:10:09.879866+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:10:09.879866+0000","last_undegraded":"2024-01-30T08:10:09.879866+0000","last_fullsized":"2024-01-30T08:10:09.879866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878949+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:10:09.878949+0000","last_peered":"2024-01-30T08:10:09.878949+0000","last_clean":"2024-01-30T08:10:09.878949+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:10:09.878949+0000","last_undegraded":"2024-01-30T08:10:09.878949+0000","last_fullsized":"2024-01-30T08:10:09.878949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.916984+0000","last_change":"2024-01-30T08:10:11.912714+0000","last_active":"2024-01-30T08:10:11.916984+0000","last_peered":"2024-01-30T08:10:11.916984+0000","last_clean":"2024-01-30T08:10:11.916984+0000","last_became_active":"2024-01-30T08:10:11.912428+0000","last_became_peered":"2024-01-30T08:10:11.912428+0000","last_unstale":"2024-01-30T08:10:11.916984+0000","last_undegraded":"2024-01-30T08:10:11.916984+0000","last_fullsized":"2024-01-30T08:10:11.916984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:37:00.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902543+0000","last_change":"2024-01-30T08:10:10.906011+0000","last_active":"2024-01-30T08:10:11.902543+0000","last_peered":"2024-01-30T08:10:11.902543+0000","last_clean":"2024-01-30T08:10:11.902543+0000","last_became_active":"2024-01-30T08:10:10.905777+0000","last_became_peered":"2024-01-30T08:10:10.905777+0000","last_unstale":"2024-01-30T08:10:11.902543+0000","last_undegraded":"2024-01-30T08:10:11.902543+0000","last_fullsized":"2024-01-30T08:10:11.902543+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:57.576769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883048+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:10:09.883048+0000","last_peered":"2024-01-30T08:10:09.883048+0000","last_clean":"2024-01-30T08:10:09.883048+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:10:09.883048+0000","last_undegraded":"2024-01-30T08:10:09.883048+0000","last_fullsized":"2024-01-30T08:10:09.883048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:13:20.247550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878832+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:10:09.878832+0000","last_peered":"2024-01-30T08:10:09.878832+0000","last_clean":"2024-01-30T08:10:09.878832+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:10:09.878832+0000","last_undegraded":"2024-01-30T08:10:09.878832+0000","last_fullsized":"2024-01-30T08:10:09.878832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877896+0000","last_change":"2024-01-30T08:10:09.877896+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877896+0000","last_undegraded":"2024-01-30T08:10:09.877896+0000","last_fullsized":"2024-01-30T08:10:09.877896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902434+0000","last_change":"2024-01-30T08:09:53.883346+0000","last_active":"2024-01-30T08:10:11.902434+0000","last_peered":"2024-01-30T08:10:11.902434+0000","last_clean":"2024-01-30T08:10:11.902434+0000","last_became_active":"2024-01-30T08:09:53.878878+0000","last_became_peered":"2024-01-30T08:09:53.878878+0000","last_unstale":"2024-01-30T08:10:11.902434+0000","last_undegraded":"2024-01-30T08:10:11.902434+0000","last_fullsized":"2024-01-30T08:10:11.902434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:52.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878361+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:10:09.878361+0000","last_peered":"2024-01-30T08:10:09.878361+0000","last_clean":"2024-01-30T08:10:09.878361+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:10:09.878361+0000","last_undegraded":"2024-01-30T08:10:09.878361+0000","last_fullsized":"2024-01-30T08:10:09.878361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925762+0000","last_change":"2024-01-30T08:10:11.913825+0000","last_active":"2024-01-30T08:10:11.925762+0000","last_peered":"2024-01-30T08:10:11.925762+0000","last_clean":"2024-01-30T08:10:11.925762+0000","last_became_active":"2024-01-30T08:10:11.913570+0000","last_became_peered":"2024-01-30T08:10:11.913570+0000","last_unstale":"2024-01-30T08:10:11.925762+0000","last_undegraded":"2024-01-30T08:10:11.925762+0000","last_fullsized":"2024-01-30T08:10:11.925762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877813+0000","last_change":"2024-01-30T08:10:09.877813+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877813+0000","last_undegraded":"2024-01-30T08:10:09.877813+0000","last_fullsized":"2024-01-30T08:10:09.877813+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893380+0000","last_change":"2024-01-30T08:09:53.886717+0000","last_active":"2024-01-30T08:10:11.893380+0000","last_peered":"2024-01-30T08:10:11.893380+0000","last_clean":"2024-01-30T08:10:11.893380+0000","last_became_active":"2024-01-30T08:09:53.884242+0000","last_became_peered":"2024-01-30T08:09:53.884242+0000","last_unstale":"2024-01-30T08:10:11.893380+0000","last_undegraded":"2024-01-30T08:10:11.893380+0000","last_fullsized":"2024-01-30T08:10:11.893380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:05.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883561+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:10:09.883561+0000","last_peered":"2024-01-30T08:10:09.883561+0000","last_clean":"2024-01-30T08:10:09.883561+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:10:09.883561+0000","last_undegraded":"2024-01-30T08:10:09.883561+0000","last_fullsized":"2024-01-30T08:10:09.883561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874726+0000","last_change":"2024-01-30T08:10:09.874726+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874726+0000","last_undegraded":"2024-01-30T08:10:09.874726+0000","last_fullsized":"2024-01-30T08:10:09.874726+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873145+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:10:09.873145+0000","last_peered":"2024-01-30T08:10:09.873145+0000","last_clean":"2024-01-30T08:10:09.873145+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:10:09.873145+0000","last_undegraded":"2024-01-30T08:10:09.873145+0000","last_fullsized":"2024-01-30T08:10:09.873145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878523+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:10:09.878523+0000","last_peered":"2024-01-30T08:10:09.878523+0000","last_clean":"2024-01-30T08:10:09.878523+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:10:09.878523+0000","last_undegraded":"2024-01-30T08:10:09.878523+0000","last_fullsized":"2024-01-30T08:10:09.878523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881311+0000","last_change":"2024-01-30T08:10:09.881311+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881311+0000","last_undegraded":"2024-01-30T08:10:09.881311+0000","last_fullsized":"2024-01-30T08:10:09.881311+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878852+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:10:09.878852+0000","last_peered":"2024-01-30T08:10:09.878852+0000","last_clean":"2024-01-30T08:10:09.878852+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:10:09.878852+0000","last_undegraded":"2024-01-30T08:10:09.878852+0000","last_fullsized":"2024-01-30T08:10:09.878852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897331+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:10:11.897331+0000","last_peered":"2024-01-30T08:10:11.897331+0000","last_clean":"2024-01-30T08:10:11.897331+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:10:11.897331+0000","last_undegraded":"2024-01-30T08:10:11.897331+0000","last_fullsized":"2024-01-30T08:10:11.897331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:51.914756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902870+0000","last_change":"2024-01-30T08:10:10.901224+0000","last_active":"2024-01-30T08:10:11.902870+0000","last_peered":"2024-01-30T08:10:11.902870+0000","last_clean":"2024-01-30T08:10:11.902870+0000","last_became_active":"2024-01-30T08:10:10.900957+0000","last_became_peered":"2024-01-30T08:10:10.900957+0000","last_unstale":"2024-01-30T08:10:11.902870+0000","last_undegraded":"2024-01-30T08:10:11.902870+0000","last_fullsized":"2024-01-30T08:10:11.902870+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:23:17.774625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882806+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:10:09.882806+0000","last_peered":"2024-01-30T08:10:09.882806+0000","last_clean":"2024-01-30T08:10:09.882806+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:10:09.882806+0000","last_undegraded":"2024-01-30T08:10:09.882806+0000","last_fullsized":"2024-01-30T08:10:09.882806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879695+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:10:09.879695+0000","last_peered":"2024-01-30T08:10:09.879695+0000","last_clean":"2024-01-30T08:10:09.879695+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:10:09.879695+0000","last_undegraded":"2024-01-30T08:10:09.879695+0000","last_fullsized":"2024-01-30T08:10:09.879695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925721+0000","last_change":"2024-01-30T08:10:11.911523+0000","last_active":"2024-01-30T08:10:11.925721+0000","last_peered":"2024-01-30T08:10:11.925721+0000","last_clean":"2024-01-30T08:10:11.925721+0000","last_became_active":"2024-01-30T08:10:11.910812+0000","last_became_peered":"2024-01-30T08:10:11.910812+0000","last_unstale":"2024-01-30T08:10:11.925721+0000","last_undegraded":"2024-01-30T08:10:11.925721+0000","last_fullsized":"2024-01-30T08:10:11.925721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873933+0000","last_change":"2024-01-30T08:10:09.873933+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873933+0000","last_undegraded":"2024-01-30T08:10:09.873933+0000","last_fullsized":"2024-01-30T08:10:09.873933+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873147+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:10:09.873147+0000","last_peered":"2024-01-30T08:10:09.873147+0000","last_clean":"2024-01-30T08:10:09.873147+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:10:09.873147+0000","last_undegraded":"2024-01-30T08:10:09.873147+0000","last_fullsized":"2024-01-30T08:10:09.873147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903990+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:10:11.903990+0000","last_peered":"2024-01-30T08:10:11.903990+0000","last_clean":"2024-01-30T08:10:11.903990+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:10:11.903990+0000","last_undegraded":"2024-01-30T08:10:11.903990+0000","last_fullsized":"2024-01-30T08:10:11.903990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:30:27.351725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930162+0000","last_change":"2024-01-30T08:10:11.925753+0000","last_active":"2024-01-30T08:10:11.930162+0000","last_peered":"2024-01-30T08:10:11.930162+0000","last_clean":"2024-01-30T08:10:11.930162+0000","last_became_active":"2024-01-30T08:10:11.925478+0000","last_became_peered":"2024-01-30T08:10:11.925478+0000","last_unstale":"2024-01-30T08:10:11.930162+0000","last_undegraded":"2024-01-30T08:10:11.930162+0000","last_fullsized":"2024-01-30T08:10:11.930162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873033+0000","last_change":"2024-01-30T08:10:09.873033+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873033+0000","last_undegraded":"2024-01-30T08:10:09.873033+0000","last_fullsized":"2024-01-30T08:10:09.873033+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902254+0000","last_change":"2024-01-30T08:09:53.882768+0000","last_active":"2024-01-30T08:10:11.902254+0000","last_peered":"2024-01-30T08:10:11.902254+0000","last_clean":"2024-01-30T08:10:11.902254+0000","last_became_active":"2024-01-30T08:09:53.882430+0000","last_became_peered":"2024-01-30T08:09:53.882430+0000","last_unstale":"2024-01-30T08:10:11.902254+0000","last_undegraded":"2024-01-30T08:10:11.902254+0000","last_fullsized":"2024-01-30T08:10:11.902254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:58.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903223+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:10:11.903223+0000","last_peered":"2024-01-30T08:10:11.903223+0000","last_clean":"2024-01-30T08:10:11.903223+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:10:11.903223+0000","last_undegraded":"2024-01-30T08:10:11.903223+0000","last_fullsized":"2024-01-30T08:10:11.903223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901534+0000","last_change":"2024-01-30T08:10:10.902200+0000","last_active":"2024-01-30T08:10:11.901534+0000","last_peered":"2024-01-30T08:10:11.901534+0000","last_clean":"2024-01-30T08:10:11.901534+0000","last_became_active":"2024-01-30T08:10:10.901913+0000","last_became_peered":"2024-01-30T08:10:10.901913+0000","last_unstale":"2024-01-30T08:10:11.901534+0000","last_undegraded":"2024-01-30T08:10:11.901534+0000","last_fullsized":"2024-01-30T08:10:11.901534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:26.634238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877522+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:10:09.877522+0000","last_peered":"2024-01-30T08:10:09.877522+0000","last_clean":"2024-01-30T08:10:09.877522+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:10:09.877522+0000","last_undegraded":"2024-01-30T08:10:09.877522+0000","last_fullsized":"2024-01-30T08:10:09.877522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875134+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:10:09.875134+0000","last_peered":"2024-01-30T08:10:09.875134+0000","last_clean":"2024-01-30T08:10:09.875134+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:10:09.875134+0000","last_undegraded":"2024-01-30T08:10:09.875134+0000","last_fullsized":"2024-01-30T08:10:09.875134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.932589+0000","last_change":"2024-01-30T08:10:11.919869+0000","last_active":"2024-01-30T08:10:11.932589+0000","last_peered":"2024-01-30T08:10:11.932589+0000","last_clean":"2024-01-30T08:10:11.932589+0000","last_became_active":"2024-01-30T08:10:11.916750+0000","last_became_peered":"2024-01-30T08:10:11.916750+0000","last_unstale":"2024-01-30T08:10:11.932589+0000","last_undegraded":"2024-01-30T08:10:11.932589+0000","last_fullsized":"2024-01-30T08:10:11.932589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873952+0000","last_change":"2024-01-30T08:10:09.873952+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873952+0000","last_undegraded":"2024-01-30T08:10:09.873952+0000","last_fullsized":"2024-01-30T08:10:09.873952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876261+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:10:09.876261+0000","last_peered":"2024-01-30T08:10:09.876261+0000","last_clean":"2024-01-30T08:10:09.876261+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:10:09.876261+0000","last_undegraded":"2024-01-30T08:10:09.876261+0000","last_fullsized":"2024-01-30T08:10:09.876261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874883+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:10:09.874883+0000","last_peered":"2024-01-30T08:10:09.874883+0000","last_clean":"2024-01-30T08:10:09.874883+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:10:09.874883+0000","last_undegraded":"2024-01-30T08:10:09.874883+0000","last_fullsized":"2024-01-30T08:10:09.874883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929748+0000","last_change":"2024-01-30T08:10:11.927980+0000","last_active":"2024-01-30T08:10:11.929748+0000","last_peered":"2024-01-30T08:10:11.929748+0000","last_clean":"2024-01-30T08:10:11.929748+0000","last_became_active":"2024-01-30T08:10:11.927664+0000","last_became_peered":"2024-01-30T08:10:11.927664+0000","last_unstale":"2024-01-30T08:10:11.929748+0000","last_undegraded":"2024-01-30T08:10:11.929748+0000","last_fullsized":"2024-01-30T08:10:11.929748+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874006+0000","last_change":"2024-01-30T08:10:09.874006+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874006+0000","last_undegraded":"2024-01-30T08:10:09.874006+0000","last_fullsized":"2024-01-30T08:10:09.874006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.880736+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:10:09.880736+0000","last_peered":"2024-01-30T08:10:09.880736+0000","last_clean":"2024-01-30T08:10:09.880736+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:10:09.880736+0000","last_undegraded":"2024-01-30T08:10:09.880736+0000","last_fullsized":"2024-01-30T08:10:09.880736+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.872847+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:10:09.872847+0000","last_peered":"2024-01-30T08:10:09.872847+0000","last_clean":"2024-01-30T08:10:09.872847+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:10:09.872847+0000","last_undegraded":"2024-01-30T08:10:09.872847+0000","last_fullsized":"2024-01-30T08:10:09.872847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905453+0000","last_change":"2024-01-30T08:10:10.907159+0000","last_active":"2024-01-30T08:10:11.905453+0000","last_peered":"2024-01-30T08:10:11.905453+0000","last_clean":"2024-01-30T08:10:11.905453+0000","last_became_active":"2024-01-30T08:10:10.906711+0000","last_became_peered":"2024-01-30T08:10:10.906711+0000","last_unstale":"2024-01-30T08:10:11.905453+0000","last_undegraded":"2024-01-30T08:10:11.905453+0000","last_fullsized":"2024-01-30T08:10:11.905453+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:55:37.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897039+0000","last_change":"2024-01-30T08:09:53.893858+0000","last_active":"2024-01-30T08:10:11.897039+0000","last_peered":"2024-01-30T08:10:11.897039+0000","last_clean":"2024-01-30T08:10:11.897039+0000","last_became_active":"2024-01-30T08:09:53.893613+0000","last_became_peered":"2024-01-30T08:09:53.893613+0000","last_unstale":"2024-01-30T08:10:11.897039+0000","last_undegraded":"2024-01-30T08:10:11.897039+0000","last_fullsized":"2024-01-30T08:10:11.897039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:09.834509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884932+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:10:09.884932+0000","last_peered":"2024-01-30T08:10:09.884932+0000","last_clean":"2024-01-30T08:10:09.884932+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:10:09.884932+0000","last_undegraded":"2024-01-30T08:10:09.884932+0000","last_fullsized":"2024-01-30T08:10:09.884932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883122+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:09.883122+0000","last_peered":"2024-01-30T08:10:09.883122+0000","last_clean":"2024-01-30T08:10:09.883122+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:09.883122+0000","last_undegraded":"2024-01-30T08:10:09.883122+0000","last_fullsized":"2024-01-30T08:10:09.883122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":528384,"data_stored":785498,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.69699999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.436},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65600000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":192535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59199999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.747},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.73099999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":192557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.84999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":462848,"data_stored":195094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.502}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67900000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":199014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.373}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.497}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":192043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.318},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.39500000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.436},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.47399999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.629}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":214459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53500000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":804805,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.499}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.372}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.621}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:16.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:16.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.208+0000 7fe0a8c00640 1 Processor -- start 2024-01-30T08:10:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a8c00640 1 -- start start 2024-01-30T08:10:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a8c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0a40c4bb0 0x7fe0a4158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a4158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a8c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a4157c60 con 0x7fe0a4151d80 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a8c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a4152160 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c35f0 con 0x7fe0a40c64a0 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0a40c4bb0 0x7fe0a4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0a40c4bb0 0x7fe0a4158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49260/0 (socket says 172.21.15.50:49260) 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1400640 1 -- 172.21.15.50:0/1352951561 learned_addr learned my addr 172.21.15.50:0/1352951561 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1e00640 1 --1- 172.21.15.50:0/1352951561 >> v1:172.21.15.50:6789/0 conn(0x7fe0a4151d80 0x7fe0a40c0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53396/0 (socket says 172.21.15.50:53396) 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a2800640 1 --2- 172.21.15.50:0/1352951561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a4158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1400640 1 -- 172.21.15.50:0/1352951561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 msgr2=0x7fe0a4158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1400640 1 --2- 172.21.15.50:0/1352951561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a4158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1400640 1 -- 172.21.15.50:0/1352951561 >> v1:172.21.15.50:6789/0 conn(0x7fe0a4151d80 legacy=0x7fe0a40c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a0a00640 1 -- 172.21.15.50:0/1352951561 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602040135 0 0) 0x7fe0a4157c60 con 0x7fe0a4151d80 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a1400640 1 -- 172.21.15.50:0/1352951561 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40c6a30 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.212+0000 7fe0a2800640 1 --2- 172.21.15.50:0/1352951561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a4158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a1400640 1 --2- 172.21.15.50:0/1352951561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a4158140 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0098a0 tx=0x7fe08c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bc2c8db332fa00 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a0a00640 1 -- 172.21.15.50:0/1352951561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0aa650 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a0a00640 1 -- 172.21.15.50:0/1352951561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0aa7b0 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a0a00640 1 -- 172.21.15.50:0/1352951561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0aab40 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1352951561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 msgr2=0x7fe0a4158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1352951561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a4158140 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0098a0 tx=0x7fe08c01c4f0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1352951561 shutdown_connections 2024-01-30T08:10:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1352951561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a4158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1352951561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a4158140 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1352951561 >> 172.21.15.50:0/1352951561 conn(0x7fe0a40a9590 msgr2=0x7fe0a40c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1352951561 shutdown_connections 2024-01-30T08:10:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1352951561 wait complete. 2024-01-30T08:10:16.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 Processor -- start 2024-01-30T08:10:16.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.216+0000 7fe0a8c00640 1 -- start start 2024-01-30T08:10:16.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a415de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0a4151d80 0x7fe0a414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a406dfb0 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4154e50 con 0x7fe0a4151d80 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41f0d30 con 0x7fe0a40c64a0 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49266/0 (socket says 172.21.15.50:49266) 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 -- 172.21.15.50:0/1877847538 learned_addr learned my addr 172.21.15.50:0/1877847538 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1400640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a2800640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0a4151d80 0x7fe0a414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 -- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 msgr2=0x7fe0a414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 -- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0a4151d80 msgr2=0x7fe0a414f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0a4151d80 0x7fe0a414f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 -- 172.21.15.50:0/1877847538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0094d0 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a1e00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a415de00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c4b0 tx=0x7fe09400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe09a000640 1 -- 172.21.15.50:0/1877847538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940074e0 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe09a000640 1 -- 172.21.15.50:0/1877847538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094007660 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe09a000640 1 -- 172.21.15.50:0/1877847538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094004a30 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a41f1010 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a406dc40 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.220+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a4074a20 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.224+0000 7fe09a000640 1 -- 172.21.15.50:0/1877847538 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe094004b90 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.224+0000 7fe09a000640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe07c066500 0x7fe07c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.224+0000 7fe09a000640 1 -- 172.21.15.50:0/1877847538 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe094083430 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.224+0000 7fe0a1400640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe07c066500 0x7fe07c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.224+0000 7fe0a1400640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe07c066500 0x7fe07c0689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0ae000 tx=0x7fe08c0b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:16.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.228+0000 7fe09a000640 1 -- 172.21.15.50:0/1877847538 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe0940502d0 con 0x7fe0a40c4bb0 2024-01-30T08:10:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.380+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0a40c5b00 con 0x7fe07c066500 2024-01-30T08:10:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.396+0000 7fe09a000640 1 -- 172.21.15.50:0/1877847538 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+520017 (secure 0 0 0) 0x7fe0a40c5b00 con 0x7fe07c066500 2024-01-30T08:10:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe07c066500 msgr2=0x7fe07c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe07c066500 0x7fe07c0689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0ae000 tx=0x7fe08c0b5040 comp rx=0 tx=0).stop 2024-01-30T08:10:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 msgr2=0x7fe0a415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a415de00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c4b0 tx=0x7fe09400c970 comp rx=0 tx=0).stop 2024-01-30T08:10:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 shutdown_connections 2024-01-30T08:10:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0a4151d80 0x7fe0a414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe07c066500 0x7fe07c0689c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0a40c64a0 0x7fe0a414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 --2- 172.21.15.50:0/1877847538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0a40c4bb0 0x7fe0a415de00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 >> 172.21.15.50:0/1877847538 conn(0x7fe0a40a9590 msgr2=0x7fe0a40c1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:16.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 shutdown_connections 2024-01-30T08:10:16.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.400+0000 7fe0a8c00640 1 -- 172.21.15.50:0/1877847538 wait complete. 2024-01-30T08:10:16.425 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-01-30T08:10:15.072779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594329,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":302,"acting":302,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236596,"kb_used_data":3772,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738124,"statfs":{"total":773094113280,"available":772851838976,"internally_reserved":0,"allocated":3862528,"data_stored":2776005,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.202958"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873286+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:10:09.873286+0000","last_peered":"2024-01-30T08:10:09.873286+0000","last_clean":"2024-01-30T08:10:09.873286+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:10:09.873286+0000","last_undegraded":"2024-01-30T08:10:09.873286+0000","last_fullsized":"2024-01-30T08:10:09.873286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873025+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:10:09.873025+0000","last_peered":"2024-01-30T08:10:09.873025+0000","last_clean":"2024-01-30T08:10:09.873025+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:10:09.873025+0000","last_undegraded":"2024-01-30T08:10:09.873025+0000","last_fullsized":"2024-01-30T08:10:09.873025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903892+0000","last_change":"2024-01-30T08:09:53.888831+0000","last_active":"2024-01-30T08:10:11.903892+0000","last_peered":"2024-01-30T08:10:11.903892+0000","last_clean":"2024-01-30T08:10:11.903892+0000","last_became_active":"2024-01-30T08:09:53.888512+0000","last_became_peered":"2024-01-30T08:09:53.888512+0000","last_unstale":"2024-01-30T08:10:11.903892+0000","last_undegraded":"2024-01-30T08:10:11.903892+0000","last_fullsized":"2024-01-30T08:10:11.903892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:19.673462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929426+0000","last_change":"2024-01-30T08:10:11.925833+0000","last_active":"2024-01-30T08:10:11.929426+0000","last_peered":"2024-01-30T08:10:11.929426+0000","last_clean":"2024-01-30T08:10:11.929426+0000","last_became_active":"2024-01-30T08:10:11.925416+0000","last_became_peered":"2024-01-30T08:10:11.925416+0000","last_unstale":"2024-01-30T08:10:11.929426+0000","last_undegraded":"2024-01-30T08:10:11.929426+0000","last_fullsized":"2024-01-30T08:10:11.929426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877372+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:10:09.877372+0000","last_peered":"2024-01-30T08:10:09.877372+0000","last_clean":"2024-01-30T08:10:09.877372+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:10:09.877372+0000","last_undegraded":"2024-01-30T08:10:09.877372+0000","last_fullsized":"2024-01-30T08:10:09.877372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878738+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:10:09.878738+0000","last_peered":"2024-01-30T08:10:09.878738+0000","last_clean":"2024-01-30T08:10:09.878738+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:10:09.878738+0000","last_undegraded":"2024-01-30T08:10:09.878738+0000","last_fullsized":"2024-01-30T08:10:09.878738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:47.332748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878589+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:10:09.878589+0000","last_peered":"2024-01-30T08:10:09.878589+0000","last_clean":"2024-01-30T08:10:09.878589+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:10:09.878589+0000","last_undegraded":"2024-01-30T08:10:09.878589+0000","last_fullsized":"2024-01-30T08:10:09.878589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893805+0000","last_change":"2024-01-30T08:09:53.884011+0000","last_active":"2024-01-30T08:10:11.893805+0000","last_peered":"2024-01-30T08:10:11.893805+0000","last_clean":"2024-01-30T08:10:11.893805+0000","last_became_active":"2024-01-30T08:09:53.881881+0000","last_became_peered":"2024-01-30T08:09:53.881881+0000","last_unstale":"2024-01-30T08:10:11.893805+0000","last_undegraded":"2024-01-30T08:10:11.893805+0000","last_fullsized":"2024-01-30T08:10:11.893805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:04:50.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.872756+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:10:09.872756+0000","last_peered":"2024-01-30T08:10:09.872756+0000","last_clean":"2024-01-30T08:10:09.872756+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:10:09.872756+0000","last_undegraded":"2024-01-30T08:10:09.872756+0000","last_fullsized":"2024-01-30T08:10:09.872756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.931474+0000","last_change":"2024-01-30T08:10:11.929495+0000","last_active":"2024-01-30T08:10:11.931474+0000","last_peered":"2024-01-30T08:10:11.931474+0000","last_clean":"2024-01-30T08:10:11.931474+0000","last_became_active":"2024-01-30T08:10:11.928578+0000","last_became_peered":"2024-01-30T08:10:11.928578+0000","last_unstale":"2024-01-30T08:10:11.931474+0000","last_undegraded":"2024-01-30T08:10:11.931474+0000","last_fullsized":"2024-01-30T08:10:11.931474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905164+0000","last_change":"2024-01-30T08:09:53.887909+0000","last_active":"2024-01-30T08:10:11.905164+0000","last_peered":"2024-01-30T08:10:11.905164+0000","last_clean":"2024-01-30T08:10:11.905164+0000","last_became_active":"2024-01-30T08:09:53.887634+0000","last_became_peered":"2024-01-30T08:09:53.887634+0000","last_unstale":"2024-01-30T08:10:11.905164+0000","last_undegraded":"2024-01-30T08:10:11.905164+0000","last_fullsized":"2024-01-30T08:10:11.905164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:52.921864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896717+0000","last_change":"2024-01-30T08:09:53.883502+0000","last_active":"2024-01-30T08:10:11.896717+0000","last_peered":"2024-01-30T08:10:11.896717+0000","last_clean":"2024-01-30T08:10:11.896717+0000","last_became_active":"2024-01-30T08:09:53.883146+0000","last_became_peered":"2024-01-30T08:09:53.883146+0000","last_unstale":"2024-01-30T08:10:11.896717+0000","last_undegraded":"2024-01-30T08:10:11.896717+0000","last_fullsized":"2024-01-30T08:10:11.896717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:13.134749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896375+0000","last_change":"2024-01-30T08:09:53.883798+0000","last_active":"2024-01-30T08:10:11.896375+0000","last_peered":"2024-01-30T08:10:11.896375+0000","last_clean":"2024-01-30T08:10:11.896375+0000","last_became_active":"2024-01-30T08:09:53.883077+0000","last_became_peered":"2024-01-30T08:09:53.883077+0000","last_unstale":"2024-01-30T08:10:11.896375+0000","last_undegraded":"2024-01-30T08:10:11.896375+0000","last_fullsized":"2024-01-30T08:10:11.896375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:40.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903225+0000","last_change":"2024-01-30T08:09:53.880237+0000","last_active":"2024-01-30T08:10:11.903225+0000","last_peered":"2024-01-30T08:10:11.903225+0000","last_clean":"2024-01-30T08:10:11.903225+0000","last_became_active":"2024-01-30T08:09:53.879920+0000","last_became_peered":"2024-01-30T08:09:53.879920+0000","last_unstale":"2024-01-30T08:10:11.903225+0000","last_undegraded":"2024-01-30T08:10:11.903225+0000","last_fullsized":"2024-01-30T08:10:11.903225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:31:19.905033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930126+0000","last_change":"2024-01-30T08:10:11.928221+0000","last_active":"2024-01-30T08:10:11.930126+0000","last_peered":"2024-01-30T08:10:11.930126+0000","last_clean":"2024-01-30T08:10:11.930126+0000","last_became_active":"2024-01-30T08:10:11.924922+0000","last_became_peered":"2024-01-30T08:10:11.924922+0000","last_unstale":"2024-01-30T08:10:11.930126+0000","last_undegraded":"2024-01-30T08:10:11.930126+0000","last_fullsized":"2024-01-30T08:10:11.930126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893343+0000","last_change":"2024-01-30T08:09:53.879036+0000","last_active":"2024-01-30T08:10:11.893343+0000","last_peered":"2024-01-30T08:10:11.893343+0000","last_clean":"2024-01-30T08:10:11.893343+0000","last_became_active":"2024-01-30T08:09:53.878757+0000","last_became_peered":"2024-01-30T08:09:53.878757+0000","last_unstale":"2024-01-30T08:10:11.893343+0000","last_undegraded":"2024-01-30T08:10:11.893343+0000","last_fullsized":"2024-01-30T08:10:11.893343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:32:50.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876211+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:10:09.876211+0000","last_peered":"2024-01-30T08:10:09.876211+0000","last_clean":"2024-01-30T08:10:09.876211+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:10:09.876211+0000","last_undegraded":"2024-01-30T08:10:09.876211+0000","last_fullsized":"2024-01-30T08:10:09.876211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893908+0000","last_change":"2024-01-30T08:09:53.886393+0000","last_active":"2024-01-30T08:10:11.893908+0000","last_peered":"2024-01-30T08:10:11.893908+0000","last_clean":"2024-01-30T08:10:11.893908+0000","last_became_active":"2024-01-30T08:09:53.881749+0000","last_became_peered":"2024-01-30T08:09:53.881749+0000","last_unstale":"2024-01-30T08:10:11.893908+0000","last_undegraded":"2024-01-30T08:10:11.893908+0000","last_fullsized":"2024-01-30T08:10:11.893908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:22.523025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882884+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:10:09.882884+0000","last_peered":"2024-01-30T08:10:09.882884+0000","last_clean":"2024-01-30T08:10:09.882884+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:10:09.882884+0000","last_undegraded":"2024-01-30T08:10:09.882884+0000","last_fullsized":"2024-01-30T08:10:09.882884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.934707+0000","last_change":"2024-01-30T08:10:11.931335+0000","last_active":"2024-01-30T08:10:11.934707+0000","last_peered":"2024-01-30T08:10:11.934707+0000","last_clean":"2024-01-30T08:10:11.934707+0000","last_became_active":"2024-01-30T08:10:11.931065+0000","last_became_peered":"2024-01-30T08:10:11.931065+0000","last_unstale":"2024-01-30T08:10:11.934707+0000","last_undegraded":"2024-01-30T08:10:11.934707+0000","last_fullsized":"2024-01-30T08:10:11.934707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884985+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:10:09.884985+0000","last_peered":"2024-01-30T08:10:09.884985+0000","last_clean":"2024-01-30T08:10:09.884985+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:10:09.884985+0000","last_undegraded":"2024-01-30T08:10:09.884985+0000","last_fullsized":"2024-01-30T08:10:09.884985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925741+0000","last_change":"2024-01-30T08:10:11.911805+0000","last_active":"2024-01-30T08:10:11.925741+0000","last_peered":"2024-01-30T08:10:11.925741+0000","last_clean":"2024-01-30T08:10:11.925741+0000","last_became_active":"2024-01-30T08:10:11.911191+0000","last_became_peered":"2024-01-30T08:10:11.911191+0000","last_unstale":"2024-01-30T08:10:11.925741+0000","last_undegraded":"2024-01-30T08:10:11.925741+0000","last_fullsized":"2024-01-30T08:10:11.925741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875392+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:10:09.875392+0000","last_peered":"2024-01-30T08:10:09.875392+0000","last_clean":"2024-01-30T08:10:09.875392+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:10:09.875392+0000","last_undegraded":"2024-01-30T08:10:09.875392+0000","last_fullsized":"2024-01-30T08:10:09.875392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914789+0000","last_change":"2024-01-30T08:10:11.908732+0000","last_active":"2024-01-30T08:10:11.914789+0000","last_peered":"2024-01-30T08:10:11.914789+0000","last_clean":"2024-01-30T08:10:11.914789+0000","last_became_active":"2024-01-30T08:10:11.908460+0000","last_became_peered":"2024-01-30T08:10:11.908460+0000","last_unstale":"2024-01-30T08:10:11.914789+0000","last_undegraded":"2024-01-30T08:10:11.914789+0000","last_fullsized":"2024-01-30T08:10:11.914789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:57:12.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879678+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:10:09.879678+0000","last_peered":"2024-01-30T08:10:09.879678+0000","last_clean":"2024-01-30T08:10:09.879678+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:10:09.879678+0000","last_undegraded":"2024-01-30T08:10:09.879678+0000","last_fullsized":"2024-01-30T08:10:09.879678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875311+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:10:09.875311+0000","last_peered":"2024-01-30T08:10:09.875311+0000","last_clean":"2024-01-30T08:10:09.875311+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:10:09.875311+0000","last_undegraded":"2024-01-30T08:10:09.875311+0000","last_fullsized":"2024-01-30T08:10:09.875311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893439+0000","last_change":"2024-01-30T08:09:53.884047+0000","last_active":"2024-01-30T08:10:11.893439+0000","last_peered":"2024-01-30T08:10:11.893439+0000","last_clean":"2024-01-30T08:10:11.893439+0000","last_became_active":"2024-01-30T08:09:53.883765+0000","last_became_peered":"2024-01-30T08:09:53.883765+0000","last_unstale":"2024-01-30T08:10:11.893439+0000","last_undegraded":"2024-01-30T08:10:11.893439+0000","last_fullsized":"2024-01-30T08:10:11.893439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:54:01.174660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874229+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:10:09.874229+0000","last_peered":"2024-01-30T08:10:09.874229+0000","last_clean":"2024-01-30T08:10:09.874229+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:10:09.874229+0000","last_undegraded":"2024-01-30T08:10:09.874229+0000","last_fullsized":"2024-01-30T08:10:09.874229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924123+0000","last_change":"2024-01-30T08:10:11.917501+0000","last_active":"2024-01-30T08:10:11.924123+0000","last_peered":"2024-01-30T08:10:11.924123+0000","last_clean":"2024-01-30T08:10:11.924123+0000","last_became_active":"2024-01-30T08:10:11.917148+0000","last_became_peered":"2024-01-30T08:10:11.917148+0000","last_unstale":"2024-01-30T08:10:11.924123+0000","last_undegraded":"2024-01-30T08:10:11.924123+0000","last_fullsized":"2024-01-30T08:10:11.924123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:27.639415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883277+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:10:09.883277+0000","last_peered":"2024-01-30T08:10:09.883277+0000","last_clean":"2024-01-30T08:10:09.883277+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:10:09.883277+0000","last_undegraded":"2024-01-30T08:10:09.883277+0000","last_fullsized":"2024-01-30T08:10:09.883277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:00.220792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878429+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:10:09.878429+0000","last_peered":"2024-01-30T08:10:09.878429+0000","last_clean":"2024-01-30T08:10:09.878429+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:10:09.878429+0000","last_undegraded":"2024-01-30T08:10:09.878429+0000","last_fullsized":"2024-01-30T08:10:09.878429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:22.789462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875514+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:10:09.875514+0000","last_peered":"2024-01-30T08:10:09.875514+0000","last_clean":"2024-01-30T08:10:09.875514+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:10:09.875514+0000","last_undegraded":"2024-01-30T08:10:09.875514+0000","last_fullsized":"2024-01-30T08:10:09.875514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924583+0000","last_change":"2024-01-30T08:10:11.916385+0000","last_active":"2024-01-30T08:10:11.924583+0000","last_peered":"2024-01-30T08:10:11.924583+0000","last_clean":"2024-01-30T08:10:11.924583+0000","last_became_active":"2024-01-30T08:10:11.915981+0000","last_became_peered":"2024-01-30T08:10:11.915981+0000","last_unstale":"2024-01-30T08:10:11.924583+0000","last_undegraded":"2024-01-30T08:10:11.924583+0000","last_fullsized":"2024-01-30T08:10:11.924583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:27.251561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879137+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:10:09.879137+0000","last_peered":"2024-01-30T08:10:09.879137+0000","last_clean":"2024-01-30T08:10:09.879137+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:10:09.879137+0000","last_undegraded":"2024-01-30T08:10:09.879137+0000","last_fullsized":"2024-01-30T08:10:09.879137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875394+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:10:09.875394+0000","last_peered":"2024-01-30T08:10:09.875394+0000","last_clean":"2024-01-30T08:10:09.875394+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:10:09.875394+0000","last_undegraded":"2024-01-30T08:10:09.875394+0000","last_fullsized":"2024-01-30T08:10:09.875394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.895972+0000","last_change":"2024-01-30T08:09:53.881127+0000","last_active":"2024-01-30T08:10:11.895972+0000","last_peered":"2024-01-30T08:10:11.895972+0000","last_clean":"2024-01-30T08:10:11.895972+0000","last_became_active":"2024-01-30T08:09:53.880821+0000","last_became_peered":"2024-01-30T08:09:53.880821+0000","last_unstale":"2024-01-30T08:10:11.895972+0000","last_undegraded":"2024-01-30T08:10:11.895972+0000","last_fullsized":"2024-01-30T08:10:11.895972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:34:00.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925958+0000","last_change":"2024-01-30T08:10:11.916154+0000","last_active":"2024-01-30T08:10:11.925958+0000","last_peered":"2024-01-30T08:10:11.925958+0000","last_clean":"2024-01-30T08:10:11.925958+0000","last_became_active":"2024-01-30T08:10:11.915888+0000","last_became_peered":"2024-01-30T08:10:11.915888+0000","last_unstale":"2024-01-30T08:10:11.925958+0000","last_undegraded":"2024-01-30T08:10:11.925958+0000","last_fullsized":"2024-01-30T08:10:11.925958+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:07:31.431470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875212+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:10:09.875212+0000","last_peered":"2024-01-30T08:10:09.875212+0000","last_clean":"2024-01-30T08:10:09.875212+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:10:09.875212+0000","last_undegraded":"2024-01-30T08:10:09.875212+0000","last_fullsized":"2024-01-30T08:10:09.875212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875028+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:10:09.875028+0000","last_peered":"2024-01-30T08:10:09.875028+0000","last_clean":"2024-01-30T08:10:09.875028+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:10:09.875028+0000","last_undegraded":"2024-01-30T08:10:09.875028+0000","last_fullsized":"2024-01-30T08:10:09.875028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917333+0000","last_change":"2024-01-30T08:10:11.910891+0000","last_active":"2024-01-30T08:10:11.917333+0000","last_peered":"2024-01-30T08:10:11.917333+0000","last_clean":"2024-01-30T08:10:11.917333+0000","last_became_active":"2024-01-30T08:10:11.910551+0000","last_became_peered":"2024-01-30T08:10:11.910551+0000","last_unstale":"2024-01-30T08:10:11.917333+0000","last_undegraded":"2024-01-30T08:10:11.917333+0000","last_fullsized":"2024-01-30T08:10:11.917333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:48:29.533666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883437+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:10:09.883437+0000","last_peered":"2024-01-30T08:10:09.883437+0000","last_clean":"2024-01-30T08:10:09.883437+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:10:09.883437+0000","last_undegraded":"2024-01-30T08:10:09.883437+0000","last_fullsized":"2024-01-30T08:10:09.883437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878428+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:10:09.878428+0000","last_peered":"2024-01-30T08:10:09.878428+0000","last_clean":"2024-01-30T08:10:09.878428+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:10:09.878428+0000","last_undegraded":"2024-01-30T08:10:09.878428+0000","last_fullsized":"2024-01-30T08:10:09.878428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877696+0000","last_change":"2024-01-30T08:10:09.877696+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877696+0000","last_undegraded":"2024-01-30T08:10:09.877696+0000","last_fullsized":"2024-01-30T08:10:09.877696+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884837+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:10:09.884837+0000","last_peered":"2024-01-30T08:10:09.884837+0000","last_clean":"2024-01-30T08:10:09.884837+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:10:09.884837+0000","last_undegraded":"2024-01-30T08:10:09.884837+0000","last_fullsized":"2024-01-30T08:10:09.884837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875612+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:10:09.875612+0000","last_peered":"2024-01-30T08:10:09.875612+0000","last_clean":"2024-01-30T08:10:09.875612+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:10:09.875612+0000","last_undegraded":"2024-01-30T08:10:09.875612+0000","last_fullsized":"2024-01-30T08:10:09.875612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.926426+0000","last_change":"2024-01-30T08:10:10.907010+0000","last_active":"2024-01-30T08:10:11.926426+0000","last_peered":"2024-01-30T08:10:11.926426+0000","last_clean":"2024-01-30T08:10:11.926426+0000","last_became_active":"2024-01-30T08:10:10.906670+0000","last_became_peered":"2024-01-30T08:10:10.906670+0000","last_unstale":"2024-01-30T08:10:11.926426+0000","last_undegraded":"2024-01-30T08:10:11.926426+0000","last_fullsized":"2024-01-30T08:10:11.926426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:26.246384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879198+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:10:09.879198+0000","last_peered":"2024-01-30T08:10:09.879198+0000","last_clean":"2024-01-30T08:10:09.879198+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:10:09.879198+0000","last_undegraded":"2024-01-30T08:10:09.879198+0000","last_fullsized":"2024-01-30T08:10:09.879198+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905509+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:10:11.905509+0000","last_peered":"2024-01-30T08:10:11.905509+0000","last_clean":"2024-01-30T08:10:11.905509+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:10:11.905509+0000","last_undegraded":"2024-01-30T08:10:11.905509+0000","last_fullsized":"2024-01-30T08:10:11.905509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874376+0000","last_change":"2024-01-30T08:10:09.874376+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874376+0000","last_undegraded":"2024-01-30T08:10:09.874376+0000","last_fullsized":"2024-01-30T08:10:09.874376+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877175+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:10:09.877175+0000","last_peered":"2024-01-30T08:10:09.877175+0000","last_clean":"2024-01-30T08:10:09.877175+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:10:09.877175+0000","last_undegraded":"2024-01-30T08:10:09.877175+0000","last_fullsized":"2024-01-30T08:10:09.877175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879337+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:10:09.879337+0000","last_peered":"2024-01-30T08:10:09.879337+0000","last_clean":"2024-01-30T08:10:09.879337+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:10:09.879337+0000","last_undegraded":"2024-01-30T08:10:09.879337+0000","last_fullsized":"2024-01-30T08:10:09.879337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929867+0000","last_change":"2024-01-30T08:10:11.928520+0000","last_active":"2024-01-30T08:10:11.929867+0000","last_peered":"2024-01-30T08:10:11.929867+0000","last_clean":"2024-01-30T08:10:11.929867+0000","last_became_active":"2024-01-30T08:10:11.927399+0000","last_became_peered":"2024-01-30T08:10:11.927399+0000","last_unstale":"2024-01-30T08:10:11.929867+0000","last_undegraded":"2024-01-30T08:10:11.929867+0000","last_fullsized":"2024-01-30T08:10:11.929867+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.878291+0000","last_change":"2024-01-30T08:10:09.878291+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.878291+0000","last_undegraded":"2024-01-30T08:10:09.878291+0000","last_fullsized":"2024-01-30T08:10:09.878291+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873259+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:10:09.873259+0000","last_peered":"2024-01-30T08:10:09.873259+0000","last_clean":"2024-01-30T08:10:09.873259+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:10:09.873259+0000","last_undegraded":"2024-01-30T08:10:09.873259+0000","last_fullsized":"2024-01-30T08:10:09.873259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876778+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:10:09.876778+0000","last_peered":"2024-01-30T08:10:09.876778+0000","last_clean":"2024-01-30T08:10:09.876778+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:10:09.876778+0000","last_undegraded":"2024-01-30T08:10:09.876778+0000","last_fullsized":"2024-01-30T08:10:09.876778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873017+0000","last_change":"2024-01-30T08:10:09.873017+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873017+0000","last_undegraded":"2024-01-30T08:10:09.873017+0000","last_fullsized":"2024-01-30T08:10:09.873017+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901991+0000","last_change":"2024-01-30T08:09:53.881438+0000","last_active":"2024-01-30T08:10:11.901991+0000","last_peered":"2024-01-30T08:10:11.901991+0000","last_clean":"2024-01-30T08:10:11.901991+0000","last_became_active":"2024-01-30T08:09:53.881166+0000","last_became_peered":"2024-01-30T08:09:53.881166+0000","last_unstale":"2024-01-30T08:10:11.901991+0000","last_undegraded":"2024-01-30T08:10:11.901991+0000","last_fullsized":"2024-01-30T08:10:11.901991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:37.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893536+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:10:11.893536+0000","last_peered":"2024-01-30T08:10:11.893536+0000","last_clean":"2024-01-30T08:10:11.893536+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:10:11.893536+0000","last_undegraded":"2024-01-30T08:10:11.893536+0000","last_fullsized":"2024-01-30T08:10:11.893536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:43.172388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902051+0000","last_change":"2024-01-30T08:10:10.905030+0000","last_active":"2024-01-30T08:10:11.902051+0000","last_peered":"2024-01-30T08:10:11.902051+0000","last_clean":"2024-01-30T08:10:11.902051+0000","last_became_active":"2024-01-30T08:10:10.901186+0000","last_became_peered":"2024-01-30T08:10:10.901186+0000","last_unstale":"2024-01-30T08:10:11.902051+0000","last_undegraded":"2024-01-30T08:10:11.902051+0000","last_fullsized":"2024-01-30T08:10:11.902051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:30.092942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.894010+0000","last_change":"2024-01-30T08:09:53.881466+0000","last_active":"2024-01-30T08:10:11.894010+0000","last_peered":"2024-01-30T08:10:11.894010+0000","last_clean":"2024-01-30T08:10:11.894010+0000","last_became_active":"2024-01-30T08:09:53.880847+0000","last_became_peered":"2024-01-30T08:09:53.880847+0000","last_unstale":"2024-01-30T08:10:11.894010+0000","last_undegraded":"2024-01-30T08:10:11.894010+0000","last_fullsized":"2024-01-30T08:10:11.894010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:24:30.424249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883933+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:10:09.883933+0000","last_peered":"2024-01-30T08:10:09.883933+0000","last_clean":"2024-01-30T08:10:09.883933+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:10:09.883933+0000","last_undegraded":"2024-01-30T08:10:09.883933+0000","last_fullsized":"2024-01-30T08:10:09.883933+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.938380+0000","last_change":"2024-01-30T08:10:10.903517+0000","last_active":"2024-01-30T08:10:11.938380+0000","last_peered":"2024-01-30T08:10:11.938380+0000","last_clean":"2024-01-30T08:10:11.938380+0000","last_became_active":"2024-01-30T08:10:10.903251+0000","last_became_peered":"2024-01-30T08:10:10.903251+0000","last_unstale":"2024-01-30T08:10:11.938380+0000","last_undegraded":"2024-01-30T08:10:11.938380+0000","last_fullsized":"2024-01-30T08:10:11.938380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:26.792702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876885+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:10:09.876885+0000","last_peered":"2024-01-30T08:10:09.876885+0000","last_clean":"2024-01-30T08:10:09.876885+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:10:09.876885+0000","last_undegraded":"2024-01-30T08:10:09.876885+0000","last_fullsized":"2024-01-30T08:10:09.876885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878586+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:10:09.878586+0000","last_peered":"2024-01-30T08:10:09.878586+0000","last_clean":"2024-01-30T08:10:09.878586+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:10:09.878586+0000","last_undegraded":"2024-01-30T08:10:09.878586+0000","last_fullsized":"2024-01-30T08:10:09.878586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873024+0000","last_change":"2024-01-30T08:10:09.873024+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873024+0000","last_undegraded":"2024-01-30T08:10:09.873024+0000","last_fullsized":"2024-01-30T08:10:09.873024+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873366+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:10:09.873366+0000","last_peered":"2024-01-30T08:10:09.873366+0000","last_clean":"2024-01-30T08:10:09.873366+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:10:09.873366+0000","last_undegraded":"2024-01-30T08:10:09.873366+0000","last_fullsized":"2024-01-30T08:10:09.873366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874049+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:10:09.874049+0000","last_peered":"2024-01-30T08:10:09.874049+0000","last_clean":"2024-01-30T08:10:09.874049+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:10:09.874049+0000","last_undegraded":"2024-01-30T08:10:09.874049+0000","last_fullsized":"2024-01-30T08:10:09.874049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914866+0000","last_change":"2024-01-30T08:10:11.909037+0000","last_active":"2024-01-30T08:10:11.914866+0000","last_peered":"2024-01-30T08:10:11.914866+0000","last_clean":"2024-01-30T08:10:11.914866+0000","last_became_active":"2024-01-30T08:10:11.908779+0000","last_became_peered":"2024-01-30T08:10:11.908779+0000","last_unstale":"2024-01-30T08:10:11.914866+0000","last_undegraded":"2024-01-30T08:10:11.914866+0000","last_fullsized":"2024-01-30T08:10:11.914866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:09.368965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.882394+0000","last_change":"2024-01-30T08:10:09.882394+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.882394+0000","last_undegraded":"2024-01-30T08:10:09.882394+0000","last_fullsized":"2024-01-30T08:10:09.882394+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877623+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:10:09.877623+0000","last_peered":"2024-01-30T08:10:09.877623+0000","last_clean":"2024-01-30T08:10:09.877623+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:10:09.877623+0000","last_undegraded":"2024-01-30T08:10:09.877623+0000","last_fullsized":"2024-01-30T08:10:09.877623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:23.401989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873363+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:10:09.873363+0000","last_peered":"2024-01-30T08:10:09.873363+0000","last_clean":"2024-01-30T08:10:09.873363+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:10:09.873363+0000","last_undegraded":"2024-01-30T08:10:09.873363+0000","last_fullsized":"2024-01-30T08:10:09.873363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874771+0000","last_change":"2024-01-30T08:10:09.874771+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874771+0000","last_undegraded":"2024-01-30T08:10:09.874771+0000","last_fullsized":"2024-01-30T08:10:09.874771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882655+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:10:09.882655+0000","last_peered":"2024-01-30T08:10:09.882655+0000","last_clean":"2024-01-30T08:10:09.882655+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:10:09.882655+0000","last_undegraded":"2024-01-30T08:10:09.882655+0000","last_fullsized":"2024-01-30T08:10:09.882655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:00:52.172429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896891+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:10:11.896891+0000","last_peered":"2024-01-30T08:10:11.896891+0000","last_clean":"2024-01-30T08:10:11.896891+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:10:11.896891+0000","last_undegraded":"2024-01-30T08:10:11.896891+0000","last_fullsized":"2024-01-30T08:10:11.896891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:37.710856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881839+0000","last_change":"2024-01-30T08:10:09.881839+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881839+0000","last_undegraded":"2024-01-30T08:10:09.881839+0000","last_fullsized":"2024-01-30T08:10:09.881839+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905233+0000","last_change":"2024-01-30T08:09:53.883329+0000","last_active":"2024-01-30T08:10:11.905233+0000","last_peered":"2024-01-30T08:10:11.905233+0000","last_clean":"2024-01-30T08:10:11.905233+0000","last_became_active":"2024-01-30T08:09:53.881025+0000","last_became_peered":"2024-01-30T08:09:53.881025+0000","last_unstale":"2024-01-30T08:10:11.905233+0000","last_undegraded":"2024-01-30T08:10:11.905233+0000","last_fullsized":"2024-01-30T08:10:11.905233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:38.717964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896458+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:10:11.896458+0000","last_peered":"2024-01-30T08:10:11.896458+0000","last_clean":"2024-01-30T08:10:11.896458+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:10:11.896458+0000","last_undegraded":"2024-01-30T08:10:11.896458+0000","last_fullsized":"2024-01-30T08:10:11.896458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:51.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.920942+0000","last_change":"2024-01-30T08:10:11.914923+0000","last_active":"2024-01-30T08:10:11.920942+0000","last_peered":"2024-01-30T08:10:11.920942+0000","last_clean":"2024-01-30T08:10:11.920942+0000","last_became_active":"2024-01-30T08:10:11.914536+0000","last_became_peered":"2024-01-30T08:10:11.914536+0000","last_unstale":"2024-01-30T08:10:11.920942+0000","last_undegraded":"2024-01-30T08:10:11.920942+0000","last_fullsized":"2024-01-30T08:10:11.920942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873057+0000","last_change":"2024-01-30T08:10:09.873057+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873057+0000","last_undegraded":"2024-01-30T08:10:09.873057+0000","last_fullsized":"2024-01-30T08:10:09.873057+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875678+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:10:09.875678+0000","last_peered":"2024-01-30T08:10:09.875678+0000","last_clean":"2024-01-30T08:10:09.875678+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:10:09.875678+0000","last_undegraded":"2024-01-30T08:10:09.875678+0000","last_fullsized":"2024-01-30T08:10:09.875678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873288+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:10:09.873288+0000","last_peered":"2024-01-30T08:10:09.873288+0000","last_clean":"2024-01-30T08:10:09.873288+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:10:09.873288+0000","last_undegraded":"2024-01-30T08:10:09.873288+0000","last_fullsized":"2024-01-30T08:10:09.873288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881276+0000","last_change":"2024-01-30T08:10:09.881276+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881276+0000","last_undegraded":"2024-01-30T08:10:09.881276+0000","last_fullsized":"2024-01-30T08:10:09.881276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902146+0000","last_change":"2024-01-30T08:09:53.889988+0000","last_active":"2024-01-30T08:10:11.902146+0000","last_peered":"2024-01-30T08:10:11.902146+0000","last_clean":"2024-01-30T08:10:11.902146+0000","last_became_active":"2024-01-30T08:09:53.888579+0000","last_became_peered":"2024-01-30T08:09:53.888579+0000","last_unstale":"2024-01-30T08:10:11.902146+0000","last_undegraded":"2024-01-30T08:10:11.902146+0000","last_fullsized":"2024-01-30T08:10:11.902146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:01:50.624934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873359+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:10:09.873359+0000","last_peered":"2024-01-30T08:10:09.873359+0000","last_clean":"2024-01-30T08:10:09.873359+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:10:09.873359+0000","last_undegraded":"2024-01-30T08:10:09.873359+0000","last_fullsized":"2024-01-30T08:10:09.873359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917315+0000","last_change":"2024-01-30T08:10:11.910494+0000","last_active":"2024-01-30T08:10:11.917315+0000","last_peered":"2024-01-30T08:10:11.917315+0000","last_clean":"2024-01-30T08:10:11.917315+0000","last_became_active":"2024-01-30T08:10:11.910244+0000","last_became_peered":"2024-01-30T08:10:11.910244+0000","last_unstale":"2024-01-30T08:10:11.917315+0000","last_undegraded":"2024-01-30T08:10:11.917315+0000","last_fullsized":"2024-01-30T08:10:11.917315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:10:01.141484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874758+0000","last_change":"2024-01-30T08:10:09.874758+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874758+0000","last_undegraded":"2024-01-30T08:10:09.874758+0000","last_fullsized":"2024-01-30T08:10:09.874758+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873030+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:10:09.873030+0000","last_peered":"2024-01-30T08:10:09.873030+0000","last_clean":"2024-01-30T08:10:09.873030+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:10:09.873030+0000","last_undegraded":"2024-01-30T08:10:09.873030+0000","last_fullsized":"2024-01-30T08:10:09.873030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878696+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:10:09.878696+0000","last_peered":"2024-01-30T08:10:09.878696+0000","last_clean":"2024-01-30T08:10:09.878696+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:10:09.878696+0000","last_undegraded":"2024-01-30T08:10:09.878696+0000","last_fullsized":"2024-01-30T08:10:09.878696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.928340+0000","last_change":"2024-01-30T08:10:11.926413+0000","last_active":"2024-01-30T08:10:11.928340+0000","last_peered":"2024-01-30T08:10:11.928340+0000","last_clean":"2024-01-30T08:10:11.928340+0000","last_became_active":"2024-01-30T08:10:11.926117+0000","last_became_peered":"2024-01-30T08:10:11.926117+0000","last_unstale":"2024-01-30T08:10:11.928340+0000","last_undegraded":"2024-01-30T08:10:11.928340+0000","last_fullsized":"2024-01-30T08:10:11.928340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.935402+0000","last_change":"2024-01-30T08:10:10.908780+0000","last_active":"2024-01-30T08:10:11.935402+0000","last_peered":"2024-01-30T08:10:11.935402+0000","last_clean":"2024-01-30T08:10:11.935402+0000","last_became_active":"2024-01-30T08:10:10.907095+0000","last_became_peered":"2024-01-30T08:10:10.907095+0000","last_unstale":"2024-01-30T08:10:11.935402+0000","last_undegraded":"2024-01-30T08:10:11.935402+0000","last_fullsized":"2024-01-30T08:10:11.935402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:58.832681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883795+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:10:09.883795+0000","last_peered":"2024-01-30T08:10:09.883795+0000","last_clean":"2024-01-30T08:10:09.883795+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:10:09.883795+0000","last_undegraded":"2024-01-30T08:10:09.883795+0000","last_fullsized":"2024-01-30T08:10:09.883795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874854+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:10:09.874854+0000","last_peered":"2024-01-30T08:10:09.874854+0000","last_clean":"2024-01-30T08:10:09.874854+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:10:09.874854+0000","last_undegraded":"2024-01-30T08:10:09.874854+0000","last_fullsized":"2024-01-30T08:10:09.874854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930107+0000","last_change":"2024-01-30T08:10:11.919713+0000","last_active":"2024-01-30T08:10:11.930107+0000","last_peered":"2024-01-30T08:10:11.930107+0000","last_clean":"2024-01-30T08:10:11.930107+0000","last_became_active":"2024-01-30T08:10:11.919423+0000","last_became_peered":"2024-01-30T08:10:11.919423+0000","last_unstale":"2024-01-30T08:10:11.930107+0000","last_undegraded":"2024-01-30T08:10:11.930107+0000","last_fullsized":"2024-01-30T08:10:11.930107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873059+0000","last_change":"2024-01-30T08:10:09.873059+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873059+0000","last_undegraded":"2024-01-30T08:10:09.873059+0000","last_fullsized":"2024-01-30T08:10:09.873059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873018+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:10:09.873018+0000","last_peered":"2024-01-30T08:10:09.873018+0000","last_clean":"2024-01-30T08:10:09.873018+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:10:09.873018+0000","last_undegraded":"2024-01-30T08:10:09.873018+0000","last_fullsized":"2024-01-30T08:10:09.873018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":24,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883006+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:10:09.883006+0000","last_peered":"2024-01-30T08:10:09.883006+0000","last_clean":"2024-01-30T08:10:09.883006+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:10:09.883006+0000","last_undegraded":"2024-01-30T08:10:09.883006+0000","last_fullsized":"2024-01-30T08:10:09.883006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873701+0000","last_change":"2024-01-30T08:10:09.873701+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873701+0000","last_undegraded":"2024-01-30T08:10:09.873701+0000","last_fullsized":"2024-01-30T08:10:09.873701+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873080+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:10:09.873080+0000","last_peered":"2024-01-30T08:10:09.873080+0000","last_clean":"2024-01-30T08:10:09.873080+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:10:09.873080+0000","last_undegraded":"2024-01-30T08:10:09.873080+0000","last_fullsized":"2024-01-30T08:10:09.873080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897197+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:10:11.897197+0000","last_peered":"2024-01-30T08:10:11.897197+0000","last_clean":"2024-01-30T08:10:11.897197+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:10:11.897197+0000","last_undegraded":"2024-01-30T08:10:11.897197+0000","last_fullsized":"2024-01-30T08:10:11.897197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:36.960284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873089+0000","last_change":"2024-01-30T08:10:09.873089+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873089+0000","last_undegraded":"2024-01-30T08:10:09.873089+0000","last_fullsized":"2024-01-30T08:10:09.873089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896361+0000","last_change":"2024-01-30T08:09:53.883122+0000","last_active":"2024-01-30T08:10:11.896361+0000","last_peered":"2024-01-30T08:10:11.896361+0000","last_clean":"2024-01-30T08:10:11.896361+0000","last_became_active":"2024-01-30T08:09:53.882631+0000","last_became_peered":"2024-01-30T08:09:53.882631+0000","last_unstale":"2024-01-30T08:10:11.896361+0000","last_undegraded":"2024-01-30T08:10:11.896361+0000","last_fullsized":"2024-01-30T08:10:11.896361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:41.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877245+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:10:09.877245+0000","last_peered":"2024-01-30T08:10:09.877245+0000","last_clean":"2024-01-30T08:10:09.877245+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:10:09.877245+0000","last_undegraded":"2024-01-30T08:10:09.877245+0000","last_fullsized":"2024-01-30T08:10:09.877245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.936401+0000","last_change":"2024-01-30T08:10:10.912271+0000","last_active":"2024-01-30T08:10:11.936401+0000","last_peered":"2024-01-30T08:10:11.936401+0000","last_clean":"2024-01-30T08:10:11.936401+0000","last_became_active":"2024-01-30T08:10:10.911787+0000","last_became_peered":"2024-01-30T08:10:10.911787+0000","last_unstale":"2024-01-30T08:10:11.936401+0000","last_undegraded":"2024-01-30T08:10:11.936401+0000","last_fullsized":"2024-01-30T08:10:11.936401+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:41:52.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877087+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:10:09.877087+0000","last_peered":"2024-01-30T08:10:09.877087+0000","last_clean":"2024-01-30T08:10:09.877087+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:10:09.877087+0000","last_undegraded":"2024-01-30T08:10:09.877087+0000","last_fullsized":"2024-01-30T08:10:09.877087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879701+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:10:09.879701+0000","last_peered":"2024-01-30T08:10:09.879701+0000","last_clean":"2024-01-30T08:10:09.879701+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:10:09.879701+0000","last_undegraded":"2024-01-30T08:10:09.879701+0000","last_fullsized":"2024-01-30T08:10:09.879701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.879403+0000","last_change":"2024-01-30T08:10:09.879403+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.879403+0000","last_undegraded":"2024-01-30T08:10:09.879403+0000","last_fullsized":"2024-01-30T08:10:09.879403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879866+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:10:09.879866+0000","last_peered":"2024-01-30T08:10:09.879866+0000","last_clean":"2024-01-30T08:10:09.879866+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:10:09.879866+0000","last_undegraded":"2024-01-30T08:10:09.879866+0000","last_fullsized":"2024-01-30T08:10:09.879866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878949+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:10:09.878949+0000","last_peered":"2024-01-30T08:10:09.878949+0000","last_clean":"2024-01-30T08:10:09.878949+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:10:09.878949+0000","last_undegraded":"2024-01-30T08:10:09.878949+0000","last_fullsized":"2024-01-30T08:10:09.878949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.916984+0000","last_change":"2024-01-30T08:10:11.912714+0000","last_active":"2024-01-30T08:10:11.916984+0000","last_peered":"2024-01-30T08:10:11.916984+0000","last_clean":"2024-01-30T08:10:11.916984+0000","last_became_active":"2024-01-30T08:10:11.912428+0000","last_became_peered":"2024-01-30T08:10:11.912428+0000","last_unstale":"2024-01-30T08:10:11.916984+0000","last_undegraded":"2024-01-30T08:10:11.916984+0000","last_fullsized":"2024-01-30T08:10:11.916984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:37:00.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902543+0000","last_change":"2024-01-30T08:10:10.906011+0000","last_active":"2024-01-30T08:10:11.902543+0000","last_peered":"2024-01-30T08:10:11.902543+0000","last_clean":"2024-01-30T08:10:11.902543+0000","last_became_active":"2024-01-30T08:10:10.905777+0000","last_became_peered":"2024-01-30T08:10:10.905777+0000","last_unstale":"2024-01-30T08:10:11.902543+0000","last_undegraded":"2024-01-30T08:10:11.902543+0000","last_fullsized":"2024-01-30T08:10:11.902543+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:57.576769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883048+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:10:09.883048+0000","last_peered":"2024-01-30T08:10:09.883048+0000","last_clean":"2024-01-30T08:10:09.883048+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:10:09.883048+0000","last_undegraded":"2024-01-30T08:10:09.883048+0000","last_fullsized":"2024-01-30T08:10:09.883048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:13:20.247550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878832+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:10:09.878832+0000","last_peered":"2024-01-30T08:10:09.878832+0000","last_clean":"2024-01-30T08:10:09.878832+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:10:09.878832+0000","last_undegraded":"2024-01-30T08:10:09.878832+0000","last_fullsized":"2024-01-30T08:10:09.878832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877896+0000","last_change":"2024-01-30T08:10:09.877896+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877896+0000","last_undegraded":"2024-01-30T08:10:09.877896+0000","last_fullsized":"2024-01-30T08:10:09.877896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902434+0000","last_change":"2024-01-30T08:09:53.883346+0000","last_active":"2024-01-30T08:10:11.902434+0000","last_peered":"2024-01-30T08:10:11.902434+0000","last_clean":"2024-01-30T08:10:11.902434+0000","last_became_active":"2024-01-30T08:09:53.878878+0000","last_became_peered":"2024-01-30T08:09:53.878878+0000","last_unstale":"2024-01-30T08:10:11.902434+0000","last_undegraded":"2024-01-30T08:10:11.902434+0000","last_fullsized":"2024-01-30T08:10:11.902434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:52.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878361+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:10:09.878361+0000","last_peered":"2024-01-30T08:10:09.878361+0000","last_clean":"2024-01-30T08:10:09.878361+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:10:09.878361+0000","last_undegraded":"2024-01-30T08:10:09.878361+0000","last_fullsized":"2024-01-30T08:10:09.878361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925762+0000","last_change":"2024-01-30T08:10:11.913825+0000","last_active":"2024-01-30T08:10:11.925762+0000","last_peered":"2024-01-30T08:10:11.925762+0000","last_clean":"2024-01-30T08:10:11.925762+0000","last_became_active":"2024-01-30T08:10:11.913570+0000","last_became_peered":"2024-01-30T08:10:11.913570+0000","last_unstale":"2024-01-30T08:10:11.925762+0000","last_undegraded":"2024-01-30T08:10:11.925762+0000","last_fullsized":"2024-01-30T08:10:11.925762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877813+0000","last_change":"2024-01-30T08:10:09.877813+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877813+0000","last_undegraded":"2024-01-30T08:10:09.877813+0000","last_fullsized":"2024-01-30T08:10:09.877813+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893380+0000","last_change":"2024-01-30T08:09:53.886717+0000","last_active":"2024-01-30T08:10:11.893380+0000","last_peered":"2024-01-30T08:10:11.893380+0000","last_clean":"2024-01-30T08:10:11.893380+0000","last_became_active":"2024-01-30T08:09:53.884242+0000","last_became_peered":"2024-01-30T08:09:53.884242+0000","last_unstale":"2024-01-30T08:10:11.893380+0000","last_undegraded":"2024-01-30T08:10:11.893380+0000","last_fullsized":"2024-01-30T08:10:11.893380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:05.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883561+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:10:09.883561+0000","last_peered":"2024-01-30T08:10:09.883561+0000","last_clean":"2024-01-30T08:10:09.883561+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:10:09.883561+0000","last_undegraded":"2024-01-30T08:10:09.883561+0000","last_fullsized":"2024-01-30T08:10:09.883561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874726+0000","last_change":"2024-01-30T08:10:09.874726+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874726+0000","last_undegraded":"2024-01-30T08:10:09.874726+0000","last_fullsized":"2024-01-30T08:10:09.874726+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873145+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:10:09.873145+0000","last_peered":"2024-01-30T08:10:09.873145+0000","last_clean":"2024-01-30T08:10:09.873145+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:10:09.873145+0000","last_undegraded":"2024-01-30T08:10:09.873145+0000","last_fullsized":"2024-01-30T08:10:09.873145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878523+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:10:09.878523+0000","last_peered":"2024-01-30T08:10:09.878523+0000","last_clean":"2024-01-30T08:10:09.878523+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:10:09.878523+0000","last_undegraded":"2024-01-30T08:10:09.878523+0000","last_fullsized":"2024-01-30T08:10:09.878523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881311+0000","last_change":"2024-01-30T08:10:09.881311+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881311+0000","last_undegraded":"2024-01-30T08:10:09.881311+0000","last_fullsized":"2024-01-30T08:10:09.881311+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878852+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:10:09.878852+0000","last_peered":"2024-01-30T08:10:09.878852+0000","last_clean":"2024-01-30T08:10:09.878852+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:10:09.878852+0000","last_undegraded":"2024-01-30T08:10:09.878852+0000","last_fullsized":"2024-01-30T08:10:09.878852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897331+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:10:11.897331+0000","last_peered":"2024-01-30T08:10:11.897331+0000","last_clean":"2024-01-30T08:10:11.897331+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:10:11.897331+0000","last_undegraded":"2024-01-30T08:10:11.897331+0000","last_fullsized":"2024-01-30T08:10:11.897331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:51.914756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902870+0000","last_change":"2024-01-30T08:10:10.901224+0000","last_active":"2024-01-30T08:10:11.902870+0000","last_peered":"2024-01-30T08:10:11.902870+0000","last_clean":"2024-01-30T08:10:11.902870+0000","last_became_active":"2024-01-30T08:10:10.900957+0000","last_became_peered":"2024-01-30T08:10:10.900957+0000","last_unstale":"2024-01-30T08:10:11.902870+0000","last_undegraded":"2024-01-30T08:10:11.902870+0000","last_fullsized":"2024-01-30T08:10:11.902870+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:23:17.774625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882806+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:10:09.882806+0000","last_peered":"2024-01-30T08:10:09.882806+0000","last_clean":"2024-01-30T08:10:09.882806+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:10:09.882806+0000","last_undegraded":"2024-01-30T08:10:09.882806+0000","last_fullsized":"2024-01-30T08:10:09.882806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879695+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:10:09.879695+0000","last_peered":"2024-01-30T08:10:09.879695+0000","last_clean":"2024-01-30T08:10:09.879695+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:10:09.879695+0000","last_undegraded":"2024-01-30T08:10:09.879695+0000","last_fullsized":"2024-01-30T08:10:09.879695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925721+0000","last_change":"2024-01-30T08:10:11.911523+0000","last_active":"2024-01-30T08:10:11.925721+0000","last_peered":"2024-01-30T08:10:11.925721+0000","last_clean":"2024-01-30T08:10:11.925721+0000","last_became_active":"2024-01-30T08:10:11.910812+0000","last_became_peered":"2024-01-30T08:10:11.910812+0000","last_unstale":"2024-01-30T08:10:11.925721+0000","last_undegraded":"2024-01-30T08:10:11.925721+0000","last_fullsized":"2024-01-30T08:10:11.925721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873933+0000","last_change":"2024-01-30T08:10:09.873933+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873933+0000","last_undegraded":"2024-01-30T08:10:09.873933+0000","last_fullsized":"2024-01-30T08:10:09.873933+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873147+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:10:09.873147+0000","last_peered":"2024-01-30T08:10:09.873147+0000","last_clean":"2024-01-30T08:10:09.873147+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:10:09.873147+0000","last_undegraded":"2024-01-30T08:10:09.873147+0000","last_fullsized":"2024-01-30T08:10:09.873147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903990+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:10:11.903990+0000","last_peered":"2024-01-30T08:10:11.903990+0000","last_clean":"2024-01-30T08:10:11.903990+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:10:11.903990+0000","last_undegraded":"2024-01-30T08:10:11.903990+0000","last_fullsized":"2024-01-30T08:10:11.903990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:30:27.351725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930162+0000","last_change":"2024-01-30T08:10:11.925753+0000","last_active":"2024-01-30T08:10:11.930162+0000","last_peered":"2024-01-30T08:10:11.930162+0000","last_clean":"2024-01-30T08:10:11.930162+0000","last_became_active":"2024-01-30T08:10:11.925478+0000","last_became_peered":"2024-01-30T08:10:11.925478+0000","last_unstale":"2024-01-30T08:10:11.930162+0000","last_undegraded":"2024-01-30T08:10:11.930162+0000","last_fullsized":"2024-01-30T08:10:11.930162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873033+0000","last_change":"2024-01-30T08:10:09.873033+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873033+0000","last_undegraded":"2024-01-30T08:10:09.873033+0000","last_fullsized":"2024-01-30T08:10:09.873033+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902254+0000","last_change":"2024-01-30T08:09:53.882768+0000","last_active":"2024-01-30T08:10:11.902254+0000","last_peered":"2024-01-30T08:10:11.902254+0000","last_clean":"2024-01-30T08:10:11.902254+0000","last_became_active":"2024-01-30T08:09:53.882430+0000","last_became_peered":"2024-01-30T08:09:53.882430+0000","last_unstale":"2024-01-30T08:10:11.902254+0000","last_undegraded":"2024-01-30T08:10:11.902254+0000","last_fullsized":"2024-01-30T08:10:11.902254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:58.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903223+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:10:11.903223+0000","last_peered":"2024-01-30T08:10:11.903223+0000","last_clean":"2024-01-30T08:10:11.903223+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:10:11.903223+0000","last_undegraded":"2024-01-30T08:10:11.903223+0000","last_fullsized":"2024-01-30T08:10:11.903223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901534+0000","last_change":"2024-01-30T08:10:10.902200+0000","last_active":"2024-01-30T08:10:11.901534+0000","last_peered":"2024-01-30T08:10:11.901534+0000","last_clean":"2024-01-30T08:10:11.901534+0000","last_became_active":"2024-01-30T08:10:10.901913+0000","last_became_peered":"2024-01-30T08:10:10.901913+0000","last_unstale":"2024-01-30T08:10:11.901534+0000","last_undegraded":"2024-01-30T08:10:11.901534+0000","last_fullsized":"2024-01-30T08:10:11.901534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:26.634238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877522+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:10:09.877522+0000","last_peered":"2024-01-30T08:10:09.877522+0000","last_clean":"2024-01-30T08:10:09.877522+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:10:09.877522+0000","last_undegraded":"2024-01-30T08:10:09.877522+0000","last_fullsized":"2024-01-30T08:10:09.877522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875134+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:10:09.875134+0000","last_peered":"2024-01-30T08:10:09.875134+0000","last_clean":"2024-01-30T08:10:09.875134+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:10:09.875134+0000","last_undegraded":"2024-01-30T08:10:09.875134+0000","last_fullsized":"2024-01-30T08:10:09.875134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.932589+0000","last_change":"2024-01-30T08:10:11.919869+0000","last_active":"2024-01-30T08:10:11.932589+0000","last_peered":"2024-01-30T08:10:11.932589+0000","last_clean":"2024-01-30T08:10:11.932589+0000","last_became_active":"2024-01-30T08:10:11.916750+0000","last_became_peered":"2024-01-30T08:10:11.916750+0000","last_unstale":"2024-01-30T08:10:11.932589+0000","last_undegraded":"2024-01-30T08:10:11.932589+0000","last_fullsized":"2024-01-30T08:10:11.932589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873952+0000","last_change":"2024-01-30T08:10:09.873952+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873952+0000","last_undegraded":"2024-01-30T08:10:09.873952+0000","last_fullsized":"2024-01-30T08:10:09.873952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876261+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:10:09.876261+0000","last_peered":"2024-01-30T08:10:09.876261+0000","last_clean":"2024-01-30T08:10:09.876261+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:10:09.876261+0000","last_undegraded":"2024-01-30T08:10:09.876261+0000","last_fullsized":"2024-01-30T08:10:09.876261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874883+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:10:09.874883+0000","last_peered":"2024-01-30T08:10:09.874883+0000","last_clean":"2024-01-30T08:10:09.874883+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:10:09.874883+0000","last_undegraded":"2024-01-30T08:10:09.874883+0000","last_fullsized":"2024-01-30T08:10:09.874883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929748+0000","last_change":"2024-01-30T08:10:11.927980+0000","last_active":"2024-01-30T08:10:11.929748+0000","last_peered":"2024-01-30T08:10:11.929748+0000","last_clean":"2024-01-30T08:10:11.929748+0000","last_became_active":"2024-01-30T08:10:11.927664+0000","last_became_peered":"2024-01-30T08:10:11.927664+0000","last_unstale":"2024-01-30T08:10:11.929748+0000","last_undegraded":"2024-01-30T08:10:11.929748+0000","last_fullsized":"2024-01-30T08:10:11.929748+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874006+0000","last_change":"2024-01-30T08:10:09.874006+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874006+0000","last_undegraded":"2024-01-30T08:10:09.874006+0000","last_fullsized":"2024-01-30T08:10:09.874006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.880736+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:10:09.880736+0000","last_peered":"2024-01-30T08:10:09.880736+0000","last_clean":"2024-01-30T08:10:09.880736+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:10:09.880736+0000","last_undegraded":"2024-01-30T08:10:09.880736+0000","last_fullsized":"2024-01-30T08:10:09.880736+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.872847+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:10:09.872847+0000","last_peered":"2024-01-30T08:10:09.872847+0000","last_clean":"2024-01-30T08:10:09.872847+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:10:09.872847+0000","last_undegraded":"2024-01-30T08:10:09.872847+0000","last_fullsized":"2024-01-30T08:10:09.872847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905453+0000","last_change":"2024-01-30T08:10:10.907159+0000","last_active":"2024-01-30T08:10:11.905453+0000","last_peered":"2024-01-30T08:10:11.905453+0000","last_clean":"2024-01-30T08:10:11.905453+0000","last_became_active":"2024-01-30T08:10:10.906711+0000","last_became_peered":"2024-01-30T08:10:10.906711+0000","last_unstale":"2024-01-30T08:10:11.905453+0000","last_undegraded":"2024-01-30T08:10:11.905453+0000","last_fullsized":"2024-01-30T08:10:11.905453+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:55:37.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897039+0000","last_change":"2024-01-30T08:09:53.893858+0000","last_active":"2024-01-30T08:10:11.897039+0000","last_peered":"2024-01-30T08:10:11.897039+0000","last_clean":"2024-01-30T08:10:11.897039+0000","last_became_active":"2024-01-30T08:09:53.893613+0000","last_became_peered":"2024-01-30T08:09:53.893613+0000","last_unstale":"2024-01-30T08:10:11.897039+0000","last_undegraded":"2024-01-30T08:10:11.897039+0000","last_fullsized":"2024-01-30T08:10:11.897039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:09.834509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884932+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:10:09.884932+0000","last_peered":"2024-01-30T08:10:09.884932+0000","last_clean":"2024-01-30T08:10:09.884932+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:10:09.884932+0000","last_undegraded":"2024-01-30T08:10:09.884932+0000","last_fullsized":"2024-01-30T08:10:09.884932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883122+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:09.883122+0000","last_peered":"2024-01-30T08:10:09.883122+0000","last_clean":"2024-01-30T08:10:09.883122+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:09.883122+0000","last_undegraded":"2024-01-30T08:10:09.883122+0000","last_fullsized":"2024-01-30T08:10:09.883122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":528384,"data_stored":785498,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.69699999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.436},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65600000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":192535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59199999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.747},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.73099999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":192557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.84999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":462848,"data_stored":195094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.502}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67900000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":199014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.373}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.497}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":192043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.318},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.39500000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.436},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.47399999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.629}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":214459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53500000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":804805,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.499}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.372}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.621}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:16.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:16.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.608+0000 7fcb79400640 1 Processor -- start 2024-01-30T08:10:16.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.608+0000 7fcb79400640 1 -- start start 2024-01-30T08:10:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb79400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 0x7fcb741559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb79400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740c3ed0 con 0x7fcb740c0ee0 2024-01-30T08:10:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb79400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7406bca0 con 0x7fcb7414fbf0 2024-01-30T08:10:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb79400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740a5520 con 0x7fcb740c1de0 2024-01-30T08:10:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb740c0ee0 0x7fcb7406a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53408/0 (socket says 172.21.15.50:53408) 2024-01-30T08:10:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71e00640 1 -- 172.21.15.50:0/462914281 learned_addr learned my addr 172.21.15.50:0/462914281 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015867343 0 0) 0x7fcb740c3ed0 con 0x7fcb740c0ee0 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb73200640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 0x7fcb741559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb54003530 con 0x7fcb740c0ee0 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2931372540 0 0) 0x7fcb54003530 con 0x7fcb740c0ee0 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 msgr2=0x7fcb741559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 0x7fcb741559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 >> v1:172.21.15.125:6789/0 conn(0x7fcb7414fbf0 legacy=0x7fcb740a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7406bef0 con 0x7fcb740c0ee0 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fcb5c001680 con 0x7fcb740c0ee0 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 >> v1:172.21.15.50:6789/0 conn(0x7fcb740c0ee0 legacy=0x7fcb7406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb540039b0 0x7fcb54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 0x7fcb540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb54004d10 0x7fcb54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740a5520 con 0x7fcb540039b0 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5400bb50 con 0x7fcb54004d10 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5400bd10 con 0x7fcb740c1de0 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb72800640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb540039b0 0x7fcb54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb73200640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb54004d10 0x7fcb54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb71e00640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 0x7fcb540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb72800640 1 -- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 msgr2=0x7fcb540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb72800640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb740c1de0 0x7fcb540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb72800640 1 -- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb54004d10 msgr2=0x7fcb54005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb72800640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb54004d10 0x7fcb54005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb72800640 1 -- 172.21.15.50:0/462914281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54003530 con 0x7fcb540039b0 2024-01-30T08:10:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.612+0000 7fcb73200640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb54004d10 0x7fcb54005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb72800640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb540039b0 0x7fcb54003dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001780 tx=0x7fcb6401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8b55404aea0b86 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640052d0 con 0x7fcb540039b0 2024-01-30T08:10:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb640a7050 con 0x7fcb540039b0 2024-01-30T08:10:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb71400640 1 -- 172.21.15.50:0/462914281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64003600 con 0x7fcb540039b0 2024-01-30T08:10:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 -- 172.21.15.50:0/462914281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb540039b0 msgr2=0x7fcb54003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 --2- 172.21.15.50:0/462914281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb540039b0 0x7fcb54003dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001780 tx=0x7fcb6401c3d0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb73200640 1 -- 172.21.15.50:0/462914281 reap_dead start 2024-01-30T08:10:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 -- 172.21.15.50:0/462914281 shutdown_connections 2024-01-30T08:10:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 -- 172.21.15.50:0/462914281 >> 172.21.15.50:0/462914281 conn(0x7fcb740c5b50 msgr2=0x7fcb740c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 -- 172.21.15.50:0/462914281 shutdown_connections 2024-01-30T08:10:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 -- 172.21.15.50:0/462914281 wait complete. 2024-01-30T08:10:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 Processor -- start 2024-01-30T08:10:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.616+0000 7fcb79400640 1 -- start start 2024-01-30T08:10:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb540039b0 0x7fcb740a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb7414f380 0x7fcb74153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb740a6c90 0x7fcb741542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7414e7b0 con 0x7fcb740a6c90 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741538f0 con 0x7fcb7414f380 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7414ece0 con 0x7fcb540039b0 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb740a6c90 0x7fcb741542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb740a6c90 0x7fcb741542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49290/0 (socket says 172.21.15.50:49290) 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 -- 172.21.15.50:0/1906179356 learned_addr learned my addr 172.21.15.50:0/1906179356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb72800640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb540039b0 0x7fcb740a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb71e00640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb7414f380 0x7fcb74153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 -- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb540039b0 msgr2=0x7fcb740a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb540039b0 0x7fcb740a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 -- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb7414f380 msgr2=0x7fcb74153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb7414f380 0x7fcb74153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 -- 172.21.15.50:0/1906179356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74145b90 con 0x7fcb740a6c90 2024-01-30T08:10:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb73200640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb740a6c90 0x7fcb741542c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcb74153580 tx=0x7fcb6c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb6aa00640 1 -- 172.21.15.50:0/1906179356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c00e050 con 0x7fcb740a6c90 2024-01-30T08:10:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb6aa00640 1 -- 172.21.15.50:0/1906179356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c00f040 con 0x7fcb740a6c90 2024-01-30T08:10:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb6aa00640 1 -- 172.21.15.50:0/1906179356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c0039a0 con 0x7fcb740a6c90 2024-01-30T08:10:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7414ea00 con 0x7fcb740a6c90 2024-01-30T08:10:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb740a5e50 con 0x7fcb740a6c90 2024-01-30T08:10:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.620+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb74074a20 con 0x7fcb740a6c90 2024-01-30T08:10:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.624+0000 7fcb6aa00640 1 -- 172.21.15.50:0/1906179356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcb6c015440 con 0x7fcb740a6c90 2024-01-30T08:10:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.624+0000 7fcb6aa00640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb4c066500 0x7fcb4c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.624+0000 7fcb6aa00640 1 -- 172.21.15.50:0/1906179356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcb6c084700 con 0x7fcb740a6c90 2024-01-30T08:10:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.624+0000 7fcb72800640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb4c066500 0x7fcb4c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:16.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.624+0000 7fcb72800640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb4c066500 0x7fcb4c0689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001750 tx=0x7fcb640011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:16.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.628+0000 7fcb6aa00640 1 -- 172.21.15.50:0/1906179356 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcb6c051640 con 0x7fcb740a6c90 2024-01-30T08:10:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.784+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb74072c50 con 0x7fcb4c066500 2024-01-30T08:10:16.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.796+0000 7fcb6aa00640 1 -- 172.21.15.50:0/1906179356 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+520017 (secure 0 0 0) 0x7fcb640052b0 con 0x7fcb4c066500 2024-01-30T08:10:16.803 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb4c066500 msgr2=0x7fcb4c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb4c066500 0x7fcb4c0689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001750 tx=0x7fcb640011a0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb740a6c90 msgr2=0x7fcb741542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb740a6c90 0x7fcb741542c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcb74153580 tx=0x7fcb6c010590 comp rx=0 tx=0).stop 2024-01-30T08:10:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 shutdown_connections 2024-01-30T08:10:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb7414f380 0x7fcb74153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb4c066500 0x7fcb4c0689c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb740a6c90 0x7fcb741542c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 --2- 172.21.15.50:0/1906179356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb540039b0 0x7fcb740a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 >> 172.21.15.50:0/1906179356 conn(0x7fcb740c5b50 msgr2=0x7fcb740c5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 shutdown_connections 2024-01-30T08:10:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:16.800+0000 7fcb79400640 1 -- 172.21.15.50:0/1906179356 wait complete. 2024-01-30T08:10:16.823 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-01-30T08:10:15.072779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594329,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":302,"acting":302,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236596,"kb_used_data":3772,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738124,"statfs":{"total":773094113280,"available":772851838976,"internally_reserved":0,"allocated":3862528,"data_stored":2776005,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.202958"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873286+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:10:09.873286+0000","last_peered":"2024-01-30T08:10:09.873286+0000","last_clean":"2024-01-30T08:10:09.873286+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:10:09.873286+0000","last_undegraded":"2024-01-30T08:10:09.873286+0000","last_fullsized":"2024-01-30T08:10:09.873286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873025+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:10:09.873025+0000","last_peered":"2024-01-30T08:10:09.873025+0000","last_clean":"2024-01-30T08:10:09.873025+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:10:09.873025+0000","last_undegraded":"2024-01-30T08:10:09.873025+0000","last_fullsized":"2024-01-30T08:10:09.873025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903892+0000","last_change":"2024-01-30T08:09:53.888831+0000","last_active":"2024-01-30T08:10:11.903892+0000","last_peered":"2024-01-30T08:10:11.903892+0000","last_clean":"2024-01-30T08:10:11.903892+0000","last_became_active":"2024-01-30T08:09:53.888512+0000","last_became_peered":"2024-01-30T08:09:53.888512+0000","last_unstale":"2024-01-30T08:10:11.903892+0000","last_undegraded":"2024-01-30T08:10:11.903892+0000","last_fullsized":"2024-01-30T08:10:11.903892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:19.673462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929426+0000","last_change":"2024-01-30T08:10:11.925833+0000","last_active":"2024-01-30T08:10:11.929426+0000","last_peered":"2024-01-30T08:10:11.929426+0000","last_clean":"2024-01-30T08:10:11.929426+0000","last_became_active":"2024-01-30T08:10:11.925416+0000","last_became_peered":"2024-01-30T08:10:11.925416+0000","last_unstale":"2024-01-30T08:10:11.929426+0000","last_undegraded":"2024-01-30T08:10:11.929426+0000","last_fullsized":"2024-01-30T08:10:11.929426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877372+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:10:09.877372+0000","last_peered":"2024-01-30T08:10:09.877372+0000","last_clean":"2024-01-30T08:10:09.877372+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:10:09.877372+0000","last_undegraded":"2024-01-30T08:10:09.877372+0000","last_fullsized":"2024-01-30T08:10:09.877372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878738+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:10:09.878738+0000","last_peered":"2024-01-30T08:10:09.878738+0000","last_clean":"2024-01-30T08:10:09.878738+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:10:09.878738+0000","last_undegraded":"2024-01-30T08:10:09.878738+0000","last_fullsized":"2024-01-30T08:10:09.878738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:47.332748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878589+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:10:09.878589+0000","last_peered":"2024-01-30T08:10:09.878589+0000","last_clean":"2024-01-30T08:10:09.878589+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:10:09.878589+0000","last_undegraded":"2024-01-30T08:10:09.878589+0000","last_fullsized":"2024-01-30T08:10:09.878589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893805+0000","last_change":"2024-01-30T08:09:53.884011+0000","last_active":"2024-01-30T08:10:11.893805+0000","last_peered":"2024-01-30T08:10:11.893805+0000","last_clean":"2024-01-30T08:10:11.893805+0000","last_became_active":"2024-01-30T08:09:53.881881+0000","last_became_peered":"2024-01-30T08:09:53.881881+0000","last_unstale":"2024-01-30T08:10:11.893805+0000","last_undegraded":"2024-01-30T08:10:11.893805+0000","last_fullsized":"2024-01-30T08:10:11.893805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:04:50.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.872756+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:10:09.872756+0000","last_peered":"2024-01-30T08:10:09.872756+0000","last_clean":"2024-01-30T08:10:09.872756+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:10:09.872756+0000","last_undegraded":"2024-01-30T08:10:09.872756+0000","last_fullsized":"2024-01-30T08:10:09.872756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.931474+0000","last_change":"2024-01-30T08:10:11.929495+0000","last_active":"2024-01-30T08:10:11.931474+0000","last_peered":"2024-01-30T08:10:11.931474+0000","last_clean":"2024-01-30T08:10:11.931474+0000","last_became_active":"2024-01-30T08:10:11.928578+0000","last_became_peered":"2024-01-30T08:10:11.928578+0000","last_unstale":"2024-01-30T08:10:11.931474+0000","last_undegraded":"2024-01-30T08:10:11.931474+0000","last_fullsized":"2024-01-30T08:10:11.931474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905164+0000","last_change":"2024-01-30T08:09:53.887909+0000","last_active":"2024-01-30T08:10:11.905164+0000","last_peered":"2024-01-30T08:10:11.905164+0000","last_clean":"2024-01-30T08:10:11.905164+0000","last_became_active":"2024-01-30T08:09:53.887634+0000","last_became_peered":"2024-01-30T08:09:53.887634+0000","last_unstale":"2024-01-30T08:10:11.905164+0000","last_undegraded":"2024-01-30T08:10:11.905164+0000","last_fullsized":"2024-01-30T08:10:11.905164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:52.921864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896717+0000","last_change":"2024-01-30T08:09:53.883502+0000","last_active":"2024-01-30T08:10:11.896717+0000","last_peered":"2024-01-30T08:10:11.896717+0000","last_clean":"2024-01-30T08:10:11.896717+0000","last_became_active":"2024-01-30T08:09:53.883146+0000","last_became_peered":"2024-01-30T08:09:53.883146+0000","last_unstale":"2024-01-30T08:10:11.896717+0000","last_undegraded":"2024-01-30T08:10:11.896717+0000","last_fullsized":"2024-01-30T08:10:11.896717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:13.134749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896375+0000","last_change":"2024-01-30T08:09:53.883798+0000","last_active":"2024-01-30T08:10:11.896375+0000","last_peered":"2024-01-30T08:10:11.896375+0000","last_clean":"2024-01-30T08:10:11.896375+0000","last_became_active":"2024-01-30T08:09:53.883077+0000","last_became_peered":"2024-01-30T08:09:53.883077+0000","last_unstale":"2024-01-30T08:10:11.896375+0000","last_undegraded":"2024-01-30T08:10:11.896375+0000","last_fullsized":"2024-01-30T08:10:11.896375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:40.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903225+0000","last_change":"2024-01-30T08:09:53.880237+0000","last_active":"2024-01-30T08:10:11.903225+0000","last_peered":"2024-01-30T08:10:11.903225+0000","last_clean":"2024-01-30T08:10:11.903225+0000","last_became_active":"2024-01-30T08:09:53.879920+0000","last_became_peered":"2024-01-30T08:09:53.879920+0000","last_unstale":"2024-01-30T08:10:11.903225+0000","last_undegraded":"2024-01-30T08:10:11.903225+0000","last_fullsized":"2024-01-30T08:10:11.903225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:31:19.905033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930126+0000","last_change":"2024-01-30T08:10:11.928221+0000","last_active":"2024-01-30T08:10:11.930126+0000","last_peered":"2024-01-30T08:10:11.930126+0000","last_clean":"2024-01-30T08:10:11.930126+0000","last_became_active":"2024-01-30T08:10:11.924922+0000","last_became_peered":"2024-01-30T08:10:11.924922+0000","last_unstale":"2024-01-30T08:10:11.930126+0000","last_undegraded":"2024-01-30T08:10:11.930126+0000","last_fullsized":"2024-01-30T08:10:11.930126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893343+0000","last_change":"2024-01-30T08:09:53.879036+0000","last_active":"2024-01-30T08:10:11.893343+0000","last_peered":"2024-01-30T08:10:11.893343+0000","last_clean":"2024-01-30T08:10:11.893343+0000","last_became_active":"2024-01-30T08:09:53.878757+0000","last_became_peered":"2024-01-30T08:09:53.878757+0000","last_unstale":"2024-01-30T08:10:11.893343+0000","last_undegraded":"2024-01-30T08:10:11.893343+0000","last_fullsized":"2024-01-30T08:10:11.893343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:32:50.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876211+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:10:09.876211+0000","last_peered":"2024-01-30T08:10:09.876211+0000","last_clean":"2024-01-30T08:10:09.876211+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:10:09.876211+0000","last_undegraded":"2024-01-30T08:10:09.876211+0000","last_fullsized":"2024-01-30T08:10:09.876211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893908+0000","last_change":"2024-01-30T08:09:53.886393+0000","last_active":"2024-01-30T08:10:11.893908+0000","last_peered":"2024-01-30T08:10:11.893908+0000","last_clean":"2024-01-30T08:10:11.893908+0000","last_became_active":"2024-01-30T08:09:53.881749+0000","last_became_peered":"2024-01-30T08:09:53.881749+0000","last_unstale":"2024-01-30T08:10:11.893908+0000","last_undegraded":"2024-01-30T08:10:11.893908+0000","last_fullsized":"2024-01-30T08:10:11.893908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:22.523025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882884+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:10:09.882884+0000","last_peered":"2024-01-30T08:10:09.882884+0000","last_clean":"2024-01-30T08:10:09.882884+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:10:09.882884+0000","last_undegraded":"2024-01-30T08:10:09.882884+0000","last_fullsized":"2024-01-30T08:10:09.882884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.934707+0000","last_change":"2024-01-30T08:10:11.931335+0000","last_active":"2024-01-30T08:10:11.934707+0000","last_peered":"2024-01-30T08:10:11.934707+0000","last_clean":"2024-01-30T08:10:11.934707+0000","last_became_active":"2024-01-30T08:10:11.931065+0000","last_became_peered":"2024-01-30T08:10:11.931065+0000","last_unstale":"2024-01-30T08:10:11.934707+0000","last_undegraded":"2024-01-30T08:10:11.934707+0000","last_fullsized":"2024-01-30T08:10:11.934707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884985+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:10:09.884985+0000","last_peered":"2024-01-30T08:10:09.884985+0000","last_clean":"2024-01-30T08:10:09.884985+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:10:09.884985+0000","last_undegraded":"2024-01-30T08:10:09.884985+0000","last_fullsized":"2024-01-30T08:10:09.884985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925741+0000","last_change":"2024-01-30T08:10:11.911805+0000","last_active":"2024-01-30T08:10:11.925741+0000","last_peered":"2024-01-30T08:10:11.925741+0000","last_clean":"2024-01-30T08:10:11.925741+0000","last_became_active":"2024-01-30T08:10:11.911191+0000","last_became_peered":"2024-01-30T08:10:11.911191+0000","last_unstale":"2024-01-30T08:10:11.925741+0000","last_undegraded":"2024-01-30T08:10:11.925741+0000","last_fullsized":"2024-01-30T08:10:11.925741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875392+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:10:09.875392+0000","last_peered":"2024-01-30T08:10:09.875392+0000","last_clean":"2024-01-30T08:10:09.875392+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:10:09.875392+0000","last_undegraded":"2024-01-30T08:10:09.875392+0000","last_fullsized":"2024-01-30T08:10:09.875392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914789+0000","last_change":"2024-01-30T08:10:11.908732+0000","last_active":"2024-01-30T08:10:11.914789+0000","last_peered":"2024-01-30T08:10:11.914789+0000","last_clean":"2024-01-30T08:10:11.914789+0000","last_became_active":"2024-01-30T08:10:11.908460+0000","last_became_peered":"2024-01-30T08:10:11.908460+0000","last_unstale":"2024-01-30T08:10:11.914789+0000","last_undegraded":"2024-01-30T08:10:11.914789+0000","last_fullsized":"2024-01-30T08:10:11.914789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:57:12.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879678+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:10:09.879678+0000","last_peered":"2024-01-30T08:10:09.879678+0000","last_clean":"2024-01-30T08:10:09.879678+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:10:09.879678+0000","last_undegraded":"2024-01-30T08:10:09.879678+0000","last_fullsized":"2024-01-30T08:10:09.879678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875311+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:10:09.875311+0000","last_peered":"2024-01-30T08:10:09.875311+0000","last_clean":"2024-01-30T08:10:09.875311+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:10:09.875311+0000","last_undegraded":"2024-01-30T08:10:09.875311+0000","last_fullsized":"2024-01-30T08:10:09.875311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893439+0000","last_change":"2024-01-30T08:09:53.884047+0000","last_active":"2024-01-30T08:10:11.893439+0000","last_peered":"2024-01-30T08:10:11.893439+0000","last_clean":"2024-01-30T08:10:11.893439+0000","last_became_active":"2024-01-30T08:09:53.883765+0000","last_became_peered":"2024-01-30T08:09:53.883765+0000","last_unstale":"2024-01-30T08:10:11.893439+0000","last_undegraded":"2024-01-30T08:10:11.893439+0000","last_fullsized":"2024-01-30T08:10:11.893439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:54:01.174660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874229+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:10:09.874229+0000","last_peered":"2024-01-30T08:10:09.874229+0000","last_clean":"2024-01-30T08:10:09.874229+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:10:09.874229+0000","last_undegraded":"2024-01-30T08:10:09.874229+0000","last_fullsized":"2024-01-30T08:10:09.874229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924123+0000","last_change":"2024-01-30T08:10:11.917501+0000","last_active":"2024-01-30T08:10:11.924123+0000","last_peered":"2024-01-30T08:10:11.924123+0000","last_clean":"2024-01-30T08:10:11.924123+0000","last_became_active":"2024-01-30T08:10:11.917148+0000","last_became_peered":"2024-01-30T08:10:11.917148+0000","last_unstale":"2024-01-30T08:10:11.924123+0000","last_undegraded":"2024-01-30T08:10:11.924123+0000","last_fullsized":"2024-01-30T08:10:11.924123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:27.639415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883277+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:10:09.883277+0000","last_peered":"2024-01-30T08:10:09.883277+0000","last_clean":"2024-01-30T08:10:09.883277+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:10:09.883277+0000","last_undegraded":"2024-01-30T08:10:09.883277+0000","last_fullsized":"2024-01-30T08:10:09.883277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:00.220792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878429+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:10:09.878429+0000","last_peered":"2024-01-30T08:10:09.878429+0000","last_clean":"2024-01-30T08:10:09.878429+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:10:09.878429+0000","last_undegraded":"2024-01-30T08:10:09.878429+0000","last_fullsized":"2024-01-30T08:10:09.878429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:22.789462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875514+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:10:09.875514+0000","last_peered":"2024-01-30T08:10:09.875514+0000","last_clean":"2024-01-30T08:10:09.875514+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:10:09.875514+0000","last_undegraded":"2024-01-30T08:10:09.875514+0000","last_fullsized":"2024-01-30T08:10:09.875514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924583+0000","last_change":"2024-01-30T08:10:11.916385+0000","last_active":"2024-01-30T08:10:11.924583+0000","last_peered":"2024-01-30T08:10:11.924583+0000","last_clean":"2024-01-30T08:10:11.924583+0000","last_became_active":"2024-01-30T08:10:11.915981+0000","last_became_peered":"2024-01-30T08:10:11.915981+0000","last_unstale":"2024-01-30T08:10:11.924583+0000","last_undegraded":"2024-01-30T08:10:11.924583+0000","last_fullsized":"2024-01-30T08:10:11.924583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:27.251561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879137+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:10:09.879137+0000","last_peered":"2024-01-30T08:10:09.879137+0000","last_clean":"2024-01-30T08:10:09.879137+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:10:09.879137+0000","last_undegraded":"2024-01-30T08:10:09.879137+0000","last_fullsized":"2024-01-30T08:10:09.879137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875394+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:10:09.875394+0000","last_peered":"2024-01-30T08:10:09.875394+0000","last_clean":"2024-01-30T08:10:09.875394+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:10:09.875394+0000","last_undegraded":"2024-01-30T08:10:09.875394+0000","last_fullsized":"2024-01-30T08:10:09.875394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.895972+0000","last_change":"2024-01-30T08:09:53.881127+0000","last_active":"2024-01-30T08:10:11.895972+0000","last_peered":"2024-01-30T08:10:11.895972+0000","last_clean":"2024-01-30T08:10:11.895972+0000","last_became_active":"2024-01-30T08:09:53.880821+0000","last_became_peered":"2024-01-30T08:09:53.880821+0000","last_unstale":"2024-01-30T08:10:11.895972+0000","last_undegraded":"2024-01-30T08:10:11.895972+0000","last_fullsized":"2024-01-30T08:10:11.895972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:34:00.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925958+0000","last_change":"2024-01-30T08:10:11.916154+0000","last_active":"2024-01-30T08:10:11.925958+0000","last_peered":"2024-01-30T08:10:11.925958+0000","last_clean":"2024-01-30T08:10:11.925958+0000","last_became_active":"2024-01-30T08:10:11.915888+0000","last_became_peered":"2024-01-30T08:10:11.915888+0000","last_unstale":"2024-01-30T08:10:11.925958+0000","last_undegraded":"2024-01-30T08:10:11.925958+0000","last_fullsized":"2024-01-30T08:10:11.925958+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:07:31.431470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875212+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:10:09.875212+0000","last_peered":"2024-01-30T08:10:09.875212+0000","last_clean":"2024-01-30T08:10:09.875212+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:10:09.875212+0000","last_undegraded":"2024-01-30T08:10:09.875212+0000","last_fullsized":"2024-01-30T08:10:09.875212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875028+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:10:09.875028+0000","last_peered":"2024-01-30T08:10:09.875028+0000","last_clean":"2024-01-30T08:10:09.875028+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:10:09.875028+0000","last_undegraded":"2024-01-30T08:10:09.875028+0000","last_fullsized":"2024-01-30T08:10:09.875028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917333+0000","last_change":"2024-01-30T08:10:11.910891+0000","last_active":"2024-01-30T08:10:11.917333+0000","last_peered":"2024-01-30T08:10:11.917333+0000","last_clean":"2024-01-30T08:10:11.917333+0000","last_became_active":"2024-01-30T08:10:11.910551+0000","last_became_peered":"2024-01-30T08:10:11.910551+0000","last_unstale":"2024-01-30T08:10:11.917333+0000","last_undegraded":"2024-01-30T08:10:11.917333+0000","last_fullsized":"2024-01-30T08:10:11.917333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:48:29.533666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883437+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:10:09.883437+0000","last_peered":"2024-01-30T08:10:09.883437+0000","last_clean":"2024-01-30T08:10:09.883437+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:10:09.883437+0000","last_undegraded":"2024-01-30T08:10:09.883437+0000","last_fullsized":"2024-01-30T08:10:09.883437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878428+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:10:09.878428+0000","last_peered":"2024-01-30T08:10:09.878428+0000","last_clean":"2024-01-30T08:10:09.878428+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:10:09.878428+0000","last_undegraded":"2024-01-30T08:10:09.878428+0000","last_fullsized":"2024-01-30T08:10:09.878428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877696+0000","last_change":"2024-01-30T08:10:09.877696+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877696+0000","last_undegraded":"2024-01-30T08:10:09.877696+0000","last_fullsized":"2024-01-30T08:10:09.877696+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884837+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:10:09.884837+0000","last_peered":"2024-01-30T08:10:09.884837+0000","last_clean":"2024-01-30T08:10:09.884837+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:10:09.884837+0000","last_undegraded":"2024-01-30T08:10:09.884837+0000","last_fullsized":"2024-01-30T08:10:09.884837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875612+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:10:09.875612+0000","last_peered":"2024-01-30T08:10:09.875612+0000","last_clean":"2024-01-30T08:10:09.875612+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:10:09.875612+0000","last_undegraded":"2024-01-30T08:10:09.875612+0000","last_fullsized":"2024-01-30T08:10:09.875612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.926426+0000","last_change":"2024-01-30T08:10:10.907010+0000","last_active":"2024-01-30T08:10:11.926426+0000","last_peered":"2024-01-30T08:10:11.926426+0000","last_clean":"2024-01-30T08:10:11.926426+0000","last_became_active":"2024-01-30T08:10:10.906670+0000","last_became_peered":"2024-01-30T08:10:10.906670+0000","last_unstale":"2024-01-30T08:10:11.926426+0000","last_undegraded":"2024-01-30T08:10:11.926426+0000","last_fullsized":"2024-01-30T08:10:11.926426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:26.246384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879198+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:10:09.879198+0000","last_peered":"2024-01-30T08:10:09.879198+0000","last_clean":"2024-01-30T08:10:09.879198+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:10:09.879198+0000","last_undegraded":"2024-01-30T08:10:09.879198+0000","last_fullsized":"2024-01-30T08:10:09.879198+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905509+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:10:11.905509+0000","last_peered":"2024-01-30T08:10:11.905509+0000","last_clean":"2024-01-30T08:10:11.905509+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:10:11.905509+0000","last_undegraded":"2024-01-30T08:10:11.905509+0000","last_fullsized":"2024-01-30T08:10:11.905509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874376+0000","last_change":"2024-01-30T08:10:09.874376+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874376+0000","last_undegraded":"2024-01-30T08:10:09.874376+0000","last_fullsized":"2024-01-30T08:10:09.874376+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877175+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:10:09.877175+0000","last_peered":"2024-01-30T08:10:09.877175+0000","last_clean":"2024-01-30T08:10:09.877175+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:10:09.877175+0000","last_undegraded":"2024-01-30T08:10:09.877175+0000","last_fullsized":"2024-01-30T08:10:09.877175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879337+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:10:09.879337+0000","last_peered":"2024-01-30T08:10:09.879337+0000","last_clean":"2024-01-30T08:10:09.879337+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:10:09.879337+0000","last_undegraded":"2024-01-30T08:10:09.879337+0000","last_fullsized":"2024-01-30T08:10:09.879337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929867+0000","last_change":"2024-01-30T08:10:11.928520+0000","last_active":"2024-01-30T08:10:11.929867+0000","last_peered":"2024-01-30T08:10:11.929867+0000","last_clean":"2024-01-30T08:10:11.929867+0000","last_became_active":"2024-01-30T08:10:11.927399+0000","last_became_peered":"2024-01-30T08:10:11.927399+0000","last_unstale":"2024-01-30T08:10:11.929867+0000","last_undegraded":"2024-01-30T08:10:11.929867+0000","last_fullsized":"2024-01-30T08:10:11.929867+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.878291+0000","last_change":"2024-01-30T08:10:09.878291+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.878291+0000","last_undegraded":"2024-01-30T08:10:09.878291+0000","last_fullsized":"2024-01-30T08:10:09.878291+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873259+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:10:09.873259+0000","last_peered":"2024-01-30T08:10:09.873259+0000","last_clean":"2024-01-30T08:10:09.873259+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:10:09.873259+0000","last_undegraded":"2024-01-30T08:10:09.873259+0000","last_fullsized":"2024-01-30T08:10:09.873259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876778+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:10:09.876778+0000","last_peered":"2024-01-30T08:10:09.876778+0000","last_clean":"2024-01-30T08:10:09.876778+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:10:09.876778+0000","last_undegraded":"2024-01-30T08:10:09.876778+0000","last_fullsized":"2024-01-30T08:10:09.876778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873017+0000","last_change":"2024-01-30T08:10:09.873017+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873017+0000","last_undegraded":"2024-01-30T08:10:09.873017+0000","last_fullsized":"2024-01-30T08:10:09.873017+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901991+0000","last_change":"2024-01-30T08:09:53.881438+0000","last_active":"2024-01-30T08:10:11.901991+0000","last_peered":"2024-01-30T08:10:11.901991+0000","last_clean":"2024-01-30T08:10:11.901991+0000","last_became_active":"2024-01-30T08:09:53.881166+0000","last_became_peered":"2024-01-30T08:09:53.881166+0000","last_unstale":"2024-01-30T08:10:11.901991+0000","last_undegraded":"2024-01-30T08:10:11.901991+0000","last_fullsized":"2024-01-30T08:10:11.901991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:37.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893536+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:10:11.893536+0000","last_peered":"2024-01-30T08:10:11.893536+0000","last_clean":"2024-01-30T08:10:11.893536+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:10:11.893536+0000","last_undegraded":"2024-01-30T08:10:11.893536+0000","last_fullsized":"2024-01-30T08:10:11.893536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:43.172388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902051+0000","last_change":"2024-01-30T08:10:10.905030+0000","last_active":"2024-01-30T08:10:11.902051+0000","last_peered":"2024-01-30T08:10:11.902051+0000","last_clean":"2024-01-30T08:10:11.902051+0000","last_became_active":"2024-01-30T08:10:10.901186+0000","last_became_peered":"2024-01-30T08:10:10.901186+0000","last_unstale":"2024-01-30T08:10:11.902051+0000","last_undegraded":"2024-01-30T08:10:11.902051+0000","last_fullsized":"2024-01-30T08:10:11.902051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:30.092942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.894010+0000","last_change":"2024-01-30T08:09:53.881466+0000","last_active":"2024-01-30T08:10:11.894010+0000","last_peered":"2024-01-30T08:10:11.894010+0000","last_clean":"2024-01-30T08:10:11.894010+0000","last_became_active":"2024-01-30T08:09:53.880847+0000","last_became_peered":"2024-01-30T08:09:53.880847+0000","last_unstale":"2024-01-30T08:10:11.894010+0000","last_undegraded":"2024-01-30T08:10:11.894010+0000","last_fullsized":"2024-01-30T08:10:11.894010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:24:30.424249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883933+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:10:09.883933+0000","last_peered":"2024-01-30T08:10:09.883933+0000","last_clean":"2024-01-30T08:10:09.883933+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:10:09.883933+0000","last_undegraded":"2024-01-30T08:10:09.883933+0000","last_fullsized":"2024-01-30T08:10:09.883933+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.938380+0000","last_change":"2024-01-30T08:10:10.903517+0000","last_active":"2024-01-30T08:10:11.938380+0000","last_peered":"2024-01-30T08:10:11.938380+0000","last_clean":"2024-01-30T08:10:11.938380+0000","last_became_active":"2024-01-30T08:10:10.903251+0000","last_became_peered":"2024-01-30T08:10:10.903251+0000","last_unstale":"2024-01-30T08:10:11.938380+0000","last_undegraded":"2024-01-30T08:10:11.938380+0000","last_fullsized":"2024-01-30T08:10:11.938380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:26.792702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876885+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:10:09.876885+0000","last_peered":"2024-01-30T08:10:09.876885+0000","last_clean":"2024-01-30T08:10:09.876885+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:10:09.876885+0000","last_undegraded":"2024-01-30T08:10:09.876885+0000","last_fullsized":"2024-01-30T08:10:09.876885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878586+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:10:09.878586+0000","last_peered":"2024-01-30T08:10:09.878586+0000","last_clean":"2024-01-30T08:10:09.878586+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:10:09.878586+0000","last_undegraded":"2024-01-30T08:10:09.878586+0000","last_fullsized":"2024-01-30T08:10:09.878586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873024+0000","last_change":"2024-01-30T08:10:09.873024+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873024+0000","last_undegraded":"2024-01-30T08:10:09.873024+0000","last_fullsized":"2024-01-30T08:10:09.873024+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873366+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:10:09.873366+0000","last_peered":"2024-01-30T08:10:09.873366+0000","last_clean":"2024-01-30T08:10:09.873366+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:10:09.873366+0000","last_undegraded":"2024-01-30T08:10:09.873366+0000","last_fullsized":"2024-01-30T08:10:09.873366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874049+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:10:09.874049+0000","last_peered":"2024-01-30T08:10:09.874049+0000","last_clean":"2024-01-30T08:10:09.874049+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:10:09.874049+0000","last_undegraded":"2024-01-30T08:10:09.874049+0000","last_fullsized":"2024-01-30T08:10:09.874049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914866+0000","last_change":"2024-01-30T08:10:11.909037+0000","last_active":"2024-01-30T08:10:11.914866+0000","last_peered":"2024-01-30T08:10:11.914866+0000","last_clean":"2024-01-30T08:10:11.914866+0000","last_became_active":"2024-01-30T08:10:11.908779+0000","last_became_peered":"2024-01-30T08:10:11.908779+0000","last_unstale":"2024-01-30T08:10:11.914866+0000","last_undegraded":"2024-01-30T08:10:11.914866+0000","last_fullsized":"2024-01-30T08:10:11.914866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:09.368965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.882394+0000","last_change":"2024-01-30T08:10:09.882394+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.882394+0000","last_undegraded":"2024-01-30T08:10:09.882394+0000","last_fullsized":"2024-01-30T08:10:09.882394+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877623+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:10:09.877623+0000","last_peered":"2024-01-30T08:10:09.877623+0000","last_clean":"2024-01-30T08:10:09.877623+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:10:09.877623+0000","last_undegraded":"2024-01-30T08:10:09.877623+0000","last_fullsized":"2024-01-30T08:10:09.877623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:23.401989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873363+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:10:09.873363+0000","last_peered":"2024-01-30T08:10:09.873363+0000","last_clean":"2024-01-30T08:10:09.873363+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:10:09.873363+0000","last_undegraded":"2024-01-30T08:10:09.873363+0000","last_fullsized":"2024-01-30T08:10:09.873363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874771+0000","last_change":"2024-01-30T08:10:09.874771+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874771+0000","last_undegraded":"2024-01-30T08:10:09.874771+0000","last_fullsized":"2024-01-30T08:10:09.874771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882655+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:10:09.882655+0000","last_peered":"2024-01-30T08:10:09.882655+0000","last_clean":"2024-01-30T08:10:09.882655+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:10:09.882655+0000","last_undegraded":"2024-01-30T08:10:09.882655+0000","last_fullsized":"2024-01-30T08:10:09.882655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:00:52.172429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896891+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:10:11.896891+0000","last_peered":"2024-01-30T08:10:11.896891+0000","last_clean":"2024-01-30T08:10:11.896891+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:10:11.896891+0000","last_undegraded":"2024-01-30T08:10:11.896891+0000","last_fullsized":"2024-01-30T08:10:11.896891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:37.710856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881839+0000","last_change":"2024-01-30T08:10:09.881839+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881839+0000","last_undegraded":"2024-01-30T08:10:09.881839+0000","last_fullsized":"2024-01-30T08:10:09.881839+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905233+0000","last_change":"2024-01-30T08:09:53.883329+0000","last_active":"2024-01-30T08:10:11.905233+0000","last_peered":"2024-01-30T08:10:11.905233+0000","last_clean":"2024-01-30T08:10:11.905233+0000","last_became_active":"2024-01-30T08:09:53.881025+0000","last_became_peered":"2024-01-30T08:09:53.881025+0000","last_unstale":"2024-01-30T08:10:11.905233+0000","last_undegraded":"2024-01-30T08:10:11.905233+0000","last_fullsized":"2024-01-30T08:10:11.905233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:38.717964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896458+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:10:11.896458+0000","last_peered":"2024-01-30T08:10:11.896458+0000","last_clean":"2024-01-30T08:10:11.896458+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:10:11.896458+0000","last_undegraded":"2024-01-30T08:10:11.896458+0000","last_fullsized":"2024-01-30T08:10:11.896458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:51.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.920942+0000","last_change":"2024-01-30T08:10:11.914923+0000","last_active":"2024-01-30T08:10:11.920942+0000","last_peered":"2024-01-30T08:10:11.920942+0000","last_clean":"2024-01-30T08:10:11.920942+0000","last_became_active":"2024-01-30T08:10:11.914536+0000","last_became_peered":"2024-01-30T08:10:11.914536+0000","last_unstale":"2024-01-30T08:10:11.920942+0000","last_undegraded":"2024-01-30T08:10:11.920942+0000","last_fullsized":"2024-01-30T08:10:11.920942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873057+0000","last_change":"2024-01-30T08:10:09.873057+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873057+0000","last_undegraded":"2024-01-30T08:10:09.873057+0000","last_fullsized":"2024-01-30T08:10:09.873057+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875678+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:10:09.875678+0000","last_peered":"2024-01-30T08:10:09.875678+0000","last_clean":"2024-01-30T08:10:09.875678+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:10:09.875678+0000","last_undegraded":"2024-01-30T08:10:09.875678+0000","last_fullsized":"2024-01-30T08:10:09.875678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873288+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:10:09.873288+0000","last_peered":"2024-01-30T08:10:09.873288+0000","last_clean":"2024-01-30T08:10:09.873288+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:10:09.873288+0000","last_undegraded":"2024-01-30T08:10:09.873288+0000","last_fullsized":"2024-01-30T08:10:09.873288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881276+0000","last_change":"2024-01-30T08:10:09.881276+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881276+0000","last_undegraded":"2024-01-30T08:10:09.881276+0000","last_fullsized":"2024-01-30T08:10:09.881276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902146+0000","last_change":"2024-01-30T08:09:53.889988+0000","last_active":"2024-01-30T08:10:11.902146+0000","last_peered":"2024-01-30T08:10:11.902146+0000","last_clean":"2024-01-30T08:10:11.902146+0000","last_became_active":"2024-01-30T08:09:53.888579+0000","last_became_peered":"2024-01-30T08:09:53.888579+0000","last_unstale":"2024-01-30T08:10:11.902146+0000","last_undegraded":"2024-01-30T08:10:11.902146+0000","last_fullsized":"2024-01-30T08:10:11.902146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:01:50.624934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873359+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:10:09.873359+0000","last_peered":"2024-01-30T08:10:09.873359+0000","last_clean":"2024-01-30T08:10:09.873359+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:10:09.873359+0000","last_undegraded":"2024-01-30T08:10:09.873359+0000","last_fullsized":"2024-01-30T08:10:09.873359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917315+0000","last_change":"2024-01-30T08:10:11.910494+0000","last_active":"2024-01-30T08:10:11.917315+0000","last_peered":"2024-01-30T08:10:11.917315+0000","last_clean":"2024-01-30T08:10:11.917315+0000","last_became_active":"2024-01-30T08:10:11.910244+0000","last_became_peered":"2024-01-30T08:10:11.910244+0000","last_unstale":"2024-01-30T08:10:11.917315+0000","last_undegraded":"2024-01-30T08:10:11.917315+0000","last_fullsized":"2024-01-30T08:10:11.917315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:10:01.141484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874758+0000","last_change":"2024-01-30T08:10:09.874758+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874758+0000","last_undegraded":"2024-01-30T08:10:09.874758+0000","last_fullsized":"2024-01-30T08:10:09.874758+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873030+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:10:09.873030+0000","last_peered":"2024-01-30T08:10:09.873030+0000","last_clean":"2024-01-30T08:10:09.873030+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:10:09.873030+0000","last_undegraded":"2024-01-30T08:10:09.873030+0000","last_fullsized":"2024-01-30T08:10:09.873030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878696+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:10:09.878696+0000","last_peered":"2024-01-30T08:10:09.878696+0000","last_clean":"2024-01-30T08:10:09.878696+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:10:09.878696+0000","last_undegraded":"2024-01-30T08:10:09.878696+0000","last_fullsized":"2024-01-30T08:10:09.878696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.928340+0000","last_change":"2024-01-30T08:10:11.926413+0000","last_active":"2024-01-30T08:10:11.928340+0000","last_peered":"2024-01-30T08:10:11.928340+0000","last_clean":"2024-01-30T08:10:11.928340+0000","last_became_active":"2024-01-30T08:10:11.926117+0000","last_became_peered":"2024-01-30T08:10:11.926117+0000","last_unstale":"2024-01-30T08:10:11.928340+0000","last_undegraded":"2024-01-30T08:10:11.928340+0000","last_fullsized":"2024-01-30T08:10:11.928340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.935402+0000","last_change":"2024-01-30T08:10:10.908780+0000","last_active":"2024-01-30T08:10:11.935402+0000","last_peered":"2024-01-30T08:10:11.935402+0000","last_clean":"2024-01-30T08:10:11.935402+0000","last_became_active":"2024-01-30T08:10:10.907095+0000","last_became_peered":"2024-01-30T08:10:10.907095+0000","last_unstale":"2024-01-30T08:10:11.935402+0000","last_undegraded":"2024-01-30T08:10:11.935402+0000","last_fullsized":"2024-01-30T08:10:11.935402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:58.832681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883795+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:10:09.883795+0000","last_peered":"2024-01-30T08:10:09.883795+0000","last_clean":"2024-01-30T08:10:09.883795+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:10:09.883795+0000","last_undegraded":"2024-01-30T08:10:09.883795+0000","last_fullsized":"2024-01-30T08:10:09.883795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874854+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:10:09.874854+0000","last_peered":"2024-01-30T08:10:09.874854+0000","last_clean":"2024-01-30T08:10:09.874854+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:10:09.874854+0000","last_undegraded":"2024-01-30T08:10:09.874854+0000","last_fullsized":"2024-01-30T08:10:09.874854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930107+0000","last_change":"2024-01-30T08:10:11.919713+0000","last_active":"2024-01-30T08:10:11.930107+0000","last_peered":"2024-01-30T08:10:11.930107+0000","last_clean":"2024-01-30T08:10:11.930107+0000","last_became_active":"2024-01-30T08:10:11.919423+0000","last_became_peered":"2024-01-30T08:10:11.919423+0000","last_unstale":"2024-01-30T08:10:11.930107+0000","last_undegraded":"2024-01-30T08:10:11.930107+0000","last_fullsized":"2024-01-30T08:10:11.930107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873059+0000","last_change":"2024-01-30T08:10:09.873059+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873059+0000","last_undegraded":"2024-01-30T08:10:09.873059+0000","last_fullsized":"2024-01-30T08:10:09.873059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873018+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:10:09.873018+0000","last_peered":"2024-01-30T08:10:09.873018+0000","last_clean":"2024-01-30T08:10:09.873018+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:10:09.873018+0000","last_undegraded":"2024-01-30T08:10:09.873018+0000","last_fullsized":"2024-01-30T08:10:09.873018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":24,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883006+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:10:09.883006+0000","last_peered":"2024-01-30T08:10:09.883006+0000","last_clean":"2024-01-30T08:10:09.883006+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:10:09.883006+0000","last_undegraded":"2024-01-30T08:10:09.883006+0000","last_fullsized":"2024-01-30T08:10:09.883006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873701+0000","last_change":"2024-01-30T08:10:09.873701+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873701+0000","last_undegraded":"2024-01-30T08:10:09.873701+0000","last_fullsized":"2024-01-30T08:10:09.873701+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873080+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:10:09.873080+0000","last_peered":"2024-01-30T08:10:09.873080+0000","last_clean":"2024-01-30T08:10:09.873080+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:10:09.873080+0000","last_undegraded":"2024-01-30T08:10:09.873080+0000","last_fullsized":"2024-01-30T08:10:09.873080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897197+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:10:11.897197+0000","last_peered":"2024-01-30T08:10:11.897197+0000","last_clean":"2024-01-30T08:10:11.897197+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:10:11.897197+0000","last_undegraded":"2024-01-30T08:10:11.897197+0000","last_fullsized":"2024-01-30T08:10:11.897197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:36.960284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873089+0000","last_change":"2024-01-30T08:10:09.873089+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873089+0000","last_undegraded":"2024-01-30T08:10:09.873089+0000","last_fullsized":"2024-01-30T08:10:09.873089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896361+0000","last_change":"2024-01-30T08:09:53.883122+0000","last_active":"2024-01-30T08:10:11.896361+0000","last_peered":"2024-01-30T08:10:11.896361+0000","last_clean":"2024-01-30T08:10:11.896361+0000","last_became_active":"2024-01-30T08:09:53.882631+0000","last_became_peered":"2024-01-30T08:09:53.882631+0000","last_unstale":"2024-01-30T08:10:11.896361+0000","last_undegraded":"2024-01-30T08:10:11.896361+0000","last_fullsized":"2024-01-30T08:10:11.896361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:41.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877245+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:10:09.877245+0000","last_peered":"2024-01-30T08:10:09.877245+0000","last_clean":"2024-01-30T08:10:09.877245+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:10:09.877245+0000","last_undegraded":"2024-01-30T08:10:09.877245+0000","last_fullsized":"2024-01-30T08:10:09.877245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.936401+0000","last_change":"2024-01-30T08:10:10.912271+0000","last_active":"2024-01-30T08:10:11.936401+0000","last_peered":"2024-01-30T08:10:11.936401+0000","last_clean":"2024-01-30T08:10:11.936401+0000","last_became_active":"2024-01-30T08:10:10.911787+0000","last_became_peered":"2024-01-30T08:10:10.911787+0000","last_unstale":"2024-01-30T08:10:11.936401+0000","last_undegraded":"2024-01-30T08:10:11.936401+0000","last_fullsized":"2024-01-30T08:10:11.936401+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:41:52.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877087+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:10:09.877087+0000","last_peered":"2024-01-30T08:10:09.877087+0000","last_clean":"2024-01-30T08:10:09.877087+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:10:09.877087+0000","last_undegraded":"2024-01-30T08:10:09.877087+0000","last_fullsized":"2024-01-30T08:10:09.877087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879701+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:10:09.879701+0000","last_peered":"2024-01-30T08:10:09.879701+0000","last_clean":"2024-01-30T08:10:09.879701+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:10:09.879701+0000","last_undegraded":"2024-01-30T08:10:09.879701+0000","last_fullsized":"2024-01-30T08:10:09.879701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.879403+0000","last_change":"2024-01-30T08:10:09.879403+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.879403+0000","last_undegraded":"2024-01-30T08:10:09.879403+0000","last_fullsized":"2024-01-30T08:10:09.879403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879866+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:10:09.879866+0000","last_peered":"2024-01-30T08:10:09.879866+0000","last_clean":"2024-01-30T08:10:09.879866+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:10:09.879866+0000","last_undegraded":"2024-01-30T08:10:09.879866+0000","last_fullsized":"2024-01-30T08:10:09.879866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878949+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:10:09.878949+0000","last_peered":"2024-01-30T08:10:09.878949+0000","last_clean":"2024-01-30T08:10:09.878949+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:10:09.878949+0000","last_undegraded":"2024-01-30T08:10:09.878949+0000","last_fullsized":"2024-01-30T08:10:09.878949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.916984+0000","last_change":"2024-01-30T08:10:11.912714+0000","last_active":"2024-01-30T08:10:11.916984+0000","last_peered":"2024-01-30T08:10:11.916984+0000","last_clean":"2024-01-30T08:10:11.916984+0000","last_became_active":"2024-01-30T08:10:11.912428+0000","last_became_peered":"2024-01-30T08:10:11.912428+0000","last_unstale":"2024-01-30T08:10:11.916984+0000","last_undegraded":"2024-01-30T08:10:11.916984+0000","last_fullsized":"2024-01-30T08:10:11.916984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:37:00.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902543+0000","last_change":"2024-01-30T08:10:10.906011+0000","last_active":"2024-01-30T08:10:11.902543+0000","last_peered":"2024-01-30T08:10:11.902543+0000","last_clean":"2024-01-30T08:10:11.902543+0000","last_became_active":"2024-01-30T08:10:10.905777+0000","last_became_peered":"2024-01-30T08:10:10.905777+0000","last_unstale":"2024-01-30T08:10:11.902543+0000","last_undegraded":"2024-01-30T08:10:11.902543+0000","last_fullsized":"2024-01-30T08:10:11.902543+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:57.576769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883048+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:10:09.883048+0000","last_peered":"2024-01-30T08:10:09.883048+0000","last_clean":"2024-01-30T08:10:09.883048+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:10:09.883048+0000","last_undegraded":"2024-01-30T08:10:09.883048+0000","last_fullsized":"2024-01-30T08:10:09.883048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:13:20.247550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878832+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:10:09.878832+0000","last_peered":"2024-01-30T08:10:09.878832+0000","last_clean":"2024-01-30T08:10:09.878832+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:10:09.878832+0000","last_undegraded":"2024-01-30T08:10:09.878832+0000","last_fullsized":"2024-01-30T08:10:09.878832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877896+0000","last_change":"2024-01-30T08:10:09.877896+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877896+0000","last_undegraded":"2024-01-30T08:10:09.877896+0000","last_fullsized":"2024-01-30T08:10:09.877896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902434+0000","last_change":"2024-01-30T08:09:53.883346+0000","last_active":"2024-01-30T08:10:11.902434+0000","last_peered":"2024-01-30T08:10:11.902434+0000","last_clean":"2024-01-30T08:10:11.902434+0000","last_became_active":"2024-01-30T08:09:53.878878+0000","last_became_peered":"2024-01-30T08:09:53.878878+0000","last_unstale":"2024-01-30T08:10:11.902434+0000","last_undegraded":"2024-01-30T08:10:11.902434+0000","last_fullsized":"2024-01-30T08:10:11.902434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:52.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878361+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:10:09.878361+0000","last_peered":"2024-01-30T08:10:09.878361+0000","last_clean":"2024-01-30T08:10:09.878361+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:10:09.878361+0000","last_undegraded":"2024-01-30T08:10:09.878361+0000","last_fullsized":"2024-01-30T08:10:09.878361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925762+0000","last_change":"2024-01-30T08:10:11.913825+0000","last_active":"2024-01-30T08:10:11.925762+0000","last_peered":"2024-01-30T08:10:11.925762+0000","last_clean":"2024-01-30T08:10:11.925762+0000","last_became_active":"2024-01-30T08:10:11.913570+0000","last_became_peered":"2024-01-30T08:10:11.913570+0000","last_unstale":"2024-01-30T08:10:11.925762+0000","last_undegraded":"2024-01-30T08:10:11.925762+0000","last_fullsized":"2024-01-30T08:10:11.925762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.877813+0000","last_change":"2024-01-30T08:10:09.877813+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.877813+0000","last_undegraded":"2024-01-30T08:10:09.877813+0000","last_fullsized":"2024-01-30T08:10:09.877813+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893380+0000","last_change":"2024-01-30T08:09:53.886717+0000","last_active":"2024-01-30T08:10:11.893380+0000","last_peered":"2024-01-30T08:10:11.893380+0000","last_clean":"2024-01-30T08:10:11.893380+0000","last_became_active":"2024-01-30T08:09:53.884242+0000","last_became_peered":"2024-01-30T08:09:53.884242+0000","last_unstale":"2024-01-30T08:10:11.893380+0000","last_undegraded":"2024-01-30T08:10:11.893380+0000","last_fullsized":"2024-01-30T08:10:11.893380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:05.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883561+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:10:09.883561+0000","last_peered":"2024-01-30T08:10:09.883561+0000","last_clean":"2024-01-30T08:10:09.883561+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:10:09.883561+0000","last_undegraded":"2024-01-30T08:10:09.883561+0000","last_fullsized":"2024-01-30T08:10:09.883561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874726+0000","last_change":"2024-01-30T08:10:09.874726+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874726+0000","last_undegraded":"2024-01-30T08:10:09.874726+0000","last_fullsized":"2024-01-30T08:10:09.874726+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873145+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:10:09.873145+0000","last_peered":"2024-01-30T08:10:09.873145+0000","last_clean":"2024-01-30T08:10:09.873145+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:10:09.873145+0000","last_undegraded":"2024-01-30T08:10:09.873145+0000","last_fullsized":"2024-01-30T08:10:09.873145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878523+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:10:09.878523+0000","last_peered":"2024-01-30T08:10:09.878523+0000","last_clean":"2024-01-30T08:10:09.878523+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:10:09.878523+0000","last_undegraded":"2024-01-30T08:10:09.878523+0000","last_fullsized":"2024-01-30T08:10:09.878523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.881311+0000","last_change":"2024-01-30T08:10:09.881311+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.881311+0000","last_undegraded":"2024-01-30T08:10:09.881311+0000","last_fullsized":"2024-01-30T08:10:09.881311+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.878852+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:10:09.878852+0000","last_peered":"2024-01-30T08:10:09.878852+0000","last_clean":"2024-01-30T08:10:09.878852+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:10:09.878852+0000","last_undegraded":"2024-01-30T08:10:09.878852+0000","last_fullsized":"2024-01-30T08:10:09.878852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897331+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:10:11.897331+0000","last_peered":"2024-01-30T08:10:11.897331+0000","last_clean":"2024-01-30T08:10:11.897331+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:10:11.897331+0000","last_undegraded":"2024-01-30T08:10:11.897331+0000","last_fullsized":"2024-01-30T08:10:11.897331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:51.914756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902870+0000","last_change":"2024-01-30T08:10:10.901224+0000","last_active":"2024-01-30T08:10:11.902870+0000","last_peered":"2024-01-30T08:10:11.902870+0000","last_clean":"2024-01-30T08:10:11.902870+0000","last_became_active":"2024-01-30T08:10:10.900957+0000","last_became_peered":"2024-01-30T08:10:10.900957+0000","last_unstale":"2024-01-30T08:10:11.902870+0000","last_undegraded":"2024-01-30T08:10:11.902870+0000","last_fullsized":"2024-01-30T08:10:11.902870+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:23:17.774625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.882806+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:10:09.882806+0000","last_peered":"2024-01-30T08:10:09.882806+0000","last_clean":"2024-01-30T08:10:09.882806+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:10:09.882806+0000","last_undegraded":"2024-01-30T08:10:09.882806+0000","last_fullsized":"2024-01-30T08:10:09.882806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.879695+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:10:09.879695+0000","last_peered":"2024-01-30T08:10:09.879695+0000","last_clean":"2024-01-30T08:10:09.879695+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:10:09.879695+0000","last_undegraded":"2024-01-30T08:10:09.879695+0000","last_fullsized":"2024-01-30T08:10:09.879695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925721+0000","last_change":"2024-01-30T08:10:11.911523+0000","last_active":"2024-01-30T08:10:11.925721+0000","last_peered":"2024-01-30T08:10:11.925721+0000","last_clean":"2024-01-30T08:10:11.925721+0000","last_became_active":"2024-01-30T08:10:11.910812+0000","last_became_peered":"2024-01-30T08:10:11.910812+0000","last_unstale":"2024-01-30T08:10:11.925721+0000","last_undegraded":"2024-01-30T08:10:11.925721+0000","last_fullsized":"2024-01-30T08:10:11.925721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873933+0000","last_change":"2024-01-30T08:10:09.873933+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873933+0000","last_undegraded":"2024-01-30T08:10:09.873933+0000","last_fullsized":"2024-01-30T08:10:09.873933+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.873147+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:10:09.873147+0000","last_peered":"2024-01-30T08:10:09.873147+0000","last_clean":"2024-01-30T08:10:09.873147+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:10:09.873147+0000","last_undegraded":"2024-01-30T08:10:09.873147+0000","last_fullsized":"2024-01-30T08:10:09.873147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903990+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:10:11.903990+0000","last_peered":"2024-01-30T08:10:11.903990+0000","last_clean":"2024-01-30T08:10:11.903990+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:10:11.903990+0000","last_undegraded":"2024-01-30T08:10:11.903990+0000","last_fullsized":"2024-01-30T08:10:11.903990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:30:27.351725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930162+0000","last_change":"2024-01-30T08:10:11.925753+0000","last_active":"2024-01-30T08:10:11.930162+0000","last_peered":"2024-01-30T08:10:11.930162+0000","last_clean":"2024-01-30T08:10:11.930162+0000","last_became_active":"2024-01-30T08:10:11.925478+0000","last_became_peered":"2024-01-30T08:10:11.925478+0000","last_unstale":"2024-01-30T08:10:11.930162+0000","last_undegraded":"2024-01-30T08:10:11.930162+0000","last_fullsized":"2024-01-30T08:10:11.930162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873033+0000","last_change":"2024-01-30T08:10:09.873033+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873033+0000","last_undegraded":"2024-01-30T08:10:09.873033+0000","last_fullsized":"2024-01-30T08:10:09.873033+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902254+0000","last_change":"2024-01-30T08:09:53.882768+0000","last_active":"2024-01-30T08:10:11.902254+0000","last_peered":"2024-01-30T08:10:11.902254+0000","last_clean":"2024-01-30T08:10:11.902254+0000","last_became_active":"2024-01-30T08:09:53.882430+0000","last_became_peered":"2024-01-30T08:09:53.882430+0000","last_unstale":"2024-01-30T08:10:11.902254+0000","last_undegraded":"2024-01-30T08:10:11.902254+0000","last_fullsized":"2024-01-30T08:10:11.902254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:58.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903223+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:10:11.903223+0000","last_peered":"2024-01-30T08:10:11.903223+0000","last_clean":"2024-01-30T08:10:11.903223+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:10:11.903223+0000","last_undegraded":"2024-01-30T08:10:11.903223+0000","last_fullsized":"2024-01-30T08:10:11.903223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901534+0000","last_change":"2024-01-30T08:10:10.902200+0000","last_active":"2024-01-30T08:10:11.901534+0000","last_peered":"2024-01-30T08:10:11.901534+0000","last_clean":"2024-01-30T08:10:11.901534+0000","last_became_active":"2024-01-30T08:10:10.901913+0000","last_became_peered":"2024-01-30T08:10:10.901913+0000","last_unstale":"2024-01-30T08:10:11.901534+0000","last_undegraded":"2024-01-30T08:10:11.901534+0000","last_fullsized":"2024-01-30T08:10:11.901534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:26.634238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.877522+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:10:09.877522+0000","last_peered":"2024-01-30T08:10:09.877522+0000","last_clean":"2024-01-30T08:10:09.877522+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:10:09.877522+0000","last_undegraded":"2024-01-30T08:10:09.877522+0000","last_fullsized":"2024-01-30T08:10:09.877522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.875134+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:10:09.875134+0000","last_peered":"2024-01-30T08:10:09.875134+0000","last_clean":"2024-01-30T08:10:09.875134+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:10:09.875134+0000","last_undegraded":"2024-01-30T08:10:09.875134+0000","last_fullsized":"2024-01-30T08:10:09.875134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.932589+0000","last_change":"2024-01-30T08:10:11.919869+0000","last_active":"2024-01-30T08:10:11.932589+0000","last_peered":"2024-01-30T08:10:11.932589+0000","last_clean":"2024-01-30T08:10:11.932589+0000","last_became_active":"2024-01-30T08:10:11.916750+0000","last_became_peered":"2024-01-30T08:10:11.916750+0000","last_unstale":"2024-01-30T08:10:11.932589+0000","last_undegraded":"2024-01-30T08:10:11.932589+0000","last_fullsized":"2024-01-30T08:10:11.932589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.873952+0000","last_change":"2024-01-30T08:10:09.873952+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.873952+0000","last_undegraded":"2024-01-30T08:10:09.873952+0000","last_fullsized":"2024-01-30T08:10:09.873952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.876261+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:10:09.876261+0000","last_peered":"2024-01-30T08:10:09.876261+0000","last_clean":"2024-01-30T08:10:09.876261+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:10:09.876261+0000","last_undegraded":"2024-01-30T08:10:09.876261+0000","last_fullsized":"2024-01-30T08:10:09.876261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.874883+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:10:09.874883+0000","last_peered":"2024-01-30T08:10:09.874883+0000","last_clean":"2024-01-30T08:10:09.874883+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:10:09.874883+0000","last_undegraded":"2024-01-30T08:10:09.874883+0000","last_fullsized":"2024-01-30T08:10:09.874883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929748+0000","last_change":"2024-01-30T08:10:11.927980+0000","last_active":"2024-01-30T08:10:11.929748+0000","last_peered":"2024-01-30T08:10:11.929748+0000","last_clean":"2024-01-30T08:10:11.929748+0000","last_became_active":"2024-01-30T08:10:11.927664+0000","last_became_peered":"2024-01-30T08:10:11.927664+0000","last_unstale":"2024-01-30T08:10:11.929748+0000","last_undegraded":"2024-01-30T08:10:11.929748+0000","last_fullsized":"2024-01-30T08:10:11.929748+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-30T08:10:09.874006+0000","last_change":"2024-01-30T08:10:09.874006+0000","last_active":"2024-01-30T08:10:09.865232+0000","last_peered":"2024-01-30T08:10:09.865232+0000","last_clean":"2024-01-30T08:10:09.865232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:09.874006+0000","last_undegraded":"2024-01-30T08:10:09.874006+0000","last_fullsized":"2024-01-30T08:10:09.874006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.880736+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:10:09.880736+0000","last_peered":"2024-01-30T08:10:09.880736+0000","last_clean":"2024-01-30T08:10:09.880736+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:10:09.880736+0000","last_undegraded":"2024-01-30T08:10:09.880736+0000","last_fullsized":"2024-01-30T08:10:09.880736+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.872847+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:10:09.872847+0000","last_peered":"2024-01-30T08:10:09.872847+0000","last_clean":"2024-01-30T08:10:09.872847+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:10:09.872847+0000","last_undegraded":"2024-01-30T08:10:09.872847+0000","last_fullsized":"2024-01-30T08:10:09.872847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-30T08:10:10.870409+0000","last_change":"2024-01-30T08:10:10.870409+0000","last_active":"2024-01-30T08:10:10.870409+0000","last_peered":"2024-01-30T08:10:10.870409+0000","last_clean":"2024-01-30T08:10:10.870409+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-30T08:10:10.870409+0000","last_undegraded":"2024-01-30T08:10:10.870409+0000","last_fullsized":"2024-01-30T08:10:10.870409+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905453+0000","last_change":"2024-01-30T08:10:10.907159+0000","last_active":"2024-01-30T08:10:11.905453+0000","last_peered":"2024-01-30T08:10:11.905453+0000","last_clean":"2024-01-30T08:10:11.905453+0000","last_became_active":"2024-01-30T08:10:10.906711+0000","last_became_peered":"2024-01-30T08:10:10.906711+0000","last_unstale":"2024-01-30T08:10:11.905453+0000","last_undegraded":"2024-01-30T08:10:11.905453+0000","last_fullsized":"2024-01-30T08:10:11.905453+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:55:37.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897039+0000","last_change":"2024-01-30T08:09:53.893858+0000","last_active":"2024-01-30T08:10:11.897039+0000","last_peered":"2024-01-30T08:10:11.897039+0000","last_clean":"2024-01-30T08:10:11.897039+0000","last_became_active":"2024-01-30T08:09:53.893613+0000","last_became_peered":"2024-01-30T08:09:53.893613+0000","last_unstale":"2024-01-30T08:10:11.897039+0000","last_undegraded":"2024-01-30T08:10:11.897039+0000","last_fullsized":"2024-01-30T08:10:11.897039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:09.834509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.884932+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:10:09.884932+0000","last_peered":"2024-01-30T08:10:09.884932+0000","last_clean":"2024-01-30T08:10:09.884932+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:10:09.884932+0000","last_undegraded":"2024-01-30T08:10:09.884932+0000","last_fullsized":"2024-01-30T08:10:09.884932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-01-30T08:10:09.883122+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:09.883122+0000","last_peered":"2024-01-30T08:10:09.883122+0000","last_clean":"2024-01-30T08:10:09.883122+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:09.883122+0000","last_undegraded":"2024-01-30T08:10:09.883122+0000","last_fullsized":"2024-01-30T08:10:09.883122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":528384,"data_stored":785498,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.69699999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.436},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65600000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":192535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59199999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.747},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.73099999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":192557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.84999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":462848,"data_stored":195094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.502}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67900000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":199014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.373}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.497}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":192043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.318},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.39500000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.436},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.47399999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.629}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":214459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53500000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":804805,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.499}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.372}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.621}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2024-01-30T08:10:16.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.877696+0000', 'last_change': '2024-01-30T08:10:09.877696+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.877696+0000', 'last_undegraded': '2024-01-30T08:10:09.877696+0000', 'last_fullsized': '2024-01-30T08:10:09.877696+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.874376+0000', 'last_change': '2024-01-30T08:10:09.874376+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.874376+0000', 'last_undegraded': '2024-01-30T08:10:09.874376+0000', 'last_fullsized': '2024-01-30T08:10:09.874376+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-01-30T08:10:16.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.878291+0000', 'last_change': '2024-01-30T08:10:09.878291+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.878291+0000', 'last_undegraded': '2024-01-30T08:10:09.878291+0000', 'last_fullsized': '2024-01-30T08:10:09.878291+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873017+0000', 'last_change': '2024-01-30T08:10:09.873017+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873017+0000', 'last_undegraded': '2024-01-30T08:10:09.873017+0000', 'last_fullsized': '2024-01-30T08:10:09.873017+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873024+0000', 'last_change': '2024-01-30T08:10:09.873024+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873024+0000', 'last_undegraded': '2024-01-30T08:10:09.873024+0000', 'last_fullsized': '2024-01-30T08:10:09.873024+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.882394+0000', 'last_change': '2024-01-30T08:10:09.882394+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.882394+0000', 'last_undegraded': '2024-01-30T08:10:09.882394+0000', 'last_fullsized': '2024-01-30T08:10:09.882394+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.874771+0000', 'last_change': '2024-01-30T08:10:09.874771+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.874771+0000', 'last_undegraded': '2024-01-30T08:10:09.874771+0000', 'last_fullsized': '2024-01-30T08:10:09.874771+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.881839+0000', 'last_change': '2024-01-30T08:10:09.881839+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.881839+0000', 'last_undegraded': '2024-01-30T08:10:09.881839+0000', 'last_fullsized': '2024-01-30T08:10:09.881839+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-01-30T08:10:16.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873057+0000', 'last_change': '2024-01-30T08:10:09.873057+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873057+0000', 'last_undegraded': '2024-01-30T08:10:09.873057+0000', 'last_fullsized': '2024-01-30T08:10:09.873057+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.881276+0000', 'last_change': '2024-01-30T08:10:09.881276+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.881276+0000', 'last_undegraded': '2024-01-30T08:10:09.881276+0000', 'last_fullsized': '2024-01-30T08:10:09.881276+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.874758+0000', 'last_change': '2024-01-30T08:10:09.874758+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.874758+0000', 'last_undegraded': '2024-01-30T08:10:09.874758+0000', 'last_fullsized': '2024-01-30T08:10:09.874758+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873059+0000', 'last_change': '2024-01-30T08:10:09.873059+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873059+0000', 'last_undegraded': '2024-01-30T08:10:09.873059+0000', 'last_fullsized': '2024-01-30T08:10:09.873059+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873701+0000', 'last_change': '2024-01-30T08:10:09.873701+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873701+0000', 'last_undegraded': '2024-01-30T08:10:09.873701+0000', 'last_fullsized': '2024-01-30T08:10:09.873701+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873089+0000', 'last_change': '2024-01-30T08:10:09.873089+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873089+0000', 'last_undegraded': '2024-01-30T08:10:09.873089+0000', 'last_fullsized': '2024-01-30T08:10:09.873089+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-01-30T08:10:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.879403+0000', 'last_change': '2024-01-30T08:10:09.879403+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.879403+0000', 'last_undegraded': '2024-01-30T08:10:09.879403+0000', 'last_fullsized': '2024-01-30T08:10:09.879403+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.877896+0000', 'last_change': '2024-01-30T08:10:09.877896+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.877896+0000', 'last_undegraded': '2024-01-30T08:10:09.877896+0000', 'last_fullsized': '2024-01-30T08:10:09.877896+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.877813+0000', 'last_change': '2024-01-30T08:10:09.877813+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.877813+0000', 'last_undegraded': '2024-01-30T08:10:09.877813+0000', 'last_fullsized': '2024-01-30T08:10:09.877813+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.874726+0000', 'last_change': '2024-01-30T08:10:09.874726+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.874726+0000', 'last_undegraded': '2024-01-30T08:10:09.874726+0000', 'last_fullsized': '2024-01-30T08:10:09.874726+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-01-30T08:10:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.881311+0000', 'last_change': '2024-01-30T08:10:09.881311+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.881311+0000', 'last_undegraded': '2024-01-30T08:10:09.881311+0000', 'last_fullsized': '2024-01-30T08:10:09.881311+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873933+0000', 'last_change': '2024-01-30T08:10:09.873933+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873933+0000', 'last_undegraded': '2024-01-30T08:10:09.873933+0000', 'last_fullsized': '2024-01-30T08:10:09.873933+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873033+0000', 'last_change': '2024-01-30T08:10:09.873033+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873033+0000', 'last_undegraded': '2024-01-30T08:10:09.873033+0000', 'last_fullsized': '2024-01-30T08:10:09.873033+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.873952+0000', 'last_change': '2024-01-30T08:10:09.873952+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.873952+0000', 'last_undegraded': '2024-01-30T08:10:09.873952+0000', 'last_fullsized': '2024-01-30T08:10:09.873952+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-30T08:10:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-01-30T08:10:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-30T08:10:09.874006+0000', 'last_change': '2024-01-30T08:10:09.874006+0000', 'last_active': '2024-01-30T08:10:09.865232+0000', 'last_peered': '2024-01-30T08:10:09.865232+0000', 'last_clean': '2024-01-30T08:10:09.865232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:09.874006+0000', 'last_undegraded': '2024-01-30T08:10:09.874006+0000', 'last_fullsized': '2024-01-30T08:10:09.874006+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:09.865232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-30T08:10:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-01-30T08:10:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-30T08:10:10.870409+0000', 'last_change': '2024-01-30T08:10:10.870409+0000', 'last_active': '2024-01-30T08:10:10.870409+0000', 'last_peered': '2024-01-30T08:10:10.870409+0000', 'last_clean': '2024-01-30T08:10:10.870409+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-30T08:10:10.870409+0000', 'last_undegraded': '2024-01-30T08:10:10.870409+0000', 'last_fullsized': '2024-01-30T08:10:10.870409+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'last_clean_scrub_stamp': '2024-01-30T08:10:10.870409+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-30T08:10:16.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-30T08:10:17.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c17c00640 1 Processor -- start 2024-01-30T08:10:17.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c17c00640 1 -- start start 2024-01-30T08:10:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c17c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c1006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c17c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100c7b40 con 0x7f1c100a7120 2024-01-30T08:10:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c17c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c10155730 con 0x7f1c1006de40 2024-01-30T08:10:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c17c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100a7770 con 0x7f1c101584a0 2024-01-30T08:10:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c0fe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1c100a7120 0x7f1c1015d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53420/0 (socket says 172.21.15.50:53420) 2024-01-30T08:10:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c0fe00640 1 -- 172.21.15.50:0/3473570104 learned_addr learned my addr 172.21.15.50:0/3473570104 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c15c00640 1 --2- 172.21.15.50:0/3473570104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c1006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c0f400640 1 -- 172.21.15.50:0/3473570104 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379010262 0 0) 0x7f1bf8001120 con 0x7f1c100a7120 2024-01-30T08:10:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c0f400640 1 -- 172.21.15.50:0/3473570104 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf0003530 con 0x7f1c100a7120 2024-01-30T08:10:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c0f400640 1 -- 172.21.15.50:0/3473570104 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996789796 0 0) 0x7f1c00001120 con 0x7f1c1006de40 2024-01-30T08:10:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c0f400640 1 -- 172.21.15.50:0/3473570104 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf8001120 con 0x7f1c1006de40 2024-01-30T08:10:17.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c15c00640 1 -- 172.21.15.50:0/3473570104 >> v1:172.21.15.125:6789/0 conn(0x7f1c1006de40 legacy=0x7f1c10157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c15c00640 1 -- 172.21.15.50:0/3473570104 >> v1:172.21.15.50:6789/0 conn(0x7f1c100a7120 legacy=0x7f1c1015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.004+0000 7f1c15c00640 1 -- 172.21.15.50:0/3473570104 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1006ec20 con 0x7f1c101584a0 2024-01-30T08:10:17.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c15c00640 1 --2- 172.21.15.50:0/3473570104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c1006e220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006edb0 tx=0x7f1c0801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821a00d8e9f55913 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c0f400640 1 -- 172.21.15.50:0/3473570104 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080a5830 con 0x7f1c101584a0 2024-01-30T08:10:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c0f400640 1 -- 172.21.15.50:0/3473570104 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c080a5990 con 0x7f1c101584a0 2024-01-30T08:10:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c0f400640 1 -- 172.21.15.50:0/3473570104 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080a5d20 con 0x7f1c101584a0 2024-01-30T08:10:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c17c00640 1 -- 172.21.15.50:0/3473570104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 msgr2=0x7f1c1006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c17c00640 1 --2- 172.21.15.50:0/3473570104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c1006e220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006edb0 tx=0x7f1c0801c970 comp rx=0 tx=0).stop 2024-01-30T08:10:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c17c00640 1 -- 172.21.15.50:0/3473570104 shutdown_connections 2024-01-30T08:10:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c17c00640 1 --2- 172.21.15.50:0/3473570104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c1006e220 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c17c00640 1 -- 172.21.15.50:0/3473570104 >> 172.21.15.50:0/3473570104 conn(0x7f1c100c4830 msgr2=0x7f1c100c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c17c00640 1 -- 172.21.15.50:0/3473570104 shutdown_connections 2024-01-30T08:10:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.008+0000 7f1c17c00640 1 -- 172.21.15.50:0/3473570104 wait complete. 2024-01-30T08:10:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 Processor -- start 2024-01-30T08:10:17.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 -- start start 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c1006de40 0x7f1c10146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c100a7120 0x7f1c1006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c100a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10155310 con 0x7f1c100a7120 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101ee0b0 con 0x7f1c1006de40 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101ee5a0 con 0x7f1c101584a0 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c100a7120 0x7f1c1006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c100a7120 0x7f1c1006c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49294/0 (socket says 172.21.15.50:49294) 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 -- 172.21.15.50:0/1143945671 learned_addr learned my addr 172.21.15.50:0/1143945671 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c15c00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c100a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c15200640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c1006de40 0x7f1c10146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 -- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 msgr2=0x7f1c100a7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c100a7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 -- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c1006de40 msgr2=0x7f1c10146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c1006de40 0x7f1c10146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 -- 172.21.15.50:0/1143945671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08009a70 con 0x7f1c100a7120 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0fe00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c100a7120 0x7f1c1006c8d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c650 tx=0x7f1bf800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0cc00640 1 -- 172.21.15.50:0/1143945671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8005ac0 con 0x7f1c100a7120 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0cc00640 1 -- 172.21.15.50:0/1143945671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8005c40 con 0x7f1c100a7120 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1014a660 con 0x7f1c100a7120 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c0cc00640 1 -- 172.21.15.50:0/1143945671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8007070 con 0x7f1c100a7120 2024-01-30T08:10:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.012+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1014abe0 con 0x7f1c100a7120 2024-01-30T08:10:17.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.016+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c100a79f0 con 0x7f1c100a7120 2024-01-30T08:10:17.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.016+0000 7f1c0cc00640 1 -- 172.21.15.50:0/1143945671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1bf80071f0 con 0x7f1c100a7120 2024-01-30T08:10:17.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.016+0000 7f1c0cc00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1be8066500 0x7f1be80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.016+0000 7f1c0cc00640 1 -- 172.21.15.50:0/1143945671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1bf80838f0 con 0x7f1c100a7120 2024-01-30T08:10:17.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.016+0000 7f1c15200640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1be8066500 0x7f1be80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.016+0000 7f1c15200640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1be8066500 0x7f1be80689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006d720 tx=0x7f1c00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.020+0000 7f1c0cc00640 1 -- 172.21.15.50:0/1143945671 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1c100a79f0 con 0x7f1c100a7120 2024-01-30T08:10:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.236+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1c100c7b40 con 0x7f1c100a7120 2024-01-30T08:10:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.236+0000 7f1c0cc00640 1 -- 172.21.15.50:0/1143945671 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1439 (secure 0 0 0) 0x7f1bf80175b0 con 0x7f1c100a7120 2024-01-30T08:10:17.241 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:17.241 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":43,"num_osds":8,"num_up_osds":8,"osd_up_since":1706602114,"num_in_osds":8,"osd_in_since":1706602106,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":128},{"state_name":"unknown","count":42},{"state_name":"creating+peering","count":23}],"num_pgs":193,"num_pools":5,"num_objects":28,"data_bytes":594329,"bytes_used":242274304,"bytes_avail":772851838976,"bytes_total":773094113280,"unknown_pgs_ratio":0.21761657297611237,"inactive_pgs_ratio":0.11917098611593246,"write_bytes_sec":2164,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":23,"id":2,"up":1,"in":1,"max":1,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5170},{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5214}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-30T08:09:37.063913+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-30T08:10:17.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1be8066500 msgr2=0x7f1be80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1be8066500 0x7f1be80689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006d720 tx=0x7f1c00009040 comp rx=0 tx=0).stop 2024-01-30T08:10:17.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c100a7120 msgr2=0x7f1c1006c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c100a7120 0x7f1c1006c8d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c650 tx=0x7f1bf800cb10 comp rx=0 tx=0).stop 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 shutdown_connections 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1be8066500 0x7f1be80689c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c101584a0 0x7f1c100a7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c100a7120 0x7f1c1006c8d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 --2- 172.21.15.50:0/1143945671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c1006de40 0x7f1c10146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 >> 172.21.15.50:0/1143945671 conn(0x7f1c100c4830 msgr2=0x7f1c10152610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 shutdown_connections 2024-01-30T08:10:17.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.240+0000 7f1c17c00640 1 -- 172.21.15.50:0/1143945671 wait complete. 2024-01-30T08:10:17.263 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-30T08:10:17.263 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.400+0000 7fdec9600640 1 Processor -- start 2024-01-30T08:10:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.400+0000 7fdec9600640 1 -- start start 2024-01-30T08:10:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec9600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdec40c1840 0x7fdec40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec9600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec40a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec9600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40a8cf0 con 0x7fdec40c5650 2024-01-30T08:10:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec9600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec4072a30 con 0x7fdec40c1840 2024-01-30T08:10:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec9600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40a8f40 con 0x7fdec40c4760 2024-01-30T08:10:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec2000640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdec40c5650 0x7fdec406cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53430/0 (socket says 172.21.15.50:53430) 2024-01-30T08:10:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec2000640 1 -- 172.21.15.50:0/2762415276 learned_addr learned my addr 172.21.15.50:0/2762415276 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec3400640 1 --2- 172.21.15.50:0/2762415276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec40a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec2a00640 1 --2- 172.21.15.50:0/2762415276 >> v2:172.21.15.125:3300/0 conn(0x7fdec40c1840 0x7fdec40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec1600640 1 -- 172.21.15.50:0/2762415276 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135718285 0 0) 0x7fdec40a8cf0 con 0x7fdec40c5650 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec1600640 1 -- 172.21.15.50:0/2762415276 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea4005740 con 0x7fdec40c5650 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec3400640 1 -- 172.21.15.50:0/2762415276 >> v2:172.21.15.125:3300/0 conn(0x7fdec40c1840 msgr2=0x7fdec40a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec3400640 1 --2- 172.21.15.50:0/2762415276 >> v2:172.21.15.125:3300/0 conn(0x7fdec40c1840 0x7fdec40a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec3400640 1 -- 172.21.15.50:0/2762415276 >> v1:172.21.15.50:6789/0 conn(0x7fdec40c5650 legacy=0x7fdec406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec1600640 1 -- 172.21.15.50:0/2762415276 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979687182 0 0) 0x7fdea4005740 con 0x7fdec40c5650 2024-01-30T08:10:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.404+0000 7fdec3400640 1 -- 172.21.15.50:0/2762415276 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4072cd0 con 0x7fdec40c4760 2024-01-30T08:10:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec3400640 1 --2- 172.21.15.50:0/2762415276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec40a5290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009d90 tx=0x7fdebc01c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39ba4e5b85f43776 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec1600640 1 -- 172.21.15.50:0/2762415276 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac001680 con 0x7fdec40c4760 2024-01-30T08:10:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec1600640 1 -- 172.21.15.50:0/2762415276 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0a6490 con 0x7fdec40c4760 2024-01-30T08:10:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec1600640 1 -- 172.21.15.50:0/2762415276 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0a6820 con 0x7fdec40c4760 2024-01-30T08:10:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 -- 172.21.15.50:0/2762415276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 msgr2=0x7fdec40a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 --2- 172.21.15.50:0/2762415276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec40a5290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009d90 tx=0x7fdebc01c7e0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 -- 172.21.15.50:0/2762415276 shutdown_connections 2024-01-30T08:10:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 --2- 172.21.15.50:0/2762415276 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec40a5290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 --2- 172.21.15.50:0/2762415276 >> v2:172.21.15.125:3300/0 conn(0x7fdec40c1840 0x7fdec40a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 -- 172.21.15.50:0/2762415276 >> 172.21.15.50:0/2762415276 conn(0x7fdec40c5b50 msgr2=0x7fdec40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 -- 172.21.15.50:0/2762415276 shutdown_connections 2024-01-30T08:10:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 -- 172.21.15.50:0/2762415276 wait complete. 2024-01-30T08:10:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 Processor -- start 2024-01-30T08:10:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.408+0000 7fdec9600640 1 -- start start 2024-01-30T08:10:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdec40c1840 0x7fdec41edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec40c5650 0x7fdec4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40bb150 con 0x7fdec40c5650 2024-01-30T08:10:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41ee270 con 0x7fdec40c1840 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40c6380 con 0x7fdec40c4760 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec40c5650 0x7fdec4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec40c5650 0x7fdec4153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49296/0 (socket says 172.21.15.50:49296) 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 -- 172.21.15.50:0/1269587560 learned_addr learned my addr 172.21.15.50:0/1269587560 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec2000640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec2a00640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdec40c1840 0x7fdec41edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 -- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 msgr2=0x7fdec414edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec414edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 -- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdec40c1840 msgr2=0x7fdec41edd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdec40c1840 0x7fdec41edd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 -- 172.21.15.50:0/1269587560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc009a70 con 0x7fdec40c5650 2024-01-30T08:10:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec3400640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec40c5650 0x7fdec4153620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdebc01d080 tx=0x7fdebc019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdebaa00640 1 -- 172.21.15.50:0/1269587560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b7070 con 0x7fdec40c5650 2024-01-30T08:10:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdebaa00640 1 -- 172.21.15.50:0/1269587560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc009450 con 0x7fdec40c5650 2024-01-30T08:10:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec414bf70 con 0x7fdec40c5650 2024-01-30T08:10:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdebaa00640 1 -- 172.21.15.50:0/1269587560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0a76b0 con 0x7fdec40c5650 2024-01-30T08:10:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec40bae70 con 0x7fdec40c5650 2024-01-30T08:10:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec4074a20 con 0x7fdec40c5650 2024-01-30T08:10:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.412+0000 7fdebaa00640 1 -- 172.21.15.50:0/1269587560 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdebc0a7810 con 0x7fdec40c5650 2024-01-30T08:10:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.416+0000 7fdebaa00640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde9c066500 0x7fde9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.416+0000 7fdebaa00640 1 -- 172.21.15.50:0/1269587560 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fdebc11e8a0 con 0x7fdec40c5650 2024-01-30T08:10:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.416+0000 7fdec2a00640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde9c066500 0x7fde9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.416+0000 7fdec2a00640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde9c066500 0x7fde9c0689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009ac0 tx=0x7fdeb4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.420+0000 7fdebaa00640 1 -- 172.21.15.50:0/1269587560 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdebc0eb740 con 0x7fdec40c5650 2024-01-30T08:10:17.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.576+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdec406dc30 con 0x7fde9c066500 2024-01-30T08:10:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.592+0000 7fdebaa00640 1 -- 172.21.15.50:0/1269587560 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528150 (secure 0 0 0) 0x7fdeb40119e0 con 0x7fde9c066500 2024-01-30T08:10:17.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde9c066500 msgr2=0x7fde9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde9c066500 0x7fde9c0689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009ac0 tx=0x7fdeb4009190 comp rx=0 tx=0).stop 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec40c5650 msgr2=0x7fdec4153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec40c5650 0x7fdec4153620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdebc01d080 tx=0x7fdebc019580 comp rx=0 tx=0).stop 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 shutdown_connections 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fde9c066500 0x7fde9c0689c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec40c5650 0x7fdec4153620 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdec40c4760 0x7fdec414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 --2- 172.21.15.50:0/1269587560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdec40c1840 0x7fdec41edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 >> 172.21.15.50:0/1269587560 conn(0x7fdec40c5b50 msgr2=0x7fdec40c4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 shutdown_connections 2024-01-30T08:10:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:17.596+0000 7fdec9600640 1 -- 172.21.15.50:0/1269587560 wait complete. 2024-01-30T08:10:17.617 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-01-30T08:10:17.073321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":343,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236944,"kb_used_data":4104,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737776,"statfs":{"total":773094113280,"available":772851482624,"internally_reserved":0,"allocated":4202496,"data_stored":2953004,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.194370"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507443+0000","last_change":"2024-01-30T08:10:11.932403+0000","last_active":"2024-01-30T08:10:13.507443+0000","last_peered":"2024-01-30T08:10:13.507443+0000","last_clean":"2024-01-30T08:10:13.507443+0000","last_became_active":"2024-01-30T08:10:11.932098+0000","last_became_peered":"2024-01-30T08:10:11.932098+0000","last_unstale":"2024-01-30T08:10:13.507443+0000","last_undegraded":"2024-01-30T08:10:13.507443+0000","last_fullsized":"2024-01-30T08:10:13.507443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:13.993728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902866+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:10:13.902866+0000","last_peered":"2024-01-30T08:10:13.902866+0000","last_clean":"2024-01-30T08:10:13.902866+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:10:13.902866+0000","last_undegraded":"2024-01-30T08:10:13.902866+0000","last_fullsized":"2024-01-30T08:10:13.902866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.900924+0000","last_change":"2024-01-30T08:10:11.909840+0000","last_active":"2024-01-30T08:10:13.900924+0000","last_peered":"2024-01-30T08:10:13.900924+0000","last_clean":"2024-01-30T08:10:13.900924+0000","last_became_active":"2024-01-30T08:10:11.909510+0000","last_became_peered":"2024-01-30T08:10:11.909510+0000","last_unstale":"2024-01-30T08:10:13.900924+0000","last_undegraded":"2024-01-30T08:10:13.900924+0000","last_fullsized":"2024-01-30T08:10:13.900924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:33.705197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902479+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:10:13.902479+0000","last_peered":"2024-01-30T08:10:13.902479+0000","last_clean":"2024-01-30T08:10:13.902479+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:10:13.902479+0000","last_undegraded":"2024-01-30T08:10:13.902479+0000","last_fullsized":"2024-01-30T08:10:13.902479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903370+0000","last_change":"2024-01-30T08:10:11.918145+0000","last_active":"2024-01-30T08:10:13.903370+0000","last_peered":"2024-01-30T08:10:13.903370+0000","last_clean":"2024-01-30T08:10:13.903370+0000","last_became_active":"2024-01-30T08:10:11.917857+0000","last_became_peered":"2024-01-30T08:10:11.917857+0000","last_unstale":"2024-01-30T08:10:13.903370+0000","last_undegraded":"2024-01-30T08:10:13.903370+0000","last_fullsized":"2024-01-30T08:10:13.903370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:45:51.628287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903892+0000","last_change":"2024-01-30T08:09:53.888831+0000","last_active":"2024-01-30T08:10:11.903892+0000","last_peered":"2024-01-30T08:10:11.903892+0000","last_clean":"2024-01-30T08:10:11.903892+0000","last_became_active":"2024-01-30T08:09:53.888512+0000","last_became_peered":"2024-01-30T08:09:53.888512+0000","last_unstale":"2024-01-30T08:10:11.903892+0000","last_undegraded":"2024-01-30T08:10:11.903892+0000","last_fullsized":"2024-01-30T08:10:11.903892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:19.673462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929426+0000","last_change":"2024-01-30T08:10:11.925833+0000","last_active":"2024-01-30T08:10:11.929426+0000","last_peered":"2024-01-30T08:10:11.929426+0000","last_clean":"2024-01-30T08:10:11.929426+0000","last_became_active":"2024-01-30T08:10:11.925416+0000","last_became_peered":"2024-01-30T08:10:11.925416+0000","last_unstale":"2024-01-30T08:10:11.929426+0000","last_undegraded":"2024-01-30T08:10:11.929426+0000","last_fullsized":"2024-01-30T08:10:11.929426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918018+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:10:12.918018+0000","last_peered":"2024-01-30T08:10:12.918018+0000","last_clean":"2024-01-30T08:10:12.918018+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:10:12.918018+0000","last_undegraded":"2024-01-30T08:10:12.918018+0000","last_fullsized":"2024-01-30T08:10:12.918018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918256+0000","last_change":"2024-01-30T08:10:11.924224+0000","last_active":"2024-01-30T08:10:12.918256+0000","last_peered":"2024-01-30T08:10:12.918256+0000","last_clean":"2024-01-30T08:10:12.918256+0000","last_became_active":"2024-01-30T08:10:11.923933+0000","last_became_peered":"2024-01-30T08:10:11.923933+0000","last_unstale":"2024-01-30T08:10:12.918256+0000","last_undegraded":"2024-01-30T08:10:12.918256+0000","last_fullsized":"2024-01-30T08:10:12.918256+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:18.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917911+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:10:12.917911+0000","last_peered":"2024-01-30T08:10:12.917911+0000","last_clean":"2024-01-30T08:10:12.917911+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:10:12.917911+0000","last_undegraded":"2024-01-30T08:10:12.917911+0000","last_fullsized":"2024-01-30T08:10:12.917911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:47.332748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902379+0000","last_change":"2024-01-30T08:10:11.906567+0000","last_active":"2024-01-30T08:10:13.902379+0000","last_peered":"2024-01-30T08:10:13.902379+0000","last_clean":"2024-01-30T08:10:13.902379+0000","last_became_active":"2024-01-30T08:10:11.905650+0000","last_became_peered":"2024-01-30T08:10:11.905650+0000","last_unstale":"2024-01-30T08:10:13.902379+0000","last_undegraded":"2024-01-30T08:10:13.902379+0000","last_fullsized":"2024-01-30T08:10:13.902379+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:29:47.946644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903087+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:10:13.903087+0000","last_peered":"2024-01-30T08:10:13.903087+0000","last_clean":"2024-01-30T08:10:13.903087+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:10:13.903087+0000","last_undegraded":"2024-01-30T08:10:13.903087+0000","last_fullsized":"2024-01-30T08:10:13.903087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902612+0000","last_change":"2024-01-30T08:10:11.926171+0000","last_active":"2024-01-30T08:10:13.902612+0000","last_peered":"2024-01-30T08:10:13.902612+0000","last_clean":"2024-01-30T08:10:13.902612+0000","last_became_active":"2024-01-30T08:10:11.924275+0000","last_became_peered":"2024-01-30T08:10:11.924275+0000","last_unstale":"2024-01-30T08:10:13.902612+0000","last_undegraded":"2024-01-30T08:10:13.902612+0000","last_fullsized":"2024-01-30T08:10:13.902612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:29:24.179739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893805+0000","last_change":"2024-01-30T08:09:53.884011+0000","last_active":"2024-01-30T08:10:11.893805+0000","last_peered":"2024-01-30T08:10:11.893805+0000","last_clean":"2024-01-30T08:10:11.893805+0000","last_became_active":"2024-01-30T08:09:53.881881+0000","last_became_peered":"2024-01-30T08:09:53.881881+0000","last_unstale":"2024-01-30T08:10:11.893805+0000","last_undegraded":"2024-01-30T08:10:11.893805+0000","last_fullsized":"2024-01-30T08:10:11.893805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:04:50.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903417+0000","last_change":"2024-01-30T08:10:11.918156+0000","last_active":"2024-01-30T08:10:13.903417+0000","last_peered":"2024-01-30T08:10:13.903417+0000","last_clean":"2024-01-30T08:10:13.903417+0000","last_became_active":"2024-01-30T08:10:11.917883+0000","last_became_peered":"2024-01-30T08:10:11.917883+0000","last_unstale":"2024-01-30T08:10:13.903417+0000","last_undegraded":"2024-01-30T08:10:13.903417+0000","last_fullsized":"2024-01-30T08:10:13.903417+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:50:22.597566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901135+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:10:13.901135+0000","last_peered":"2024-01-30T08:10:13.901135+0000","last_clean":"2024-01-30T08:10:13.901135+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:10:13.901135+0000","last_undegraded":"2024-01-30T08:10:13.901135+0000","last_fullsized":"2024-01-30T08:10:13.901135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.931474+0000","last_change":"2024-01-30T08:10:11.929495+0000","last_active":"2024-01-30T08:10:11.931474+0000","last_peered":"2024-01-30T08:10:11.931474+0000","last_clean":"2024-01-30T08:10:11.931474+0000","last_became_active":"2024-01-30T08:10:11.928578+0000","last_became_peered":"2024-01-30T08:10:11.928578+0000","last_unstale":"2024-01-30T08:10:11.931474+0000","last_undegraded":"2024-01-30T08:10:11.931474+0000","last_fullsized":"2024-01-30T08:10:11.931474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905164+0000","last_change":"2024-01-30T08:09:53.887909+0000","last_active":"2024-01-30T08:10:11.905164+0000","last_peered":"2024-01-30T08:10:11.905164+0000","last_clean":"2024-01-30T08:10:11.905164+0000","last_became_active":"2024-01-30T08:09:53.887634+0000","last_became_peered":"2024-01-30T08:09:53.887634+0000","last_unstale":"2024-01-30T08:10:11.905164+0000","last_undegraded":"2024-01-30T08:10:11.905164+0000","last_fullsized":"2024-01-30T08:10:11.905164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:52.921864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.900967+0000","last_change":"2024-01-30T08:10:11.917861+0000","last_active":"2024-01-30T08:10:13.900967+0000","last_peered":"2024-01-30T08:10:13.900967+0000","last_clean":"2024-01-30T08:10:13.900967+0000","last_became_active":"2024-01-30T08:10:11.915988+0000","last_became_peered":"2024-01-30T08:10:11.915988+0000","last_unstale":"2024-01-30T08:10:13.900967+0000","last_undegraded":"2024-01-30T08:10:13.900967+0000","last_fullsized":"2024-01-30T08:10:13.900967+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:20:00.507002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896717+0000","last_change":"2024-01-30T08:09:53.883502+0000","last_active":"2024-01-30T08:10:11.896717+0000","last_peered":"2024-01-30T08:10:11.896717+0000","last_clean":"2024-01-30T08:10:11.896717+0000","last_became_active":"2024-01-30T08:09:53.883146+0000","last_became_peered":"2024-01-30T08:09:53.883146+0000","last_unstale":"2024-01-30T08:10:11.896717+0000","last_undegraded":"2024-01-30T08:10:11.896717+0000","last_fullsized":"2024-01-30T08:10:11.896717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:13.134749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917742+0000","last_change":"2024-01-30T08:10:11.926194+0000","last_active":"2024-01-30T08:10:12.917742+0000","last_peered":"2024-01-30T08:10:12.917742+0000","last_clean":"2024-01-30T08:10:12.917742+0000","last_became_active":"2024-01-30T08:10:11.925933+0000","last_became_peered":"2024-01-30T08:10:11.925933+0000","last_unstale":"2024-01-30T08:10:12.917742+0000","last_undegraded":"2024-01-30T08:10:12.917742+0000","last_fullsized":"2024-01-30T08:10:12.917742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:22.541776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896375+0000","last_change":"2024-01-30T08:09:53.883798+0000","last_active":"2024-01-30T08:10:11.896375+0000","last_peered":"2024-01-30T08:10:11.896375+0000","last_clean":"2024-01-30T08:10:11.896375+0000","last_became_active":"2024-01-30T08:09:53.883077+0000","last_became_peered":"2024-01-30T08:09:53.883077+0000","last_unstale":"2024-01-30T08:10:11.896375+0000","last_undegraded":"2024-01-30T08:10:11.896375+0000","last_fullsized":"2024-01-30T08:10:11.896375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:40.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901712+0000","last_change":"2024-01-30T08:10:11.920412+0000","last_active":"2024-01-30T08:10:13.901712+0000","last_peered":"2024-01-30T08:10:13.901712+0000","last_clean":"2024-01-30T08:10:13.901712+0000","last_became_active":"2024-01-30T08:10:11.920222+0000","last_became_peered":"2024-01-30T08:10:11.920222+0000","last_unstale":"2024-01-30T08:10:13.901712+0000","last_undegraded":"2024-01-30T08:10:13.901712+0000","last_fullsized":"2024-01-30T08:10:13.901712+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:06:36.045513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903225+0000","last_change":"2024-01-30T08:09:53.880237+0000","last_active":"2024-01-30T08:10:11.903225+0000","last_peered":"2024-01-30T08:10:11.903225+0000","last_clean":"2024-01-30T08:10:11.903225+0000","last_became_active":"2024-01-30T08:09:53.879920+0000","last_became_peered":"2024-01-30T08:09:53.879920+0000","last_unstale":"2024-01-30T08:10:11.903225+0000","last_undegraded":"2024-01-30T08:10:11.903225+0000","last_fullsized":"2024-01-30T08:10:11.903225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:31:19.905033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930126+0000","last_change":"2024-01-30T08:10:11.928221+0000","last_active":"2024-01-30T08:10:11.930126+0000","last_peered":"2024-01-30T08:10:11.930126+0000","last_clean":"2024-01-30T08:10:11.930126+0000","last_became_active":"2024-01-30T08:10:11.924922+0000","last_became_peered":"2024-01-30T08:10:11.924922+0000","last_unstale":"2024-01-30T08:10:11.930126+0000","last_undegraded":"2024-01-30T08:10:11.930126+0000","last_fullsized":"2024-01-30T08:10:11.930126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893343+0000","last_change":"2024-01-30T08:09:53.879036+0000","last_active":"2024-01-30T08:10:11.893343+0000","last_peered":"2024-01-30T08:10:11.893343+0000","last_clean":"2024-01-30T08:10:11.893343+0000","last_became_active":"2024-01-30T08:09:53.878757+0000","last_became_peered":"2024-01-30T08:09:53.878757+0000","last_unstale":"2024-01-30T08:10:11.893343+0000","last_undegraded":"2024-01-30T08:10:11.893343+0000","last_fullsized":"2024-01-30T08:10:11.893343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:32:50.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508183+0000","last_change":"2024-01-30T08:10:11.933824+0000","last_active":"2024-01-30T08:10:13.508183+0000","last_peered":"2024-01-30T08:10:13.508183+0000","last_clean":"2024-01-30T08:10:13.508183+0000","last_became_active":"2024-01-30T08:10:11.933501+0000","last_became_peered":"2024-01-30T08:10:11.933501+0000","last_unstale":"2024-01-30T08:10:13.508183+0000","last_undegraded":"2024-01-30T08:10:13.508183+0000","last_fullsized":"2024-01-30T08:10:13.508183+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:02:57.291089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917467+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:10:12.917467+0000","last_peered":"2024-01-30T08:10:12.917467+0000","last_clean":"2024-01-30T08:10:12.917467+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:10:12.917467+0000","last_undegraded":"2024-01-30T08:10:12.917467+0000","last_fullsized":"2024-01-30T08:10:12.917467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903536+0000","last_change":"2024-01-30T08:10:11.903620+0000","last_active":"2024-01-30T08:10:13.903536+0000","last_peered":"2024-01-30T08:10:13.903536+0000","last_clean":"2024-01-30T08:10:13.903536+0000","last_became_active":"2024-01-30T08:10:11.903324+0000","last_became_peered":"2024-01-30T08:10:11.903324+0000","last_unstale":"2024-01-30T08:10:13.903536+0000","last_undegraded":"2024-01-30T08:10:13.903536+0000","last_fullsized":"2024-01-30T08:10:13.903536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:54:07.037992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893908+0000","last_change":"2024-01-30T08:09:53.886393+0000","last_active":"2024-01-30T08:10:11.893908+0000","last_peered":"2024-01-30T08:10:11.893908+0000","last_clean":"2024-01-30T08:10:11.893908+0000","last_became_active":"2024-01-30T08:09:53.881749+0000","last_became_peered":"2024-01-30T08:09:53.881749+0000","last_unstale":"2024-01-30T08:10:11.893908+0000","last_undegraded":"2024-01-30T08:10:11.893908+0000","last_fullsized":"2024-01-30T08:10:11.893908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:22.523025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507882+0000","last_change":"2024-01-30T08:10:11.931072+0000","last_active":"2024-01-30T08:10:13.507882+0000","last_peered":"2024-01-30T08:10:13.507882+0000","last_clean":"2024-01-30T08:10:13.507882+0000","last_became_active":"2024-01-30T08:10:11.929521+0000","last_became_peered":"2024-01-30T08:10:11.929521+0000","last_unstale":"2024-01-30T08:10:13.507882+0000","last_undegraded":"2024-01-30T08:10:13.507882+0000","last_fullsized":"2024-01-30T08:10:13.507882+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:29:45.740630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507315+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:10:13.507315+0000","last_peered":"2024-01-30T08:10:13.507315+0000","last_clean":"2024-01-30T08:10:13.507315+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:10:13.507315+0000","last_undegraded":"2024-01-30T08:10:13.507315+0000","last_fullsized":"2024-01-30T08:10:13.507315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.934707+0000","last_change":"2024-01-30T08:10:11.931335+0000","last_active":"2024-01-30T08:10:11.934707+0000","last_peered":"2024-01-30T08:10:11.934707+0000","last_clean":"2024-01-30T08:10:11.934707+0000","last_became_active":"2024-01-30T08:10:11.931065+0000","last_became_peered":"2024-01-30T08:10:11.931065+0000","last_unstale":"2024-01-30T08:10:11.934707+0000","last_undegraded":"2024-01-30T08:10:11.934707+0000","last_fullsized":"2024-01-30T08:10:11.934707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508288+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:10:13.508288+0000","last_peered":"2024-01-30T08:10:13.508288+0000","last_clean":"2024-01-30T08:10:13.508288+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:10:13.508288+0000","last_undegraded":"2024-01-30T08:10:13.508288+0000","last_fullsized":"2024-01-30T08:10:13.508288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925741+0000","last_change":"2024-01-30T08:10:11.911805+0000","last_active":"2024-01-30T08:10:11.925741+0000","last_peered":"2024-01-30T08:10:11.925741+0000","last_clean":"2024-01-30T08:10:11.925741+0000","last_became_active":"2024-01-30T08:10:11.911191+0000","last_became_peered":"2024-01-30T08:10:11.911191+0000","last_unstale":"2024-01-30T08:10:11.925741+0000","last_undegraded":"2024-01-30T08:10:11.925741+0000","last_fullsized":"2024-01-30T08:10:11.925741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918889+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:10:12.918889+0000","last_peered":"2024-01-30T08:10:12.918889+0000","last_clean":"2024-01-30T08:10:12.918889+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:10:12.918889+0000","last_undegraded":"2024-01-30T08:10:12.918889+0000","last_fullsized":"2024-01-30T08:10:12.918889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914789+0000","last_change":"2024-01-30T08:10:11.908732+0000","last_active":"2024-01-30T08:10:11.914789+0000","last_peered":"2024-01-30T08:10:11.914789+0000","last_clean":"2024-01-30T08:10:11.914789+0000","last_became_active":"2024-01-30T08:10:11.908460+0000","last_became_peered":"2024-01-30T08:10:11.908460+0000","last_unstale":"2024-01-30T08:10:11.914789+0000","last_undegraded":"2024-01-30T08:10:11.914789+0000","last_fullsized":"2024-01-30T08:10:11.914789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:57:12.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918365+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:10:12.918365+0000","last_peered":"2024-01-30T08:10:12.918365+0000","last_clean":"2024-01-30T08:10:12.918365+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:10:12.918365+0000","last_undegraded":"2024-01-30T08:10:12.918365+0000","last_fullsized":"2024-01-30T08:10:12.918365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507875+0000","last_change":"2024-01-30T08:10:11.936287+0000","last_active":"2024-01-30T08:10:13.507875+0000","last_peered":"2024-01-30T08:10:13.507875+0000","last_clean":"2024-01-30T08:10:13.507875+0000","last_became_active":"2024-01-30T08:10:11.935989+0000","last_became_peered":"2024-01-30T08:10:11.935989+0000","last_unstale":"2024-01-30T08:10:13.507875+0000","last_undegraded":"2024-01-30T08:10:13.507875+0000","last_fullsized":"2024-01-30T08:10:13.507875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:11:50.982119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919136+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:10:12.919136+0000","last_peered":"2024-01-30T08:10:12.919136+0000","last_clean":"2024-01-30T08:10:12.919136+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:10:12.919136+0000","last_undegraded":"2024-01-30T08:10:12.919136+0000","last_fullsized":"2024-01-30T08:10:12.919136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904367+0000","last_change":"2024-01-30T08:10:11.908608+0000","last_active":"2024-01-30T08:10:13.904367+0000","last_peered":"2024-01-30T08:10:13.904367+0000","last_clean":"2024-01-30T08:10:13.904367+0000","last_became_active":"2024-01-30T08:10:11.908311+0000","last_became_peered":"2024-01-30T08:10:11.908311+0000","last_unstale":"2024-01-30T08:10:13.904367+0000","last_undegraded":"2024-01-30T08:10:13.904367+0000","last_fullsized":"2024-01-30T08:10:13.904367+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:34.378522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893439+0000","last_change":"2024-01-30T08:09:53.884047+0000","last_active":"2024-01-30T08:10:11.893439+0000","last_peered":"2024-01-30T08:10:11.893439+0000","last_clean":"2024-01-30T08:10:11.893439+0000","last_became_active":"2024-01-30T08:09:53.883765+0000","last_became_peered":"2024-01-30T08:09:53.883765+0000","last_unstale":"2024-01-30T08:10:11.893439+0000","last_undegraded":"2024-01-30T08:10:11.893439+0000","last_fullsized":"2024-01-30T08:10:11.893439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:54:01.174660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918762+0000","last_change":"2024-01-30T08:10:11.914067+0000","last_active":"2024-01-30T08:10:12.918762+0000","last_peered":"2024-01-30T08:10:12.918762+0000","last_clean":"2024-01-30T08:10:12.918762+0000","last_became_active":"2024-01-30T08:10:11.913126+0000","last_became_peered":"2024-01-30T08:10:11.913126+0000","last_unstale":"2024-01-30T08:10:12.918762+0000","last_undegraded":"2024-01-30T08:10:12.918762+0000","last_fullsized":"2024-01-30T08:10:12.918762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:15:42.380354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917611+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:10:12.917611+0000","last_peered":"2024-01-30T08:10:12.917611+0000","last_clean":"2024-01-30T08:10:12.917611+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:10:12.917611+0000","last_undegraded":"2024-01-30T08:10:12.917611+0000","last_fullsized":"2024-01-30T08:10:12.917611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924123+0000","last_change":"2024-01-30T08:10:11.917501+0000","last_active":"2024-01-30T08:10:11.924123+0000","last_peered":"2024-01-30T08:10:11.924123+0000","last_clean":"2024-01-30T08:10:11.924123+0000","last_became_active":"2024-01-30T08:10:11.917148+0000","last_became_peered":"2024-01-30T08:10:11.917148+0000","last_unstale":"2024-01-30T08:10:11.924123+0000","last_undegraded":"2024-01-30T08:10:11.924123+0000","last_fullsized":"2024-01-30T08:10:11.924123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:27.639415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507533+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:10:13.507533+0000","last_peered":"2024-01-30T08:10:13.507533+0000","last_clean":"2024-01-30T08:10:13.507533+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:10:13.507533+0000","last_undegraded":"2024-01-30T08:10:13.507533+0000","last_fullsized":"2024-01-30T08:10:13.507533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:00.220792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902102+0000","last_change":"2024-01-30T08:10:11.922203+0000","last_active":"2024-01-30T08:10:13.902102+0000","last_peered":"2024-01-30T08:10:13.902102+0000","last_clean":"2024-01-30T08:10:13.902102+0000","last_became_active":"2024-01-30T08:10:11.921978+0000","last_became_peered":"2024-01-30T08:10:11.921978+0000","last_unstale":"2024-01-30T08:10:13.902102+0000","last_undegraded":"2024-01-30T08:10:13.902102+0000","last_fullsized":"2024-01-30T08:10:13.902102+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:20:00.743813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917453+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:10:12.917453+0000","last_peered":"2024-01-30T08:10:12.917453+0000","last_clean":"2024-01-30T08:10:12.917453+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:10:12.917453+0000","last_undegraded":"2024-01-30T08:10:12.917453+0000","last_fullsized":"2024-01-30T08:10:12.917453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:22.789462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917472+0000","last_change":"2024-01-30T08:10:11.931281+0000","last_active":"2024-01-30T08:10:12.917472+0000","last_peered":"2024-01-30T08:10:12.917472+0000","last_clean":"2024-01-30T08:10:12.917472+0000","last_became_active":"2024-01-30T08:10:11.930845+0000","last_became_peered":"2024-01-30T08:10:11.930845+0000","last_unstale":"2024-01-30T08:10:12.917472+0000","last_undegraded":"2024-01-30T08:10:12.917472+0000","last_fullsized":"2024-01-30T08:10:12.917472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:01:10.135799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918890+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:10:12.918890+0000","last_peered":"2024-01-30T08:10:12.918890+0000","last_clean":"2024-01-30T08:10:12.918890+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:10:12.918890+0000","last_undegraded":"2024-01-30T08:10:12.918890+0000","last_fullsized":"2024-01-30T08:10:12.918890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.924583+0000","last_change":"2024-01-30T08:10:11.916385+0000","last_active":"2024-01-30T08:10:11.924583+0000","last_peered":"2024-01-30T08:10:11.924583+0000","last_clean":"2024-01-30T08:10:11.924583+0000","last_became_active":"2024-01-30T08:10:11.915981+0000","last_became_peered":"2024-01-30T08:10:11.915981+0000","last_unstale":"2024-01-30T08:10:11.924583+0000","last_undegraded":"2024-01-30T08:10:11.924583+0000","last_fullsized":"2024-01-30T08:10:11.924583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:27.251561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903571+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:10:13.903571+0000","last_peered":"2024-01-30T08:10:13.903571+0000","last_clean":"2024-01-30T08:10:13.903571+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:10:13.903571+0000","last_undegraded":"2024-01-30T08:10:13.903571+0000","last_fullsized":"2024-01-30T08:10:13.903571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918811+0000","last_change":"2024-01-30T08:10:11.915341+0000","last_active":"2024-01-30T08:10:12.918811+0000","last_peered":"2024-01-30T08:10:12.918811+0000","last_clean":"2024-01-30T08:10:12.918811+0000","last_became_active":"2024-01-30T08:10:11.915013+0000","last_became_peered":"2024-01-30T08:10:11.915013+0000","last_unstale":"2024-01-30T08:10:12.918811+0000","last_undegraded":"2024-01-30T08:10:12.918811+0000","last_fullsized":"2024-01-30T08:10:12.918811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:33.705197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919223+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:10:12.919223+0000","last_peered":"2024-01-30T08:10:12.919223+0000","last_clean":"2024-01-30T08:10:12.919223+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:10:12.919223+0000","last_undegraded":"2024-01-30T08:10:12.919223+0000","last_fullsized":"2024-01-30T08:10:12.919223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901820+0000","last_change":"2024-01-30T08:10:11.923083+0000","last_active":"2024-01-30T08:10:13.901820+0000","last_peered":"2024-01-30T08:10:13.901820+0000","last_clean":"2024-01-30T08:10:13.901820+0000","last_became_active":"2024-01-30T08:10:11.922797+0000","last_became_peered":"2024-01-30T08:10:11.922797+0000","last_unstale":"2024-01-30T08:10:13.901820+0000","last_undegraded":"2024-01-30T08:10:13.901820+0000","last_fullsized":"2024-01-30T08:10:13.901820+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:34:26.777072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.895972+0000","last_change":"2024-01-30T08:09:53.881127+0000","last_active":"2024-01-30T08:10:11.895972+0000","last_peered":"2024-01-30T08:10:11.895972+0000","last_clean":"2024-01-30T08:10:11.895972+0000","last_became_active":"2024-01-30T08:09:53.880821+0000","last_became_peered":"2024-01-30T08:09:53.880821+0000","last_unstale":"2024-01-30T08:10:11.895972+0000","last_undegraded":"2024-01-30T08:10:11.895972+0000","last_fullsized":"2024-01-30T08:10:11.895972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:34:00.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925958+0000","last_change":"2024-01-30T08:10:11.916154+0000","last_active":"2024-01-30T08:10:11.925958+0000","last_peered":"2024-01-30T08:10:11.925958+0000","last_clean":"2024-01-30T08:10:11.925958+0000","last_became_active":"2024-01-30T08:10:11.915888+0000","last_became_peered":"2024-01-30T08:10:11.915888+0000","last_unstale":"2024-01-30T08:10:11.925958+0000","last_undegraded":"2024-01-30T08:10:11.925958+0000","last_fullsized":"2024-01-30T08:10:11.925958+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:07:31.431470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918921+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:10:12.918921+0000","last_peered":"2024-01-30T08:10:12.918921+0000","last_clean":"2024-01-30T08:10:12.918921+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:10:12.918921+0000","last_undegraded":"2024-01-30T08:10:12.918921+0000","last_fullsized":"2024-01-30T08:10:12.918921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919063+0000","last_change":"2024-01-30T08:10:11.915659+0000","last_active":"2024-01-30T08:10:12.919063+0000","last_peered":"2024-01-30T08:10:12.919063+0000","last_clean":"2024-01-30T08:10:12.919063+0000","last_became_active":"2024-01-30T08:10:11.915403+0000","last_became_peered":"2024-01-30T08:10:11.915403+0000","last_unstale":"2024-01-30T08:10:12.919063+0000","last_undegraded":"2024-01-30T08:10:12.919063+0000","last_fullsized":"2024-01-30T08:10:12.919063+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:06:36.045513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918510+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:10:12.918510+0000","last_peered":"2024-01-30T08:10:12.918510+0000","last_clean":"2024-01-30T08:10:12.918510+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:10:12.918510+0000","last_undegraded":"2024-01-30T08:10:12.918510+0000","last_fullsized":"2024-01-30T08:10:12.918510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917333+0000","last_change":"2024-01-30T08:10:11.910891+0000","last_active":"2024-01-30T08:10:11.917333+0000","last_peered":"2024-01-30T08:10:11.917333+0000","last_clean":"2024-01-30T08:10:11.917333+0000","last_became_active":"2024-01-30T08:10:11.910551+0000","last_became_peered":"2024-01-30T08:10:11.910551+0000","last_unstale":"2024-01-30T08:10:11.917333+0000","last_undegraded":"2024-01-30T08:10:11.917333+0000","last_fullsized":"2024-01-30T08:10:11.917333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:48:29.533666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508014+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:10:13.508014+0000","last_peered":"2024-01-30T08:10:13.508014+0000","last_clean":"2024-01-30T08:10:13.508014+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:10:13.508014+0000","last_undegraded":"2024-01-30T08:10:13.508014+0000","last_fullsized":"2024-01-30T08:10:13.508014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508202+0000","last_change":"2024-01-30T08:10:11.931040+0000","last_active":"2024-01-30T08:10:13.508202+0000","last_peered":"2024-01-30T08:10:13.508202+0000","last_clean":"2024-01-30T08:10:13.508202+0000","last_became_active":"2024-01-30T08:10:11.929344+0000","last_became_peered":"2024-01-30T08:10:11.929344+0000","last_unstale":"2024-01-30T08:10:13.508202+0000","last_undegraded":"2024-01-30T08:10:13.508202+0000","last_fullsized":"2024-01-30T08:10:13.508202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:30:41.523632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901594+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:10:13.901594+0000","last_peered":"2024-01-30T08:10:13.901594+0000","last_clean":"2024-01-30T08:10:13.901594+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:10:13.901594+0000","last_undegraded":"2024-01-30T08:10:13.901594+0000","last_fullsized":"2024-01-30T08:10:13.901594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918505+0000","last_change":"2024-01-30T08:10:11.913476+0000","last_active":"2024-01-30T08:10:12.918505+0000","last_peered":"2024-01-30T08:10:12.918505+0000","last_clean":"2024-01-30T08:10:12.918505+0000","last_became_active":"2024-01-30T08:10:11.913168+0000","last_became_peered":"2024-01-30T08:10:11.913168+0000","last_unstale":"2024-01-30T08:10:12.918505+0000","last_undegraded":"2024-01-30T08:10:12.918505+0000","last_fullsized":"2024-01-30T08:10:12.918505+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:48:33.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903777+0000","last_change":"2024-01-30T08:10:10.899511+0000","last_active":"2024-01-30T08:10:13.903777+0000","last_peered":"2024-01-30T08:10:13.903777+0000","last_clean":"2024-01-30T08:10:13.903777+0000","last_became_active":"2024-01-30T08:10:10.899246+0000","last_became_peered":"2024-01-30T08:10:10.899246+0000","last_unstale":"2024-01-30T08:10:13.903777+0000","last_undegraded":"2024-01-30T08:10:13.903777+0000","last_fullsized":"2024-01-30T08:10:13.903777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:55.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507974+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:10:13.507974+0000","last_peered":"2024-01-30T08:10:13.507974+0000","last_clean":"2024-01-30T08:10:13.507974+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:10:13.507974+0000","last_undegraded":"2024-01-30T08:10:13.507974+0000","last_fullsized":"2024-01-30T08:10:13.507974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919045+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:10:12.919045+0000","last_peered":"2024-01-30T08:10:12.919045+0000","last_clean":"2024-01-30T08:10:12.919045+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:10:12.919045+0000","last_undegraded":"2024-01-30T08:10:12.919045+0000","last_fullsized":"2024-01-30T08:10:12.919045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901836+0000","last_change":"2024-01-30T08:10:11.917355+0000","last_active":"2024-01-30T08:10:13.901836+0000","last_peered":"2024-01-30T08:10:13.901836+0000","last_clean":"2024-01-30T08:10:13.901836+0000","last_became_active":"2024-01-30T08:10:11.917105+0000","last_became_peered":"2024-01-30T08:10:11.917105+0000","last_unstale":"2024-01-30T08:10:13.901836+0000","last_undegraded":"2024-01-30T08:10:13.901836+0000","last_fullsized":"2024-01-30T08:10:13.901836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:38:39.285632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.926426+0000","last_change":"2024-01-30T08:10:10.907010+0000","last_active":"2024-01-30T08:10:11.926426+0000","last_peered":"2024-01-30T08:10:11.926426+0000","last_clean":"2024-01-30T08:10:11.926426+0000","last_became_active":"2024-01-30T08:10:10.906670+0000","last_became_peered":"2024-01-30T08:10:10.906670+0000","last_unstale":"2024-01-30T08:10:11.926426+0000","last_undegraded":"2024-01-30T08:10:11.926426+0000","last_fullsized":"2024-01-30T08:10:11.926426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:26.246384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904012+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:10:13.904012+0000","last_peered":"2024-01-30T08:10:13.904012+0000","last_clean":"2024-01-30T08:10:13.904012+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:10:13.904012+0000","last_undegraded":"2024-01-30T08:10:13.904012+0000","last_fullsized":"2024-01-30T08:10:13.904012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905509+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:10:11.905509+0000","last_peered":"2024-01-30T08:10:11.905509+0000","last_clean":"2024-01-30T08:10:11.905509+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:10:11.905509+0000","last_undegraded":"2024-01-30T08:10:11.905509+0000","last_fullsized":"2024-01-30T08:10:11.905509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507251+0000","last_change":"2024-01-30T08:10:11.927138+0000","last_active":"2024-01-30T08:10:13.507251+0000","last_peered":"2024-01-30T08:10:13.507251+0000","last_clean":"2024-01-30T08:10:13.507251+0000","last_became_active":"2024-01-30T08:10:11.926774+0000","last_became_peered":"2024-01-30T08:10:11.926774+0000","last_unstale":"2024-01-30T08:10:13.507251+0000","last_undegraded":"2024-01-30T08:10:13.507251+0000","last_fullsized":"2024-01-30T08:10:13.507251+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:33:29.618226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"42'4","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918766+0000","last_change":"2024-01-30T08:10:10.895924+0000","last_active":"2024-01-30T08:10:12.918766+0000","last_peered":"2024-01-30T08:10:12.918766+0000","last_clean":"2024-01-30T08:10:12.918766+0000","last_became_active":"2024-01-30T08:10:10.895664+0000","last_became_peered":"2024-01-30T08:10:10.895664+0000","last_unstale":"2024-01-30T08:10:12.918766+0000","last_undegraded":"2024-01-30T08:10:12.918766+0000","last_fullsized":"2024-01-30T08:10:12.918766+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:46.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918076+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:10:12.918076+0000","last_peered":"2024-01-30T08:10:12.918076+0000","last_clean":"2024-01-30T08:10:12.918076+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:10:12.918076+0000","last_undegraded":"2024-01-30T08:10:12.918076+0000","last_fullsized":"2024-01-30T08:10:12.918076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904171+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:10:13.904171+0000","last_peered":"2024-01-30T08:10:13.904171+0000","last_clean":"2024-01-30T08:10:13.904171+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:10:13.904171+0000","last_undegraded":"2024-01-30T08:10:13.904171+0000","last_fullsized":"2024-01-30T08:10:13.904171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929867+0000","last_change":"2024-01-30T08:10:11.928520+0000","last_active":"2024-01-30T08:10:11.929867+0000","last_peered":"2024-01-30T08:10:11.929867+0000","last_clean":"2024-01-30T08:10:11.929867+0000","last_became_active":"2024-01-30T08:10:11.927399+0000","last_became_peered":"2024-01-30T08:10:11.927399+0000","last_unstale":"2024-01-30T08:10:11.929867+0000","last_undegraded":"2024-01-30T08:10:11.929867+0000","last_fullsized":"2024-01-30T08:10:11.929867+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:49:12.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903650+0000","last_change":"2024-01-30T08:10:10.900383+0000","last_active":"2024-01-30T08:10:13.903650+0000","last_peered":"2024-01-30T08:10:13.903650+0000","last_clean":"2024-01-30T08:10:13.903650+0000","last_became_active":"2024-01-30T08:10:10.899899+0000","last_became_peered":"2024-01-30T08:10:10.899899+0000","last_unstale":"2024-01-30T08:10:13.903650+0000","last_undegraded":"2024-01-30T08:10:13.903650+0000","last_fullsized":"2024-01-30T08:10:13.903650+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:46.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902816+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:10:13.902816+0000","last_peered":"2024-01-30T08:10:13.902816+0000","last_clean":"2024-01-30T08:10:13.902816+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:10:13.902816+0000","last_undegraded":"2024-01-30T08:10:13.902816+0000","last_fullsized":"2024-01-30T08:10:13.902816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918136+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:10:12.918136+0000","last_peered":"2024-01-30T08:10:12.918136+0000","last_clean":"2024-01-30T08:10:12.918136+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:10:12.918136+0000","last_undegraded":"2024-01-30T08:10:12.918136+0000","last_fullsized":"2024-01-30T08:10:12.918136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902420+0000","last_change":"2024-01-30T08:10:11.922174+0000","last_active":"2024-01-30T08:10:13.902420+0000","last_peered":"2024-01-30T08:10:13.902420+0000","last_clean":"2024-01-30T08:10:13.902420+0000","last_became_active":"2024-01-30T08:10:11.921892+0000","last_became_peered":"2024-01-30T08:10:11.921892+0000","last_unstale":"2024-01-30T08:10:13.902420+0000","last_undegraded":"2024-01-30T08:10:13.902420+0000","last_fullsized":"2024-01-30T08:10:13.902420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:02:16.619749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.916851+0000","last_change":"2024-01-30T08:10:10.900526+0000","last_active":"2024-01-30T08:10:12.916851+0000","last_peered":"2024-01-30T08:10:12.916851+0000","last_clean":"2024-01-30T08:10:12.916851+0000","last_became_active":"2024-01-30T08:10:10.900249+0000","last_became_peered":"2024-01-30T08:10:10.900249+0000","last_unstale":"2024-01-30T08:10:12.916851+0000","last_undegraded":"2024-01-30T08:10:12.916851+0000","last_fullsized":"2024-01-30T08:10:12.916851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:11:05.648235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901991+0000","last_change":"2024-01-30T08:09:53.881438+0000","last_active":"2024-01-30T08:10:11.901991+0000","last_peered":"2024-01-30T08:10:11.901991+0000","last_clean":"2024-01-30T08:10:11.901991+0000","last_became_active":"2024-01-30T08:09:53.881166+0000","last_became_peered":"2024-01-30T08:09:53.881166+0000","last_unstale":"2024-01-30T08:10:11.901991+0000","last_undegraded":"2024-01-30T08:10:11.901991+0000","last_fullsized":"2024-01-30T08:10:11.901991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:37.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893536+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:10:11.893536+0000","last_peered":"2024-01-30T08:10:11.893536+0000","last_clean":"2024-01-30T08:10:11.893536+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:10:11.893536+0000","last_undegraded":"2024-01-30T08:10:11.893536+0000","last_fullsized":"2024-01-30T08:10:11.893536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:43.172388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508190+0000","last_change":"2024-01-30T08:10:11.928639+0000","last_active":"2024-01-30T08:10:13.508190+0000","last_peered":"2024-01-30T08:10:13.508190+0000","last_clean":"2024-01-30T08:10:13.508190+0000","last_became_active":"2024-01-30T08:10:11.928399+0000","last_became_peered":"2024-01-30T08:10:11.928399+0000","last_unstale":"2024-01-30T08:10:13.508190+0000","last_undegraded":"2024-01-30T08:10:13.508190+0000","last_fullsized":"2024-01-30T08:10:13.508190+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:02.652613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902051+0000","last_change":"2024-01-30T08:10:10.905030+0000","last_active":"2024-01-30T08:10:11.902051+0000","last_peered":"2024-01-30T08:10:11.902051+0000","last_clean":"2024-01-30T08:10:11.902051+0000","last_became_active":"2024-01-30T08:10:10.901186+0000","last_became_peered":"2024-01-30T08:10:10.901186+0000","last_unstale":"2024-01-30T08:10:11.902051+0000","last_undegraded":"2024-01-30T08:10:11.902051+0000","last_fullsized":"2024-01-30T08:10:11.902051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:30.092942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.894010+0000","last_change":"2024-01-30T08:09:53.881466+0000","last_active":"2024-01-30T08:10:11.894010+0000","last_peered":"2024-01-30T08:10:11.894010+0000","last_clean":"2024-01-30T08:10:11.894010+0000","last_became_active":"2024-01-30T08:09:53.880847+0000","last_became_peered":"2024-01-30T08:09:53.880847+0000","last_unstale":"2024-01-30T08:10:11.894010+0000","last_undegraded":"2024-01-30T08:10:11.894010+0000","last_fullsized":"2024-01-30T08:10:11.894010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:24:30.424249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507788+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:10:13.507788+0000","last_peered":"2024-01-30T08:10:13.507788+0000","last_clean":"2024-01-30T08:10:13.507788+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:10:13.507788+0000","last_undegraded":"2024-01-30T08:10:13.507788+0000","last_fullsized":"2024-01-30T08:10:13.507788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917794+0000","last_change":"2024-01-30T08:10:11.918318+0000","last_active":"2024-01-30T08:10:12.917794+0000","last_peered":"2024-01-30T08:10:12.917794+0000","last_clean":"2024-01-30T08:10:12.917794+0000","last_became_active":"2024-01-30T08:10:11.917861+0000","last_became_peered":"2024-01-30T08:10:11.917861+0000","last_unstale":"2024-01-30T08:10:12.917794+0000","last_undegraded":"2024-01-30T08:10:12.917794+0000","last_fullsized":"2024-01-30T08:10:12.917794+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:59:44.442066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.938380+0000","last_change":"2024-01-30T08:10:10.903517+0000","last_active":"2024-01-30T08:10:11.938380+0000","last_peered":"2024-01-30T08:10:11.938380+0000","last_clean":"2024-01-30T08:10:11.938380+0000","last_became_active":"2024-01-30T08:10:10.903251+0000","last_became_peered":"2024-01-30T08:10:10.903251+0000","last_unstale":"2024-01-30T08:10:11.938380+0000","last_undegraded":"2024-01-30T08:10:11.938380+0000","last_fullsized":"2024-01-30T08:10:11.938380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:26.792702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917662+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:10:12.917662+0000","last_peered":"2024-01-30T08:10:12.917662+0000","last_clean":"2024-01-30T08:10:12.917662+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:10:12.917662+0000","last_undegraded":"2024-01-30T08:10:12.917662+0000","last_fullsized":"2024-01-30T08:10:12.917662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902183+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:10:13.902183+0000","last_peered":"2024-01-30T08:10:13.902183+0000","last_clean":"2024-01-30T08:10:13.902183+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:10:13.902183+0000","last_undegraded":"2024-01-30T08:10:13.902183+0000","last_fullsized":"2024-01-30T08:10:13.902183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508319+0000","last_change":"2024-01-30T08:10:11.935854+0000","last_active":"2024-01-30T08:10:13.508319+0000","last_peered":"2024-01-30T08:10:13.508319+0000","last_clean":"2024-01-30T08:10:13.508319+0000","last_became_active":"2024-01-30T08:10:11.935556+0000","last_became_peered":"2024-01-30T08:10:11.935556+0000","last_unstale":"2024-01-30T08:10:13.508319+0000","last_undegraded":"2024-01-30T08:10:13.508319+0000","last_fullsized":"2024-01-30T08:10:13.508319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:20:00.507002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917356+0000","last_change":"2024-01-30T08:10:10.892381+0000","last_active":"2024-01-30T08:10:12.917356+0000","last_peered":"2024-01-30T08:10:12.917356+0000","last_clean":"2024-01-30T08:10:12.917356+0000","last_became_active":"2024-01-30T08:10:10.892065+0000","last_became_peered":"2024-01-30T08:10:10.892065+0000","last_unstale":"2024-01-30T08:10:12.917356+0000","last_undegraded":"2024-01-30T08:10:12.917356+0000","last_fullsized":"2024-01-30T08:10:12.917356+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:11:05.648235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902984+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:10:13.902984+0000","last_peered":"2024-01-30T08:10:13.902984+0000","last_clean":"2024-01-30T08:10:13.902984+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:10:13.902984+0000","last_undegraded":"2024-01-30T08:10:13.902984+0000","last_fullsized":"2024-01-30T08:10:13.902984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917165+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:10:12.917165+0000","last_peered":"2024-01-30T08:10:12.917165+0000","last_clean":"2024-01-30T08:10:12.917165+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:10:12.917165+0000","last_undegraded":"2024-01-30T08:10:12.917165+0000","last_fullsized":"2024-01-30T08:10:12.917165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.914866+0000","last_change":"2024-01-30T08:10:11.909037+0000","last_active":"2024-01-30T08:10:11.914866+0000","last_peered":"2024-01-30T08:10:11.914866+0000","last_clean":"2024-01-30T08:10:11.914866+0000","last_became_active":"2024-01-30T08:10:11.908779+0000","last_became_peered":"2024-01-30T08:10:11.908779+0000","last_unstale":"2024-01-30T08:10:11.914866+0000","last_undegraded":"2024-01-30T08:10:11.914866+0000","last_fullsized":"2024-01-30T08:10:11.914866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:49:09.368965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507732+0000","last_change":"2024-01-30T08:10:10.907186+0000","last_active":"2024-01-30T08:10:13.507732+0000","last_peered":"2024-01-30T08:10:13.507732+0000","last_clean":"2024-01-30T08:10:13.507732+0000","last_became_active":"2024-01-30T08:10:10.906913+0000","last_became_peered":"2024-01-30T08:10:10.906913+0000","last_unstale":"2024-01-30T08:10:13.507732+0000","last_undegraded":"2024-01-30T08:10:13.507732+0000","last_fullsized":"2024-01-30T08:10:13.507732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:15:41.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918105+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:10:12.918105+0000","last_peered":"2024-01-30T08:10:12.918105+0000","last_clean":"2024-01-30T08:10:12.918105+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:10:12.918105+0000","last_undegraded":"2024-01-30T08:10:12.918105+0000","last_fullsized":"2024-01-30T08:10:12.918105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:23.401989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902950+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:10:13.902950+0000","last_peered":"2024-01-30T08:10:13.902950+0000","last_clean":"2024-01-30T08:10:13.902950+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:10:13.902950+0000","last_undegraded":"2024-01-30T08:10:13.902950+0000","last_fullsized":"2024-01-30T08:10:13.902950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917892+0000","last_change":"2024-01-30T08:10:11.919796+0000","last_active":"2024-01-30T08:10:12.917892+0000","last_peered":"2024-01-30T08:10:12.917892+0000","last_clean":"2024-01-30T08:10:12.917892+0000","last_became_active":"2024-01-30T08:10:11.919542+0000","last_became_peered":"2024-01-30T08:10:11.919542+0000","last_unstale":"2024-01-30T08:10:12.917892+0000","last_undegraded":"2024-01-30T08:10:12.917892+0000","last_fullsized":"2024-01-30T08:10:12.917892+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:48:33.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"42'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902163+0000","last_change":"2024-01-30T08:10:10.902834+0000","last_active":"2024-01-30T08:10:13.902163+0000","last_peered":"2024-01-30T08:10:13.902163+0000","last_clean":"2024-01-30T08:10:13.902163+0000","last_became_active":"2024-01-30T08:10:10.902327+0000","last_became_peered":"2024-01-30T08:10:10.902327+0000","last_unstale":"2024-01-30T08:10:13.902163+0000","last_undegraded":"2024-01-30T08:10:13.902163+0000","last_fullsized":"2024-01-30T08:10:13.902163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:12:21.336314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507978+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:10:13.507978+0000","last_peered":"2024-01-30T08:10:13.507978+0000","last_clean":"2024-01-30T08:10:13.507978+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:10:13.507978+0000","last_undegraded":"2024-01-30T08:10:13.507978+0000","last_fullsized":"2024-01-30T08:10:13.507978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:00:52.172429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896891+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:10:11.896891+0000","last_peered":"2024-01-30T08:10:11.896891+0000","last_clean":"2024-01-30T08:10:11.896891+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:10:11.896891+0000","last_undegraded":"2024-01-30T08:10:11.896891+0000","last_fullsized":"2024-01-30T08:10:11.896891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:37.710856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917135+0000","last_change":"2024-01-30T08:10:11.912363+0000","last_active":"2024-01-30T08:10:12.917135+0000","last_peered":"2024-01-30T08:10:12.917135+0000","last_clean":"2024-01-30T08:10:12.917135+0000","last_became_active":"2024-01-30T08:10:11.912095+0000","last_became_peered":"2024-01-30T08:10:11.912095+0000","last_unstale":"2024-01-30T08:10:12.917135+0000","last_undegraded":"2024-01-30T08:10:12.917135+0000","last_fullsized":"2024-01-30T08:10:12.917135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:52:26.746366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508044+0000","last_change":"2024-01-30T08:10:10.903128+0000","last_active":"2024-01-30T08:10:13.508044+0000","last_peered":"2024-01-30T08:10:13.508044+0000","last_clean":"2024-01-30T08:10:13.508044+0000","last_became_active":"2024-01-30T08:10:10.902794+0000","last_became_peered":"2024-01-30T08:10:10.902794+0000","last_unstale":"2024-01-30T08:10:13.508044+0000","last_undegraded":"2024-01-30T08:10:13.508044+0000","last_fullsized":"2024-01-30T08:10:13.508044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:21:26.713080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905233+0000","last_change":"2024-01-30T08:09:53.883329+0000","last_active":"2024-01-30T08:10:11.905233+0000","last_peered":"2024-01-30T08:10:11.905233+0000","last_clean":"2024-01-30T08:10:11.905233+0000","last_became_active":"2024-01-30T08:09:53.881025+0000","last_became_peered":"2024-01-30T08:09:53.881025+0000","last_unstale":"2024-01-30T08:10:11.905233+0000","last_undegraded":"2024-01-30T08:10:11.905233+0000","last_fullsized":"2024-01-30T08:10:11.905233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:38.717964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896458+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:10:11.896458+0000","last_peered":"2024-01-30T08:10:11.896458+0000","last_clean":"2024-01-30T08:10:11.896458+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:10:11.896458+0000","last_undegraded":"2024-01-30T08:10:11.896458+0000","last_fullsized":"2024-01-30T08:10:11.896458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:51.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.920942+0000","last_change":"2024-01-30T08:10:11.914923+0000","last_active":"2024-01-30T08:10:11.920942+0000","last_peered":"2024-01-30T08:10:11.920942+0000","last_clean":"2024-01-30T08:10:11.920942+0000","last_became_active":"2024-01-30T08:10:11.914536+0000","last_became_peered":"2024-01-30T08:10:11.914536+0000","last_unstale":"2024-01-30T08:10:11.920942+0000","last_undegraded":"2024-01-30T08:10:11.920942+0000","last_fullsized":"2024-01-30T08:10:11.920942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:16.957689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917903+0000","last_change":"2024-01-30T08:10:10.904799+0000","last_active":"2024-01-30T08:10:12.917903+0000","last_peered":"2024-01-30T08:10:12.917903+0000","last_clean":"2024-01-30T08:10:12.917903+0000","last_became_active":"2024-01-30T08:10:10.903907+0000","last_became_peered":"2024-01-30T08:10:10.903907+0000","last_unstale":"2024-01-30T08:10:12.917903+0000","last_undegraded":"2024-01-30T08:10:12.917903+0000","last_fullsized":"2024-01-30T08:10:12.917903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:46.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918214+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:10:12.918214+0000","last_peered":"2024-01-30T08:10:12.918214+0000","last_clean":"2024-01-30T08:10:12.918214+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:10:12.918214+0000","last_undegraded":"2024-01-30T08:10:12.918214+0000","last_fullsized":"2024-01-30T08:10:12.918214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903095+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:10:13.903095+0000","last_peered":"2024-01-30T08:10:13.903095+0000","last_clean":"2024-01-30T08:10:13.903095+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:10:13.903095+0000","last_undegraded":"2024-01-30T08:10:13.903095+0000","last_fullsized":"2024-01-30T08:10:13.903095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902258+0000","last_change":"2024-01-30T08:10:11.915301+0000","last_active":"2024-01-30T08:10:13.902258+0000","last_peered":"2024-01-30T08:10:13.902258+0000","last_clean":"2024-01-30T08:10:13.902258+0000","last_became_active":"2024-01-30T08:10:11.914547+0000","last_became_peered":"2024-01-30T08:10:11.914547+0000","last_unstale":"2024-01-30T08:10:13.902258+0000","last_undegraded":"2024-01-30T08:10:13.902258+0000","last_fullsized":"2024-01-30T08:10:13.902258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:41:40.230931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507303+0000","last_change":"2024-01-30T08:10:10.900588+0000","last_active":"2024-01-30T08:10:13.507303+0000","last_peered":"2024-01-30T08:10:13.507303+0000","last_clean":"2024-01-30T08:10:13.507303+0000","last_became_active":"2024-01-30T08:10:10.900303+0000","last_became_peered":"2024-01-30T08:10:10.900303+0000","last_unstale":"2024-01-30T08:10:13.507303+0000","last_undegraded":"2024-01-30T08:10:13.507303+0000","last_fullsized":"2024-01-30T08:10:13.507303+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:48:32.787279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902146+0000","last_change":"2024-01-30T08:09:53.889988+0000","last_active":"2024-01-30T08:10:11.902146+0000","last_peered":"2024-01-30T08:10:11.902146+0000","last_clean":"2024-01-30T08:10:11.902146+0000","last_became_active":"2024-01-30T08:09:53.888579+0000","last_became_peered":"2024-01-30T08:09:53.888579+0000","last_unstale":"2024-01-30T08:10:11.902146+0000","last_undegraded":"2024-01-30T08:10:11.902146+0000","last_fullsized":"2024-01-30T08:10:11.902146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:01:50.624934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904028+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:10:13.904028+0000","last_peered":"2024-01-30T08:10:13.904028+0000","last_clean":"2024-01-30T08:10:13.904028+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:10:13.904028+0000","last_undegraded":"2024-01-30T08:10:13.904028+0000","last_fullsized":"2024-01-30T08:10:13.904028+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.917315+0000","last_change":"2024-01-30T08:10:11.910494+0000","last_active":"2024-01-30T08:10:11.917315+0000","last_peered":"2024-01-30T08:10:11.917315+0000","last_clean":"2024-01-30T08:10:11.917315+0000","last_became_active":"2024-01-30T08:10:11.910244+0000","last_became_peered":"2024-01-30T08:10:11.910244+0000","last_unstale":"2024-01-30T08:10:11.917315+0000","last_undegraded":"2024-01-30T08:10:11.917315+0000","last_fullsized":"2024-01-30T08:10:11.917315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:10:01.141484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"42'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901216+0000","last_change":"2024-01-30T08:10:10.899760+0000","last_active":"2024-01-30T08:10:13.901216+0000","last_peered":"2024-01-30T08:10:13.901216+0000","last_clean":"2024-01-30T08:10:13.901216+0000","last_became_active":"2024-01-30T08:10:10.899274+0000","last_became_peered":"2024-01-30T08:10:10.899274+0000","last_unstale":"2024-01-30T08:10:13.901216+0000","last_undegraded":"2024-01-30T08:10:13.901216+0000","last_fullsized":"2024-01-30T08:10:13.901216+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:45:50.623110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901166+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:10:13.901166+0000","last_peered":"2024-01-30T08:10:13.901166+0000","last_clean":"2024-01-30T08:10:13.901166+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:10:13.901166+0000","last_undegraded":"2024-01-30T08:10:13.901166+0000","last_fullsized":"2024-01-30T08:10:13.901166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903124+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:10:13.903124+0000","last_peered":"2024-01-30T08:10:13.903124+0000","last_clean":"2024-01-30T08:10:13.903124+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:10:13.903124+0000","last_undegraded":"2024-01-30T08:10:13.903124+0000","last_fullsized":"2024-01-30T08:10:13.903124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.928340+0000","last_change":"2024-01-30T08:10:11.926413+0000","last_active":"2024-01-30T08:10:11.928340+0000","last_peered":"2024-01-30T08:10:11.928340+0000","last_clean":"2024-01-30T08:10:11.928340+0000","last_became_active":"2024-01-30T08:10:11.926117+0000","last_became_peered":"2024-01-30T08:10:11.926117+0000","last_unstale":"2024-01-30T08:10:11.928340+0000","last_undegraded":"2024-01-30T08:10:11.928340+0000","last_fullsized":"2024-01-30T08:10:11.928340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:35:39.078337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.935402+0000","last_change":"2024-01-30T08:10:10.908780+0000","last_active":"2024-01-30T08:10:11.935402+0000","last_peered":"2024-01-30T08:10:11.935402+0000","last_clean":"2024-01-30T08:10:11.935402+0000","last_became_active":"2024-01-30T08:10:10.907095+0000","last_became_peered":"2024-01-30T08:10:10.907095+0000","last_unstale":"2024-01-30T08:10:11.935402+0000","last_undegraded":"2024-01-30T08:10:11.935402+0000","last_fullsized":"2024-01-30T08:10:11.935402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:58.832681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507659+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:10:13.507659+0000","last_peered":"2024-01-30T08:10:13.507659+0000","last_clean":"2024-01-30T08:10:13.507659+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:10:13.507659+0000","last_undegraded":"2024-01-30T08:10:13.507659+0000","last_fullsized":"2024-01-30T08:10:13.507659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917015+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:10:12.917015+0000","last_peered":"2024-01-30T08:10:12.917015+0000","last_clean":"2024-01-30T08:10:12.917015+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:10:12.917015+0000","last_undegraded":"2024-01-30T08:10:12.917015+0000","last_fullsized":"2024-01-30T08:10:12.917015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930107+0000","last_change":"2024-01-30T08:10:11.919713+0000","last_active":"2024-01-30T08:10:11.930107+0000","last_peered":"2024-01-30T08:10:11.930107+0000","last_clean":"2024-01-30T08:10:11.930107+0000","last_became_active":"2024-01-30T08:10:11.919423+0000","last_became_peered":"2024-01-30T08:10:11.919423+0000","last_unstale":"2024-01-30T08:10:11.930107+0000","last_undegraded":"2024-01-30T08:10:11.930107+0000","last_fullsized":"2024-01-30T08:10:11.930107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918325+0000","last_change":"2024-01-30T08:10:10.904324+0000","last_active":"2024-01-30T08:10:12.918325+0000","last_peered":"2024-01-30T08:10:12.918325+0000","last_clean":"2024-01-30T08:10:12.918325+0000","last_became_active":"2024-01-30T08:10:10.903909+0000","last_became_peered":"2024-01-30T08:10:10.903909+0000","last_unstale":"2024-01-30T08:10:12.918325+0000","last_undegraded":"2024-01-30T08:10:12.918325+0000","last_fullsized":"2024-01-30T08:10:12.918325+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:21.535727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903098+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:10:13.903098+0000","last_peered":"2024-01-30T08:10:13.903098+0000","last_clean":"2024-01-30T08:10:13.903098+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:10:13.903098+0000","last_undegraded":"2024-01-30T08:10:13.903098+0000","last_fullsized":"2024-01-30T08:10:13.903098+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507323+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:10:13.507323+0000","last_peered":"2024-01-30T08:10:13.507323+0000","last_clean":"2024-01-30T08:10:13.507323+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:10:13.507323+0000","last_undegraded":"2024-01-30T08:10:13.507323+0000","last_fullsized":"2024-01-30T08:10:13.507323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917459+0000","last_change":"2024-01-30T08:10:11.910522+0000","last_active":"2024-01-30T08:10:12.917459+0000","last_peered":"2024-01-30T08:10:12.917459+0000","last_clean":"2024-01-30T08:10:12.917459+0000","last_became_active":"2024-01-30T08:10:11.910255+0000","last_became_peered":"2024-01-30T08:10:11.910255+0000","last_unstale":"2024-01-30T08:10:12.917459+0000","last_undegraded":"2024-01-30T08:10:12.917459+0000","last_fullsized":"2024-01-30T08:10:12.917459+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:57:54.819218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918643+0000","last_change":"2024-01-30T08:10:10.905548+0000","last_active":"2024-01-30T08:10:12.918643+0000","last_peered":"2024-01-30T08:10:12.918643+0000","last_clean":"2024-01-30T08:10:12.918643+0000","last_became_active":"2024-01-30T08:10:10.905175+0000","last_became_peered":"2024-01-30T08:10:10.905175+0000","last_unstale":"2024-01-30T08:10:12.918643+0000","last_undegraded":"2024-01-30T08:10:12.918643+0000","last_fullsized":"2024-01-30T08:10:12.918643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:55.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902873+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:10:13.902873+0000","last_peered":"2024-01-30T08:10:13.902873+0000","last_clean":"2024-01-30T08:10:13.902873+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:10:13.902873+0000","last_undegraded":"2024-01-30T08:10:13.902873+0000","last_fullsized":"2024-01-30T08:10:13.902873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897197+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:10:11.897197+0000","last_peered":"2024-01-30T08:10:11.897197+0000","last_clean":"2024-01-30T08:10:11.897197+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:10:11.897197+0000","last_undegraded":"2024-01-30T08:10:11.897197+0000","last_fullsized":"2024-01-30T08:10:11.897197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:36.960284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903769+0000","last_change":"2024-01-30T08:10:11.910999+0000","last_active":"2024-01-30T08:10:13.903769+0000","last_peered":"2024-01-30T08:10:13.903769+0000","last_clean":"2024-01-30T08:10:13.903769+0000","last_became_active":"2024-01-30T08:10:11.910726+0000","last_became_peered":"2024-01-30T08:10:11.910726+0000","last_unstale":"2024-01-30T08:10:13.903769+0000","last_undegraded":"2024-01-30T08:10:13.903769+0000","last_fullsized":"2024-01-30T08:10:13.903769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:01:06.679976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918820+0000","last_change":"2024-01-30T08:10:10.906100+0000","last_active":"2024-01-30T08:10:12.918820+0000","last_peered":"2024-01-30T08:10:12.918820+0000","last_clean":"2024-01-30T08:10:12.918820+0000","last_became_active":"2024-01-30T08:10:10.905800+0000","last_became_peered":"2024-01-30T08:10:10.905800+0000","last_unstale":"2024-01-30T08:10:12.918820+0000","last_undegraded":"2024-01-30T08:10:12.918820+0000","last_fullsized":"2024-01-30T08:10:12.918820+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:27:13.081166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.896361+0000","last_change":"2024-01-30T08:09:53.883122+0000","last_active":"2024-01-30T08:10:11.896361+0000","last_peered":"2024-01-30T08:10:11.896361+0000","last_clean":"2024-01-30T08:10:11.896361+0000","last_became_active":"2024-01-30T08:09:53.882631+0000","last_became_peered":"2024-01-30T08:09:53.882631+0000","last_unstale":"2024-01-30T08:10:11.896361+0000","last_undegraded":"2024-01-30T08:10:11.896361+0000","last_fullsized":"2024-01-30T08:10:11.896361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:41.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918170+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:10:12.918170+0000","last_peered":"2024-01-30T08:10:12.918170+0000","last_clean":"2024-01-30T08:10:12.918170+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:10:12.918170+0000","last_undegraded":"2024-01-30T08:10:12.918170+0000","last_fullsized":"2024-01-30T08:10:12.918170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901026+0000","last_change":"2024-01-30T08:10:11.912589+0000","last_active":"2024-01-30T08:10:13.901026+0000","last_peered":"2024-01-30T08:10:13.901026+0000","last_clean":"2024-01-30T08:10:13.901026+0000","last_became_active":"2024-01-30T08:10:11.912296+0000","last_became_peered":"2024-01-30T08:10:11.912296+0000","last_unstale":"2024-01-30T08:10:13.901026+0000","last_undegraded":"2024-01-30T08:10:13.901026+0000","last_fullsized":"2024-01-30T08:10:13.901026+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:50:39.293564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.936401+0000","last_change":"2024-01-30T08:10:10.912271+0000","last_active":"2024-01-30T08:10:11.936401+0000","last_peered":"2024-01-30T08:10:11.936401+0000","last_clean":"2024-01-30T08:10:11.936401+0000","last_became_active":"2024-01-30T08:10:10.911787+0000","last_became_peered":"2024-01-30T08:10:10.911787+0000","last_unstale":"2024-01-30T08:10:11.936401+0000","last_undegraded":"2024-01-30T08:10:11.936401+0000","last_fullsized":"2024-01-30T08:10:11.936401+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:41:52.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918001+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:10:12.918001+0000","last_peered":"2024-01-30T08:10:12.918001+0000","last_clean":"2024-01-30T08:10:12.918001+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:10:12.918001+0000","last_undegraded":"2024-01-30T08:10:12.918001+0000","last_fullsized":"2024-01-30T08:10:12.918001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918331+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:10:12.918331+0000","last_peered":"2024-01-30T08:10:12.918331+0000","last_clean":"2024-01-30T08:10:12.918331+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:10:12.918331+0000","last_undegraded":"2024-01-30T08:10:12.918331+0000","last_fullsized":"2024-01-30T08:10:12.918331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901974+0000","last_change":"2024-01-30T08:10:11.906549+0000","last_active":"2024-01-30T08:10:13.901974+0000","last_peered":"2024-01-30T08:10:13.901974+0000","last_clean":"2024-01-30T08:10:13.901974+0000","last_became_active":"2024-01-30T08:10:11.906263+0000","last_became_peered":"2024-01-30T08:10:11.906263+0000","last_unstale":"2024-01-30T08:10:13.901974+0000","last_undegraded":"2024-01-30T08:10:13.901974+0000","last_fullsized":"2024-01-30T08:10:13.901974+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:00:01.806942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918339+0000","last_change":"2024-01-30T08:10:10.901997+0000","last_active":"2024-01-30T08:10:12.918339+0000","last_peered":"2024-01-30T08:10:12.918339+0000","last_clean":"2024-01-30T08:10:12.918339+0000","last_became_active":"2024-01-30T08:10:10.901704+0000","last_became_peered":"2024-01-30T08:10:10.901704+0000","last_unstale":"2024-01-30T08:10:12.918339+0000","last_undegraded":"2024-01-30T08:10:12.918339+0000","last_fullsized":"2024-01-30T08:10:12.918339+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:48.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918456+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:10:12.918456+0000","last_peered":"2024-01-30T08:10:12.918456+0000","last_clean":"2024-01-30T08:10:12.918456+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:10:12.918456+0000","last_undegraded":"2024-01-30T08:10:12.918456+0000","last_fullsized":"2024-01-30T08:10:12.918456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903760+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:10:13.903760+0000","last_peered":"2024-01-30T08:10:13.903760+0000","last_clean":"2024-01-30T08:10:13.903760+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:10:13.903760+0000","last_undegraded":"2024-01-30T08:10:13.903760+0000","last_fullsized":"2024-01-30T08:10:13.903760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.916984+0000","last_change":"2024-01-30T08:10:11.912714+0000","last_active":"2024-01-30T08:10:11.916984+0000","last_peered":"2024-01-30T08:10:11.916984+0000","last_clean":"2024-01-30T08:10:11.916984+0000","last_became_active":"2024-01-30T08:10:11.912428+0000","last_became_peered":"2024-01-30T08:10:11.912428+0000","last_unstale":"2024-01-30T08:10:11.916984+0000","last_undegraded":"2024-01-30T08:10:11.916984+0000","last_fullsized":"2024-01-30T08:10:11.916984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:37:00.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902543+0000","last_change":"2024-01-30T08:10:10.906011+0000","last_active":"2024-01-30T08:10:11.902543+0000","last_peered":"2024-01-30T08:10:11.902543+0000","last_clean":"2024-01-30T08:10:11.902543+0000","last_became_active":"2024-01-30T08:10:10.905777+0000","last_became_peered":"2024-01-30T08:10:10.905777+0000","last_unstale":"2024-01-30T08:10:11.902543+0000","last_undegraded":"2024-01-30T08:10:11.902543+0000","last_fullsized":"2024-01-30T08:10:11.902543+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:57.576769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507439+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:10:13.507439+0000","last_peered":"2024-01-30T08:10:13.507439+0000","last_clean":"2024-01-30T08:10:13.507439+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:10:13.507439+0000","last_undegraded":"2024-01-30T08:10:13.507439+0000","last_fullsized":"2024-01-30T08:10:13.507439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:13:20.247550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918035+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:10:12.918035+0000","last_peered":"2024-01-30T08:10:12.918035+0000","last_clean":"2024-01-30T08:10:12.918035+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:10:12.918035+0000","last_undegraded":"2024-01-30T08:10:12.918035+0000","last_fullsized":"2024-01-30T08:10:12.918035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903764+0000","last_change":"2024-01-30T08:10:11.913819+0000","last_active":"2024-01-30T08:10:13.903764+0000","last_peered":"2024-01-30T08:10:13.903764+0000","last_clean":"2024-01-30T08:10:13.903764+0000","last_became_active":"2024-01-30T08:10:11.912016+0000","last_became_peered":"2024-01-30T08:10:11.912016+0000","last_unstale":"2024-01-30T08:10:13.903764+0000","last_undegraded":"2024-01-30T08:10:13.903764+0000","last_fullsized":"2024-01-30T08:10:13.903764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:42:30.352856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917330+0000","last_change":"2024-01-30T08:10:10.903002+0000","last_active":"2024-01-30T08:10:12.917330+0000","last_peered":"2024-01-30T08:10:12.917330+0000","last_clean":"2024-01-30T08:10:12.917330+0000","last_became_active":"2024-01-30T08:10:10.902684+0000","last_became_peered":"2024-01-30T08:10:10.902684+0000","last_unstale":"2024-01-30T08:10:12.917330+0000","last_undegraded":"2024-01-30T08:10:12.917330+0000","last_fullsized":"2024-01-30T08:10:12.917330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:04:15.096282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902434+0000","last_change":"2024-01-30T08:09:53.883346+0000","last_active":"2024-01-30T08:10:11.902434+0000","last_peered":"2024-01-30T08:10:11.902434+0000","last_clean":"2024-01-30T08:10:11.902434+0000","last_became_active":"2024-01-30T08:09:53.878878+0000","last_became_peered":"2024-01-30T08:09:53.878878+0000","last_unstale":"2024-01-30T08:10:11.902434+0000","last_undegraded":"2024-01-30T08:10:11.902434+0000","last_fullsized":"2024-01-30T08:10:11.902434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:52.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917678+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:10:12.917678+0000","last_peered":"2024-01-30T08:10:12.917678+0000","last_clean":"2024-01-30T08:10:12.917678+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:10:12.917678+0000","last_undegraded":"2024-01-30T08:10:12.917678+0000","last_fullsized":"2024-01-30T08:10:12.917678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925762+0000","last_change":"2024-01-30T08:10:11.913825+0000","last_active":"2024-01-30T08:10:11.925762+0000","last_peered":"2024-01-30T08:10:11.925762+0000","last_clean":"2024-01-30T08:10:11.925762+0000","last_became_active":"2024-01-30T08:10:11.913570+0000","last_became_peered":"2024-01-30T08:10:11.913570+0000","last_unstale":"2024-01-30T08:10:11.925762+0000","last_undegraded":"2024-01-30T08:10:11.925762+0000","last_fullsized":"2024-01-30T08:10:11.925762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903437+0000","last_change":"2024-01-30T08:10:10.901139+0000","last_active":"2024-01-30T08:10:13.903437+0000","last_peered":"2024-01-30T08:10:13.903437+0000","last_clean":"2024-01-30T08:10:13.903437+0000","last_became_active":"2024-01-30T08:10:10.900931+0000","last_became_peered":"2024-01-30T08:10:10.900931+0000","last_unstale":"2024-01-30T08:10:13.903437+0000","last_undegraded":"2024-01-30T08:10:13.903437+0000","last_fullsized":"2024-01-30T08:10:13.903437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:48.643863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.893380+0000","last_change":"2024-01-30T08:09:53.886717+0000","last_active":"2024-01-30T08:10:11.893380+0000","last_peered":"2024-01-30T08:10:11.893380+0000","last_clean":"2024-01-30T08:10:11.893380+0000","last_became_active":"2024-01-30T08:09:53.884242+0000","last_became_peered":"2024-01-30T08:09:53.884242+0000","last_unstale":"2024-01-30T08:10:11.893380+0000","last_undegraded":"2024-01-30T08:10:11.893380+0000","last_fullsized":"2024-01-30T08:10:11.893380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:05.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508410+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:10:13.508410+0000","last_peered":"2024-01-30T08:10:13.508410+0000","last_clean":"2024-01-30T08:10:13.508410+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:10:13.508410+0000","last_undegraded":"2024-01-30T08:10:13.508410+0000","last_fullsized":"2024-01-30T08:10:13.508410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918723+0000","last_change":"2024-01-30T08:10:11.914155+0000","last_active":"2024-01-30T08:10:12.918723+0000","last_peered":"2024-01-30T08:10:12.918723+0000","last_clean":"2024-01-30T08:10:12.918723+0000","last_became_active":"2024-01-30T08:10:11.913857+0000","last_became_peered":"2024-01-30T08:10:11.913857+0000","last_unstale":"2024-01-30T08:10:12.918723+0000","last_undegraded":"2024-01-30T08:10:12.918723+0000","last_fullsized":"2024-01-30T08:10:12.918723+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:21:27.718257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901305+0000","last_change":"2024-01-30T08:10:10.898471+0000","last_active":"2024-01-30T08:10:13.901305+0000","last_peered":"2024-01-30T08:10:13.901305+0000","last_clean":"2024-01-30T08:10:13.901305+0000","last_became_active":"2024-01-30T08:10:10.898196+0000","last_became_peered":"2024-01-30T08:10:10.898196+0000","last_unstale":"2024-01-30T08:10:13.901305+0000","last_undegraded":"2024-01-30T08:10:13.901305+0000","last_fullsized":"2024-01-30T08:10:13.901305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:06:35.040336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903928+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:10:13.903928+0000","last_peered":"2024-01-30T08:10:13.903928+0000","last_clean":"2024-01-30T08:10:13.903928+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:10:13.903928+0000","last_undegraded":"2024-01-30T08:10:13.903928+0000","last_fullsized":"2024-01-30T08:10:13.903928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917512+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:10:12.917512+0000","last_peered":"2024-01-30T08:10:12.917512+0000","last_clean":"2024-01-30T08:10:12.917512+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:10:12.917512+0000","last_undegraded":"2024-01-30T08:10:12.917512+0000","last_fullsized":"2024-01-30T08:10:12.917512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901861+0000","last_change":"2024-01-30T08:10:11.911028+0000","last_active":"2024-01-30T08:10:13.901861+0000","last_peered":"2024-01-30T08:10:13.901861+0000","last_clean":"2024-01-30T08:10:13.901861+0000","last_became_active":"2024-01-30T08:10:11.910777+0000","last_became_peered":"2024-01-30T08:10:11.910777+0000","last_unstale":"2024-01-30T08:10:13.901861+0000","last_undegraded":"2024-01-30T08:10:13.901861+0000","last_fullsized":"2024-01-30T08:10:13.901861+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:12:22.341491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507876+0000","last_change":"2024-01-30T08:10:10.907980+0000","last_active":"2024-01-30T08:10:13.507876+0000","last_peered":"2024-01-30T08:10:13.507876+0000","last_clean":"2024-01-30T08:10:13.507876+0000","last_became_active":"2024-01-30T08:10:10.907667+0000","last_became_peered":"2024-01-30T08:10:10.907667+0000","last_unstale":"2024-01-30T08:10:13.507876+0000","last_undegraded":"2024-01-30T08:10:13.507876+0000","last_fullsized":"2024-01-30T08:10:13.507876+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:32.700020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903177+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:10:13.903177+0000","last_peered":"2024-01-30T08:10:13.903177+0000","last_clean":"2024-01-30T08:10:13.903177+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:10:13.903177+0000","last_undegraded":"2024-01-30T08:10:13.903177+0000","last_fullsized":"2024-01-30T08:10:13.903177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897331+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:10:11.897331+0000","last_peered":"2024-01-30T08:10:11.897331+0000","last_clean":"2024-01-30T08:10:11.897331+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:10:11.897331+0000","last_undegraded":"2024-01-30T08:10:11.897331+0000","last_fullsized":"2024-01-30T08:10:11.897331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:51.914756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902923+0000","last_change":"2024-01-30T08:10:11.917172+0000","last_active":"2024-01-30T08:10:13.902923+0000","last_peered":"2024-01-30T08:10:13.902923+0000","last_clean":"2024-01-30T08:10:13.902923+0000","last_became_active":"2024-01-30T08:10:11.916907+0000","last_became_peered":"2024-01-30T08:10:11.916907+0000","last_unstale":"2024-01-30T08:10:13.902923+0000","last_undegraded":"2024-01-30T08:10:13.902923+0000","last_fullsized":"2024-01-30T08:10:13.902923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:51:50.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902870+0000","last_change":"2024-01-30T08:10:10.901224+0000","last_active":"2024-01-30T08:10:11.902870+0000","last_peered":"2024-01-30T08:10:11.902870+0000","last_clean":"2024-01-30T08:10:11.902870+0000","last_became_active":"2024-01-30T08:10:10.900957+0000","last_became_peered":"2024-01-30T08:10:10.900957+0000","last_unstale":"2024-01-30T08:10:11.902870+0000","last_undegraded":"2024-01-30T08:10:11.902870+0000","last_fullsized":"2024-01-30T08:10:11.902870+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:23:17.774625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508191+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:10:13.508191+0000","last_peered":"2024-01-30T08:10:13.508191+0000","last_clean":"2024-01-30T08:10:13.508191+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:10:13.508191+0000","last_undegraded":"2024-01-30T08:10:13.508191+0000","last_fullsized":"2024-01-30T08:10:13.508191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918464+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:10:12.918464+0000","last_peered":"2024-01-30T08:10:12.918464+0000","last_clean":"2024-01-30T08:10:12.918464+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:10:12.918464+0000","last_undegraded":"2024-01-30T08:10:12.918464+0000","last_fullsized":"2024-01-30T08:10:12.918464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.925721+0000","last_change":"2024-01-30T08:10:11.911523+0000","last_active":"2024-01-30T08:10:11.925721+0000","last_peered":"2024-01-30T08:10:11.925721+0000","last_clean":"2024-01-30T08:10:11.925721+0000","last_became_active":"2024-01-30T08:10:11.910812+0000","last_became_peered":"2024-01-30T08:10:11.910812+0000","last_unstale":"2024-01-30T08:10:11.925721+0000","last_undegraded":"2024-01-30T08:10:11.925721+0000","last_fullsized":"2024-01-30T08:10:11.925721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:09:17.242374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919016+0000","last_change":"2024-01-30T08:10:10.904370+0000","last_active":"2024-01-30T08:10:12.919016+0000","last_peered":"2024-01-30T08:10:12.919016+0000","last_clean":"2024-01-30T08:10:12.919016+0000","last_became_active":"2024-01-30T08:10:10.903904+0000","last_became_peered":"2024-01-30T08:10:10.903904+0000","last_unstale":"2024-01-30T08:10:12.919016+0000","last_undegraded":"2024-01-30T08:10:12.919016+0000","last_fullsized":"2024-01-30T08:10:12.919016+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:48.643863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902582+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:10:13.902582+0000","last_peered":"2024-01-30T08:10:13.902582+0000","last_clean":"2024-01-30T08:10:13.902582+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:10:13.902582+0000","last_undegraded":"2024-01-30T08:10:13.902582+0000","last_fullsized":"2024-01-30T08:10:13.902582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903990+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:10:11.903990+0000","last_peered":"2024-01-30T08:10:11.903990+0000","last_clean":"2024-01-30T08:10:11.903990+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:10:11.903990+0000","last_undegraded":"2024-01-30T08:10:11.903990+0000","last_fullsized":"2024-01-30T08:10:11.903990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:30:27.351725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.930162+0000","last_change":"2024-01-30T08:10:11.925753+0000","last_active":"2024-01-30T08:10:11.930162+0000","last_peered":"2024-01-30T08:10:11.930162+0000","last_clean":"2024-01-30T08:10:11.930162+0000","last_became_active":"2024-01-30T08:10:11.925478+0000","last_became_peered":"2024-01-30T08:10:11.925478+0000","last_unstale":"2024-01-30T08:10:11.930162+0000","last_undegraded":"2024-01-30T08:10:11.930162+0000","last_fullsized":"2024-01-30T08:10:11.930162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:56:33.687659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917264+0000","last_change":"2024-01-30T08:10:10.894915+0000","last_active":"2024-01-30T08:10:12.917264+0000","last_peered":"2024-01-30T08:10:12.917264+0000","last_clean":"2024-01-30T08:10:12.917264+0000","last_became_active":"2024-01-30T08:10:10.894000+0000","last_became_peered":"2024-01-30T08:10:10.894000+0000","last_unstale":"2024-01-30T08:10:12.917264+0000","last_undegraded":"2024-01-30T08:10:12.917264+0000","last_fullsized":"2024-01-30T08:10:12.917264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:27:13.081166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.902254+0000","last_change":"2024-01-30T08:09:53.882768+0000","last_active":"2024-01-30T08:10:11.902254+0000","last_peered":"2024-01-30T08:10:11.902254+0000","last_clean":"2024-01-30T08:10:11.902254+0000","last_became_active":"2024-01-30T08:09:53.882430+0000","last_became_peered":"2024-01-30T08:09:53.882430+0000","last_unstale":"2024-01-30T08:10:11.902254+0000","last_undegraded":"2024-01-30T08:10:11.902254+0000","last_fullsized":"2024-01-30T08:10:11.902254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:58.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.903223+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:10:11.903223+0000","last_peered":"2024-01-30T08:10:11.903223+0000","last_clean":"2024-01-30T08:10:11.903223+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:10:11.903223+0000","last_undegraded":"2024-01-30T08:10:11.903223+0000","last_fullsized":"2024-01-30T08:10:11.903223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902717+0000","last_change":"2024-01-30T08:10:11.918504+0000","last_active":"2024-01-30T08:10:13.902717+0000","last_peered":"2024-01-30T08:10:13.902717+0000","last_clean":"2024-01-30T08:10:13.902717+0000","last_became_active":"2024-01-30T08:10:11.918257+0000","last_became_peered":"2024-01-30T08:10:11.918257+0000","last_unstale":"2024-01-30T08:10:13.902717+0000","last_undegraded":"2024-01-30T08:10:13.902717+0000","last_fullsized":"2024-01-30T08:10:13.902717+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:31:59.618012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.901534+0000","last_change":"2024-01-30T08:10:10.902200+0000","last_active":"2024-01-30T08:10:11.901534+0000","last_peered":"2024-01-30T08:10:11.901534+0000","last_clean":"2024-01-30T08:10:11.901534+0000","last_became_active":"2024-01-30T08:10:10.901913+0000","last_became_peered":"2024-01-30T08:10:10.901913+0000","last_unstale":"2024-01-30T08:10:11.901534+0000","last_undegraded":"2024-01-30T08:10:11.901534+0000","last_fullsized":"2024-01-30T08:10:11.901534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:26.634238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902094+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:10:13.902094+0000","last_peered":"2024-01-30T08:10:13.902094+0000","last_clean":"2024-01-30T08:10:13.902094+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:10:13.902094+0000","last_undegraded":"2024-01-30T08:10:13.902094+0000","last_fullsized":"2024-01-30T08:10:13.902094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918555+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:10:12.918555+0000","last_peered":"2024-01-30T08:10:12.918555+0000","last_clean":"2024-01-30T08:10:12.918555+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:10:12.918555+0000","last_undegraded":"2024-01-30T08:10:12.918555+0000","last_fullsized":"2024-01-30T08:10:12.918555+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.932589+0000","last_change":"2024-01-30T08:10:11.919869+0000","last_active":"2024-01-30T08:10:11.932589+0000","last_peered":"2024-01-30T08:10:11.932589+0000","last_clean":"2024-01-30T08:10:11.932589+0000","last_became_active":"2024-01-30T08:10:11.916750+0000","last_became_peered":"2024-01-30T08:10:11.916750+0000","last_unstale":"2024-01-30T08:10:11.932589+0000","last_undegraded":"2024-01-30T08:10:11.932589+0000","last_fullsized":"2024-01-30T08:10:11.932589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:13:54.017984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901901+0000","last_change":"2024-01-30T08:10:10.898772+0000","last_active":"2024-01-30T08:10:13.901901+0000","last_peered":"2024-01-30T08:10:13.901901+0000","last_clean":"2024-01-30T08:10:13.901901+0000","last_became_active":"2024-01-30T08:10:10.898513+0000","last_became_peered":"2024-01-30T08:10:10.898513+0000","last_unstale":"2024-01-30T08:10:13.901901+0000","last_undegraded":"2024-01-30T08:10:13.901901+0000","last_fullsized":"2024-01-30T08:10:13.901901+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:00:00.801765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917514+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:10:12.917514+0000","last_peered":"2024-01-30T08:10:12.917514+0000","last_clean":"2024-01-30T08:10:12.917514+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:10:12.917514+0000","last_undegraded":"2024-01-30T08:10:12.917514+0000","last_fullsized":"2024-01-30T08:10:12.917514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917511+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:10:12.917511+0000","last_peered":"2024-01-30T08:10:12.917511+0000","last_clean":"2024-01-30T08:10:12.917511+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:10:12.917511+0000","last_undegraded":"2024-01-30T08:10:12.917511+0000","last_fullsized":"2024-01-30T08:10:12.917511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.929748+0000","last_change":"2024-01-30T08:10:11.927980+0000","last_active":"2024-01-30T08:10:11.929748+0000","last_peered":"2024-01-30T08:10:11.929748+0000","last_clean":"2024-01-30T08:10:11.929748+0000","last_became_active":"2024-01-30T08:10:11.927664+0000","last_became_peered":"2024-01-30T08:10:11.927664+0000","last_unstale":"2024-01-30T08:10:11.929748+0000","last_undegraded":"2024-01-30T08:10:11.929748+0000","last_fullsized":"2024-01-30T08:10:11.929748+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:10:33.702484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901612+0000","last_change":"2024-01-30T08:10:10.899914+0000","last_active":"2024-01-30T08:10:13.901612+0000","last_peered":"2024-01-30T08:10:13.901612+0000","last_clean":"2024-01-30T08:10:13.901612+0000","last_became_active":"2024-01-30T08:10:10.899549+0000","last_became_peered":"2024-01-30T08:10:10.899549+0000","last_unstale":"2024-01-30T08:10:13.901612+0000","last_undegraded":"2024-01-30T08:10:13.901612+0000","last_fullsized":"2024-01-30T08:10:13.901612+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:32.700020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508069+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:10:13.508069+0000","last_peered":"2024-01-30T08:10:13.508069+0000","last_clean":"2024-01-30T08:10:13.508069+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:10:13.508069+0000","last_undegraded":"2024-01-30T08:10:13.508069+0000","last_fullsized":"2024-01-30T08:10:13.508069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901237+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:10:13.901237+0000","last_peered":"2024-01-30T08:10:13.901237+0000","last_clean":"2024-01-30T08:10:13.901237+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:10:13.901237+0000","last_undegraded":"2024-01-30T08:10:13.901237+0000","last_fullsized":"2024-01-30T08:10:13.901237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.916939+0000","last_change":"2024-01-30T08:10:11.903462+0000","last_active":"2024-01-30T08:10:12.916939+0000","last_peered":"2024-01-30T08:10:12.916939+0000","last_clean":"2024-01-30T08:10:12.916939+0000","last_became_active":"2024-01-30T08:10:11.903125+0000","last_became_peered":"2024-01-30T08:10:11.903125+0000","last_unstale":"2024-01-30T08:10:12.916939+0000","last_undegraded":"2024-01-30T08:10:12.916939+0000","last_fullsized":"2024-01-30T08:10:12.916939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:59:44.442066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.905453+0000","last_change":"2024-01-30T08:10:10.907159+0000","last_active":"2024-01-30T08:10:11.905453+0000","last_peered":"2024-01-30T08:10:11.905453+0000","last_clean":"2024-01-30T08:10:11.905453+0000","last_became_active":"2024-01-30T08:10:10.906711+0000","last_became_peered":"2024-01-30T08:10:10.906711+0000","last_unstale":"2024-01-30T08:10:11.905453+0000","last_undegraded":"2024-01-30T08:10:11.905453+0000","last_fullsized":"2024-01-30T08:10:11.905453+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:55:37.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-30T08:10:11.897039+0000","last_change":"2024-01-30T08:09:53.893858+0000","last_active":"2024-01-30T08:10:11.897039+0000","last_peered":"2024-01-30T08:10:11.897039+0000","last_clean":"2024-01-30T08:10:11.897039+0000","last_became_active":"2024-01-30T08:09:53.893613+0000","last_became_peered":"2024-01-30T08:09:53.893613+0000","last_unstale":"2024-01-30T08:10:11.897039+0000","last_undegraded":"2024-01-30T08:10:11.897039+0000","last_fullsized":"2024-01-30T08:10:11.897039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:09.834509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508258+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:10:13.508258+0000","last_peered":"2024-01-30T08:10:13.508258+0000","last_clean":"2024-01-30T08:10:13.508258+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:10:13.508258+0000","last_undegraded":"2024-01-30T08:10:13.508258+0000","last_fullsized":"2024-01-30T08:10:13.508258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507472+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:13.507472+0000","last_peered":"2024-01-30T08:10:13.507472+0000","last_clean":"2024-01-30T08:10:13.507472+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:13.507472+0000","last_undegraded":"2024-01-30T08:10:13.507472+0000","last_fullsized":"2024-01-30T08:10:13.507472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":815493,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.83999999999999997}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.89000000000000001}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.92200000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.82099999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71099999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.75700000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":223058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.58699999999999997}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.64700000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.48199999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":223010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.79700000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.877}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.86699999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":528384,"data_stored":226599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80200000000000005}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.66000000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":512000,"data_stored":223506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67200000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47999999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.88600000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.90900000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.044}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.018}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.94699999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":222074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.318},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.39500000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.436},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.47399999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.629}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":214459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53500000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":804805,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.499}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.372}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.621}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:17.888 INFO:tasks.ceph.mds.d.smithi125.stderr:2024-01-30T08:10:17.883+0000 7fd574a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-30T08:10:19.908 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:10:19.912 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:10:20.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.776+0000 7f67f7e00640 1 Processor -- start 2024-01-30T08:10:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.776+0000 7f67f7e00640 1 -- start start 2024-01-30T08:10:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f7e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67f006a740 0x7f67f00c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f7e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f00c40c0 con 0x7f67f00a9590 2024-01-30T08:10:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f7e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f00aa350 con 0x7f67f006ab20 2024-01-30T08:10:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f7e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f006afd0 con 0x7f67f006a740 2024-01-30T08:10:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f5e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f67f00a9590 0x7f67f015ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49116/0 (socket says 172.21.15.50:49116) 2024-01-30T08:10:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f5e00640 1 -- 172.21.15.50:0/662588428 learned_addr learned my addr 172.21.15.50:0/662588428 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f5400640 1 --2- 172.21.15.50:0/662588428 >> v2:172.21.15.125:3300/0 conn(0x7f67f006a740 0x7f67f00c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67efe00640 1 -- 172.21.15.50:0/662588428 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618245166 0 0) 0x7f67f00c40c0 con 0x7f67f00a9590 2024-01-30T08:10:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67efe00640 1 -- 172.21.15.50:0/662588428 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d0003530 con 0x7f67f00a9590 2024-01-30T08:10:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67efe00640 1 -- 172.21.15.50:0/662588428 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989362400 0 0) 0x7f67f00aa350 con 0x7f67f006ab20 2024-01-30T08:10:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67efe00640 1 -- 172.21.15.50:0/662588428 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f00c40c0 con 0x7f67f006ab20 2024-01-30T08:10:20.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f5400640 1 -- 172.21.15.50:0/662588428 >> v1:172.21.15.125:6789/0 conn(0x7f67f006ab20 legacy=0x7f67f00c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f5400640 1 -- 172.21.15.50:0/662588428 >> v1:172.21.15.50:6789/0 conn(0x7f67f00a9590 legacy=0x7f67f015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:20.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.780+0000 7f67f5400640 1 -- 172.21.15.50:0/662588428 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00aa070 con 0x7f67f006a740 2024-01-30T08:10:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f5400640 1 --2- 172.21.15.50:0/662588428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f00c4b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f67e00097c0 tx=0x7f67e001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755900c0771e79c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67efe00640 1 -- 172.21.15.50:0/662588428 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00ac640 con 0x7f67f006a740 2024-01-30T08:10:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67efe00640 1 -- 172.21.15.50:0/662588428 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e00ac7a0 con 0x7f67f006a740 2024-01-30T08:10:20.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67efe00640 1 -- 172.21.15.50:0/662588428 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00acb30 con 0x7f67f006a740 2024-01-30T08:10:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 -- 172.21.15.50:0/662588428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 msgr2=0x7f67f00c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 --2- 172.21.15.50:0/662588428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f00c4b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f67e00097c0 tx=0x7f67e001c3c0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 -- 172.21.15.50:0/662588428 shutdown_connections 2024-01-30T08:10:20.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 --2- 172.21.15.50:0/662588428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f00c4b60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 -- 172.21.15.50:0/662588428 >> 172.21.15.50:0/662588428 conn(0x7f67f00c5b50 msgr2=0x7f67f00c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:20.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 -- 172.21.15.50:0/662588428 shutdown_connections 2024-01-30T08:10:20.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 -- 172.21.15.50:0/662588428 wait complete. 2024-01-30T08:10:20.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 Processor -- start 2024-01-30T08:10:20.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.784+0000 7f67f7e00640 1 -- start start 2024-01-30T08:10:20.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f006cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:20.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f006ab20 0x7f67f0151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:20.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f00a9590 0x7f67f0151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:20.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f015cbf0 con 0x7f67f006ab20 2024-01-30T08:10:20.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0151ec0 con 0x7f67f006a740 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f015bff0 con 0x7f67f00a9590 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f006ab20 0x7f67f0151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f006ab20 0x7f67f0151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33040/0 (socket says 172.21.15.50:33040) 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f5400640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f006cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 -- 172.21.15.50:0/1811647208 learned_addr learned my addr 172.21.15.50:0/1811647208 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f5e00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f00a9590 0x7f67f0151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 -- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f00a9590 msgr2=0x7f67f0151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f00a9590 0x7f67f0151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 -- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 msgr2=0x7f67f006cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f006cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 -- 172.21.15.50:0/1811647208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0009420 con 0x7f67f006ab20 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f5400640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f006cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:20.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f4a00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f006ab20 0x7f67f0151440 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f67d800c460 tx=0x7f67d800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67ed600640 1 -- 172.21.15.50:0/1811647208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80052d0 con 0x7f67f006ab20 2024-01-30T08:10:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67ed600640 1 -- 172.21.15.50:0/1811647208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d8005450 con 0x7f67f006ab20 2024-01-30T08:10:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67ed600640 1 -- 172.21.15.50:0/1811647208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8003840 con 0x7f67f006ab20 2024-01-30T08:10:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f01ed800 con 0x7f67f006ab20 2024-01-30T08:10:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f015c910 con 0x7f67f006ab20 2024-01-30T08:10:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f01ed5d0 con 0x7f67f006ab20 2024-01-30T08:10:20.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.788+0000 7f67ed600640 1 -- 172.21.15.50:0/1811647208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f67d80039a0 con 0x7f67f006ab20 2024-01-30T08:10:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.792+0000 7f67ed600640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c8066500 0x7f67c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.792+0000 7f67ed600640 1 -- 172.21.15.50:0/1811647208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f67d8083880 con 0x7f67f006ab20 2024-01-30T08:10:20.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.792+0000 7f67f5400640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c8066500 0x7f67c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.792+0000 7f67f5400640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c8066500 0x7f67c80689c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f67e00ae000 tx=0x7f67e00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:20.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.796+0000 7f67ed600640 1 -- 172.21.15.50:0/1811647208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f67f01ed5d0 con 0x7f67f006ab20 2024-01-30T08:10:20.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.952+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67f00c13c0 con 0x7f67c8066500 2024-01-30T08:10:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.968+0000 7f67ed600640 1 -- 172.21.15.50:0/1811647208 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528215 (secure 0 0 0) 0x7f67e00accc0 con 0x7f67c8066500 2024-01-30T08:10:20.975 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c8066500 msgr2=0x7f67c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c8066500 0x7f67c80689c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f67e00ae000 tx=0x7f67e00a7000 comp rx=0 tx=0).stop 2024-01-30T08:10:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f006ab20 msgr2=0x7f67f0151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f006ab20 0x7f67f0151440 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f67d800c460 tx=0x7f67d800c920 comp rx=0 tx=0).stop 2024-01-30T08:10:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 shutdown_connections 2024-01-30T08:10:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c8066500 0x7f67c80689c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f00a9590 0x7f67f0151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f006ab20 0x7f67f0151440 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 --2- 172.21.15.50:0/1811647208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f006a740 0x7f67f006cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 >> 172.21.15.50:0/1811647208 conn(0x7f67f00c5b50 msgr2=0x7f67f00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 shutdown_connections 2024-01-30T08:10:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:20.972+0000 7f67f7e00640 1 -- 172.21.15.50:0/1811647208 wait complete. 2024-01-30T08:10:20.995 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-01-30T08:10:19.073930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":252,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":351,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236952,"kb_used_data":4128,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737768,"statfs":{"total":773094113280,"available":772851474432,"internally_reserved":0,"allocated":4227072,"data_stored":2967958,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001936"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507443+0000","last_change":"2024-01-30T08:10:11.932403+0000","last_active":"2024-01-30T08:10:13.507443+0000","last_peered":"2024-01-30T08:10:13.507443+0000","last_clean":"2024-01-30T08:10:13.507443+0000","last_became_active":"2024-01-30T08:10:11.932098+0000","last_became_peered":"2024-01-30T08:10:11.932098+0000","last_unstale":"2024-01-30T08:10:13.507443+0000","last_undegraded":"2024-01-30T08:10:13.507443+0000","last_fullsized":"2024-01-30T08:10:13.507443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:13.993728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902866+0000","last_change":"2024-01-30T08:09:53.891078+0000","last_active":"2024-01-30T08:10:13.902866+0000","last_peered":"2024-01-30T08:10:13.902866+0000","last_clean":"2024-01-30T08:10:13.902866+0000","last_became_active":"2024-01-30T08:09:53.890719+0000","last_became_peered":"2024-01-30T08:09:53.890719+0000","last_unstale":"2024-01-30T08:10:13.902866+0000","last_undegraded":"2024-01-30T08:10:13.902866+0000","last_fullsized":"2024-01-30T08:10:13.902866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:31.685669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.900924+0000","last_change":"2024-01-30T08:10:11.909840+0000","last_active":"2024-01-30T08:10:13.900924+0000","last_peered":"2024-01-30T08:10:13.900924+0000","last_clean":"2024-01-30T08:10:13.900924+0000","last_became_active":"2024-01-30T08:10:11.909510+0000","last_became_peered":"2024-01-30T08:10:11.909510+0000","last_unstale":"2024-01-30T08:10:13.900924+0000","last_undegraded":"2024-01-30T08:10:13.900924+0000","last_fullsized":"2024-01-30T08:10:13.900924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:33.705197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902479+0000","last_change":"2024-01-30T08:09:53.881090+0000","last_active":"2024-01-30T08:10:13.902479+0000","last_peered":"2024-01-30T08:10:13.902479+0000","last_clean":"2024-01-30T08:10:13.902479+0000","last_became_active":"2024-01-30T08:09:53.880735+0000","last_became_peered":"2024-01-30T08:09:53.880735+0000","last_unstale":"2024-01-30T08:10:13.902479+0000","last_undegraded":"2024-01-30T08:10:13.902479+0000","last_fullsized":"2024-01-30T08:10:13.902479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:29.547990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903370+0000","last_change":"2024-01-30T08:10:11.918145+0000","last_active":"2024-01-30T08:10:13.903370+0000","last_peered":"2024-01-30T08:10:13.903370+0000","last_clean":"2024-01-30T08:10:13.903370+0000","last_became_active":"2024-01-30T08:10:11.917857+0000","last_became_peered":"2024-01-30T08:10:11.917857+0000","last_unstale":"2024-01-30T08:10:13.903370+0000","last_undegraded":"2024-01-30T08:10:13.903370+0000","last_fullsized":"2024-01-30T08:10:13.903370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:45:51.628287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903875+0000","last_change":"2024-01-30T08:09:53.888831+0000","last_active":"2024-01-30T08:10:13.903875+0000","last_peered":"2024-01-30T08:10:13.903875+0000","last_clean":"2024-01-30T08:10:13.903875+0000","last_became_active":"2024-01-30T08:09:53.888512+0000","last_became_peered":"2024-01-30T08:09:53.888512+0000","last_unstale":"2024-01-30T08:10:13.903875+0000","last_undegraded":"2024-01-30T08:10:13.903875+0000","last_fullsized":"2024-01-30T08:10:13.903875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:19.673462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901954+0000","last_change":"2024-01-30T08:10:11.925833+0000","last_active":"2024-01-30T08:10:13.901954+0000","last_peered":"2024-01-30T08:10:13.901954+0000","last_clean":"2024-01-30T08:10:13.901954+0000","last_became_active":"2024-01-30T08:10:11.925416+0000","last_became_peered":"2024-01-30T08:10:11.925416+0000","last_unstale":"2024-01-30T08:10:13.901954+0000","last_undegraded":"2024-01-30T08:10:13.901954+0000","last_fullsized":"2024-01-30T08:10:13.901954+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:01:42.498748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918018+0000","last_change":"2024-01-30T08:09:53.875848+0000","last_active":"2024-01-30T08:10:12.918018+0000","last_peered":"2024-01-30T08:10:12.918018+0000","last_clean":"2024-01-30T08:10:12.918018+0000","last_became_active":"2024-01-30T08:09:53.875154+0000","last_became_peered":"2024-01-30T08:09:53.875154+0000","last_unstale":"2024-01-30T08:10:12.918018+0000","last_undegraded":"2024-01-30T08:10:12.918018+0000","last_fullsized":"2024-01-30T08:10:12.918018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918256+0000","last_change":"2024-01-30T08:10:11.924224+0000","last_active":"2024-01-30T08:10:12.918256+0000","last_peered":"2024-01-30T08:10:12.918256+0000","last_clean":"2024-01-30T08:10:12.918256+0000","last_became_active":"2024-01-30T08:10:11.923933+0000","last_became_peered":"2024-01-30T08:10:11.923933+0000","last_unstale":"2024-01-30T08:10:12.918256+0000","last_undegraded":"2024-01-30T08:10:12.918256+0000","last_fullsized":"2024-01-30T08:10:12.918256+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:18.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917911+0000","last_change":"2024-01-30T08:09:53.870497+0000","last_active":"2024-01-30T08:10:12.917911+0000","last_peered":"2024-01-30T08:10:12.917911+0000","last_clean":"2024-01-30T08:10:12.917911+0000","last_became_active":"2024-01-30T08:09:53.870215+0000","last_became_peered":"2024-01-30T08:09:53.870215+0000","last_unstale":"2024-01-30T08:10:12.917911+0000","last_undegraded":"2024-01-30T08:10:12.917911+0000","last_fullsized":"2024-01-30T08:10:12.917911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:47.332748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902379+0000","last_change":"2024-01-30T08:10:11.906567+0000","last_active":"2024-01-30T08:10:13.902379+0000","last_peered":"2024-01-30T08:10:13.902379+0000","last_clean":"2024-01-30T08:10:13.902379+0000","last_became_active":"2024-01-30T08:10:11.905650+0000","last_became_peered":"2024-01-30T08:10:11.905650+0000","last_unstale":"2024-01-30T08:10:13.902379+0000","last_undegraded":"2024-01-30T08:10:13.902379+0000","last_fullsized":"2024-01-30T08:10:13.902379+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:29:47.946644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903087+0000","last_change":"2024-01-30T08:09:53.893974+0000","last_active":"2024-01-30T08:10:13.903087+0000","last_peered":"2024-01-30T08:10:13.903087+0000","last_clean":"2024-01-30T08:10:13.903087+0000","last_became_active":"2024-01-30T08:09:53.893672+0000","last_became_peered":"2024-01-30T08:09:53.893672+0000","last_unstale":"2024-01-30T08:10:13.903087+0000","last_undegraded":"2024-01-30T08:10:13.903087+0000","last_fullsized":"2024-01-30T08:10:13.903087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902612+0000","last_change":"2024-01-30T08:10:11.926171+0000","last_active":"2024-01-30T08:10:13.902612+0000","last_peered":"2024-01-30T08:10:13.902612+0000","last_clean":"2024-01-30T08:10:13.902612+0000","last_became_active":"2024-01-30T08:10:11.924275+0000","last_became_peered":"2024-01-30T08:10:11.924275+0000","last_unstale":"2024-01-30T08:10:13.902612+0000","last_undegraded":"2024-01-30T08:10:13.902612+0000","last_fullsized":"2024-01-30T08:10:13.902612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:29:24.179739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899241+0000","last_change":"2024-01-30T08:09:53.884011+0000","last_active":"2024-01-30T08:10:13.899241+0000","last_peered":"2024-01-30T08:10:13.899241+0000","last_clean":"2024-01-30T08:10:13.899241+0000","last_became_active":"2024-01-30T08:09:53.881881+0000","last_became_peered":"2024-01-30T08:09:53.881881+0000","last_unstale":"2024-01-30T08:10:13.899241+0000","last_undegraded":"2024-01-30T08:10:13.899241+0000","last_fullsized":"2024-01-30T08:10:13.899241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:04:50.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903417+0000","last_change":"2024-01-30T08:10:11.918156+0000","last_active":"2024-01-30T08:10:13.903417+0000","last_peered":"2024-01-30T08:10:13.903417+0000","last_clean":"2024-01-30T08:10:13.903417+0000","last_became_active":"2024-01-30T08:10:11.917883+0000","last_became_peered":"2024-01-30T08:10:11.917883+0000","last_unstale":"2024-01-30T08:10:13.903417+0000","last_undegraded":"2024-01-30T08:10:13.903417+0000","last_fullsized":"2024-01-30T08:10:13.903417+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:50:22.597566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901135+0000","last_change":"2024-01-30T08:09:53.891571+0000","last_active":"2024-01-30T08:10:13.901135+0000","last_peered":"2024-01-30T08:10:13.901135+0000","last_clean":"2024-01-30T08:10:13.901135+0000","last_became_active":"2024-01-30T08:09:53.886586+0000","last_became_peered":"2024-01-30T08:09:53.886586+0000","last_unstale":"2024-01-30T08:10:13.901135+0000","last_undegraded":"2024-01-30T08:10:13.901135+0000","last_fullsized":"2024-01-30T08:10:13.901135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903342+0000","last_change":"2024-01-30T08:10:11.929495+0000","last_active":"2024-01-30T08:10:13.903342+0000","last_peered":"2024-01-30T08:10:13.903342+0000","last_clean":"2024-01-30T08:10:13.903342+0000","last_became_active":"2024-01-30T08:10:11.928578+0000","last_became_peered":"2024-01-30T08:10:11.928578+0000","last_unstale":"2024-01-30T08:10:13.903342+0000","last_undegraded":"2024-01-30T08:10:13.903342+0000","last_fullsized":"2024-01-30T08:10:13.903342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:37:22.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904840+0000","last_change":"2024-01-30T08:09:53.887909+0000","last_active":"2024-01-30T08:10:13.904840+0000","last_peered":"2024-01-30T08:10:13.904840+0000","last_clean":"2024-01-30T08:10:13.904840+0000","last_became_active":"2024-01-30T08:09:53.887634+0000","last_became_peered":"2024-01-30T08:09:53.887634+0000","last_unstale":"2024-01-30T08:10:13.904840+0000","last_undegraded":"2024-01-30T08:10:13.904840+0000","last_fullsized":"2024-01-30T08:10:13.904840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:52.921864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.900967+0000","last_change":"2024-01-30T08:10:11.917861+0000","last_active":"2024-01-30T08:10:13.900967+0000","last_peered":"2024-01-30T08:10:13.900967+0000","last_clean":"2024-01-30T08:10:13.900967+0000","last_became_active":"2024-01-30T08:10:11.915988+0000","last_became_peered":"2024-01-30T08:10:11.915988+0000","last_unstale":"2024-01-30T08:10:13.900967+0000","last_undegraded":"2024-01-30T08:10:13.900967+0000","last_fullsized":"2024-01-30T08:10:13.900967+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:20:00.507002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899656+0000","last_change":"2024-01-30T08:09:53.883502+0000","last_active":"2024-01-30T08:10:13.899656+0000","last_peered":"2024-01-30T08:10:13.899656+0000","last_clean":"2024-01-30T08:10:13.899656+0000","last_became_active":"2024-01-30T08:09:53.883146+0000","last_became_peered":"2024-01-30T08:09:53.883146+0000","last_unstale":"2024-01-30T08:10:13.899656+0000","last_undegraded":"2024-01-30T08:10:13.899656+0000","last_fullsized":"2024-01-30T08:10:13.899656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:13.134749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917742+0000","last_change":"2024-01-30T08:10:11.926194+0000","last_active":"2024-01-30T08:10:12.917742+0000","last_peered":"2024-01-30T08:10:12.917742+0000","last_clean":"2024-01-30T08:10:12.917742+0000","last_became_active":"2024-01-30T08:10:11.925933+0000","last_became_peered":"2024-01-30T08:10:11.925933+0000","last_unstale":"2024-01-30T08:10:12.917742+0000","last_undegraded":"2024-01-30T08:10:12.917742+0000","last_fullsized":"2024-01-30T08:10:12.917742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:22.541776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899262+0000","last_change":"2024-01-30T08:09:53.883798+0000","last_active":"2024-01-30T08:10:13.899262+0000","last_peered":"2024-01-30T08:10:13.899262+0000","last_clean":"2024-01-30T08:10:13.899262+0000","last_became_active":"2024-01-30T08:09:53.883077+0000","last_became_peered":"2024-01-30T08:09:53.883077+0000","last_unstale":"2024-01-30T08:10:13.899262+0000","last_undegraded":"2024-01-30T08:10:13.899262+0000","last_fullsized":"2024-01-30T08:10:13.899262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:40.618576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901712+0000","last_change":"2024-01-30T08:10:11.920412+0000","last_active":"2024-01-30T08:10:13.901712+0000","last_peered":"2024-01-30T08:10:13.901712+0000","last_clean":"2024-01-30T08:10:13.901712+0000","last_became_active":"2024-01-30T08:10:11.920222+0000","last_became_peered":"2024-01-30T08:10:11.920222+0000","last_unstale":"2024-01-30T08:10:13.901712+0000","last_undegraded":"2024-01-30T08:10:13.901712+0000","last_fullsized":"2024-01-30T08:10:13.901712+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:06:36.045513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902504+0000","last_change":"2024-01-30T08:09:53.880237+0000","last_active":"2024-01-30T08:10:13.902504+0000","last_peered":"2024-01-30T08:10:13.902504+0000","last_clean":"2024-01-30T08:10:13.902504+0000","last_became_active":"2024-01-30T08:09:53.879920+0000","last_became_peered":"2024-01-30T08:09:53.879920+0000","last_unstale":"2024-01-30T08:10:13.902504+0000","last_undegraded":"2024-01-30T08:10:13.902504+0000","last_fullsized":"2024-01-30T08:10:13.902504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:31:19.905033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902703+0000","last_change":"2024-01-30T08:10:11.928221+0000","last_active":"2024-01-30T08:10:13.902703+0000","last_peered":"2024-01-30T08:10:13.902703+0000","last_clean":"2024-01-30T08:10:13.902703+0000","last_became_active":"2024-01-30T08:10:11.924922+0000","last_became_peered":"2024-01-30T08:10:11.924922+0000","last_unstale":"2024-01-30T08:10:13.902703+0000","last_undegraded":"2024-01-30T08:10:13.902703+0000","last_fullsized":"2024-01-30T08:10:13.902703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:14:39.027622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898869+0000","last_change":"2024-01-30T08:09:53.879036+0000","last_active":"2024-01-30T08:10:13.898869+0000","last_peered":"2024-01-30T08:10:13.898869+0000","last_clean":"2024-01-30T08:10:13.898869+0000","last_became_active":"2024-01-30T08:09:53.878757+0000","last_became_peered":"2024-01-30T08:09:53.878757+0000","last_unstale":"2024-01-30T08:10:13.898869+0000","last_undegraded":"2024-01-30T08:10:13.898869+0000","last_fullsized":"2024-01-30T08:10:13.898869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:32:50.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508183+0000","last_change":"2024-01-30T08:10:11.933824+0000","last_active":"2024-01-30T08:10:13.508183+0000","last_peered":"2024-01-30T08:10:13.508183+0000","last_clean":"2024-01-30T08:10:13.508183+0000","last_became_active":"2024-01-30T08:10:11.933501+0000","last_became_peered":"2024-01-30T08:10:11.933501+0000","last_unstale":"2024-01-30T08:10:13.508183+0000","last_undegraded":"2024-01-30T08:10:13.508183+0000","last_fullsized":"2024-01-30T08:10:13.508183+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:02:57.291089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917467+0000","last_change":"2024-01-30T08:09:53.879965+0000","last_active":"2024-01-30T08:10:12.917467+0000","last_peered":"2024-01-30T08:10:12.917467+0000","last_clean":"2024-01-30T08:10:12.917467+0000","last_became_active":"2024-01-30T08:09:53.877793+0000","last_became_peered":"2024-01-30T08:09:53.877793+0000","last_unstale":"2024-01-30T08:10:12.917467+0000","last_undegraded":"2024-01-30T08:10:12.917467+0000","last_fullsized":"2024-01-30T08:10:12.917467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:55:01.234275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903536+0000","last_change":"2024-01-30T08:10:11.903620+0000","last_active":"2024-01-30T08:10:13.903536+0000","last_peered":"2024-01-30T08:10:13.903536+0000","last_clean":"2024-01-30T08:10:13.903536+0000","last_became_active":"2024-01-30T08:10:11.903324+0000","last_became_peered":"2024-01-30T08:10:11.903324+0000","last_unstale":"2024-01-30T08:10:13.903536+0000","last_undegraded":"2024-01-30T08:10:13.903536+0000","last_fullsized":"2024-01-30T08:10:13.903536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:54:07.037992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899020+0000","last_change":"2024-01-30T08:09:53.886393+0000","last_active":"2024-01-30T08:10:13.899020+0000","last_peered":"2024-01-30T08:10:13.899020+0000","last_clean":"2024-01-30T08:10:13.899020+0000","last_became_active":"2024-01-30T08:09:53.881749+0000","last_became_peered":"2024-01-30T08:09:53.881749+0000","last_unstale":"2024-01-30T08:10:13.899020+0000","last_undegraded":"2024-01-30T08:10:13.899020+0000","last_fullsized":"2024-01-30T08:10:13.899020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:22.523025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507882+0000","last_change":"2024-01-30T08:10:11.931072+0000","last_active":"2024-01-30T08:10:13.507882+0000","last_peered":"2024-01-30T08:10:13.507882+0000","last_clean":"2024-01-30T08:10:13.507882+0000","last_became_active":"2024-01-30T08:10:11.929521+0000","last_became_peered":"2024-01-30T08:10:11.929521+0000","last_unstale":"2024-01-30T08:10:13.507882+0000","last_undegraded":"2024-01-30T08:10:13.507882+0000","last_fullsized":"2024-01-30T08:10:13.507882+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:29:45.740630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507315+0000","last_change":"2024-01-30T08:09:53.887726+0000","last_active":"2024-01-30T08:10:13.507315+0000","last_peered":"2024-01-30T08:10:13.507315+0000","last_clean":"2024-01-30T08:10:13.507315+0000","last_became_active":"2024-01-30T08:09:53.887380+0000","last_became_peered":"2024-01-30T08:09:53.887380+0000","last_unstale":"2024-01-30T08:10:13.507315+0000","last_undegraded":"2024-01-30T08:10:13.507315+0000","last_fullsized":"2024-01-30T08:10:13.507315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902186+0000","last_change":"2024-01-30T08:10:11.931335+0000","last_active":"2024-01-30T08:10:13.902186+0000","last_peered":"2024-01-30T08:10:13.902186+0000","last_clean":"2024-01-30T08:10:13.902186+0000","last_became_active":"2024-01-30T08:10:11.931065+0000","last_became_peered":"2024-01-30T08:10:11.931065+0000","last_unstale":"2024-01-30T08:10:13.902186+0000","last_undegraded":"2024-01-30T08:10:13.902186+0000","last_fullsized":"2024-01-30T08:10:13.902186+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:24:39.718984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508288+0000","last_change":"2024-01-30T08:09:53.888942+0000","last_active":"2024-01-30T08:10:13.508288+0000","last_peered":"2024-01-30T08:10:13.508288+0000","last_clean":"2024-01-30T08:10:13.508288+0000","last_became_active":"2024-01-30T08:09:53.888650+0000","last_became_peered":"2024-01-30T08:09:53.888650+0000","last_unstale":"2024-01-30T08:10:13.508288+0000","last_undegraded":"2024-01-30T08:10:13.508288+0000","last_fullsized":"2024-01-30T08:10:13.508288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898636+0000","last_change":"2024-01-30T08:10:11.911805+0000","last_active":"2024-01-30T08:10:13.898636+0000","last_peered":"2024-01-30T08:10:13.898636+0000","last_clean":"2024-01-30T08:10:13.898636+0000","last_became_active":"2024-01-30T08:10:11.911191+0000","last_became_peered":"2024-01-30T08:10:11.911191+0000","last_unstale":"2024-01-30T08:10:13.898636+0000","last_undegraded":"2024-01-30T08:10:13.898636+0000","last_fullsized":"2024-01-30T08:10:13.898636+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:41:10.684189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918889+0000","last_change":"2024-01-30T08:09:53.871522+0000","last_active":"2024-01-30T08:10:12.918889+0000","last_peered":"2024-01-30T08:10:12.918889+0000","last_clean":"2024-01-30T08:10:12.918889+0000","last_became_active":"2024-01-30T08:09:53.871186+0000","last_became_peered":"2024-01-30T08:09:53.871186+0000","last_unstale":"2024-01-30T08:10:12.918889+0000","last_undegraded":"2024-01-30T08:10:12.918889+0000","last_fullsized":"2024-01-30T08:10:12.918889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:58.083540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901962+0000","last_change":"2024-01-30T08:10:11.908732+0000","last_active":"2024-01-30T08:10:13.901962+0000","last_peered":"2024-01-30T08:10:13.901962+0000","last_clean":"2024-01-30T08:10:13.901962+0000","last_became_active":"2024-01-30T08:10:11.908460+0000","last_became_peered":"2024-01-30T08:10:11.908460+0000","last_unstale":"2024-01-30T08:10:13.901962+0000","last_undegraded":"2024-01-30T08:10:13.901962+0000","last_fullsized":"2024-01-30T08:10:13.901962+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:30:30.760001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918365+0000","last_change":"2024-01-30T08:09:53.879503+0000","last_active":"2024-01-30T08:10:12.918365+0000","last_peered":"2024-01-30T08:10:12.918365+0000","last_clean":"2024-01-30T08:10:12.918365+0000","last_became_active":"2024-01-30T08:09:53.879155+0000","last_became_peered":"2024-01-30T08:09:53.879155+0000","last_unstale":"2024-01-30T08:10:12.918365+0000","last_undegraded":"2024-01-30T08:10:12.918365+0000","last_fullsized":"2024-01-30T08:10:12.918365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507875+0000","last_change":"2024-01-30T08:10:11.936287+0000","last_active":"2024-01-30T08:10:13.507875+0000","last_peered":"2024-01-30T08:10:13.507875+0000","last_clean":"2024-01-30T08:10:13.507875+0000","last_became_active":"2024-01-30T08:10:11.935989+0000","last_became_peered":"2024-01-30T08:10:11.935989+0000","last_unstale":"2024-01-30T08:10:13.507875+0000","last_undegraded":"2024-01-30T08:10:13.507875+0000","last_fullsized":"2024-01-30T08:10:13.507875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:11:50.982119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919136+0000","last_change":"2024-01-30T08:09:53.871370+0000","last_active":"2024-01-30T08:10:12.919136+0000","last_peered":"2024-01-30T08:10:12.919136+0000","last_clean":"2024-01-30T08:10:12.919136+0000","last_became_active":"2024-01-30T08:09:53.871085+0000","last_became_peered":"2024-01-30T08:09:53.871085+0000","last_unstale":"2024-01-30T08:10:12.919136+0000","last_undegraded":"2024-01-30T08:10:12.919136+0000","last_fullsized":"2024-01-30T08:10:12.919136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:10.602739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904367+0000","last_change":"2024-01-30T08:10:11.908608+0000","last_active":"2024-01-30T08:10:13.904367+0000","last_peered":"2024-01-30T08:10:13.904367+0000","last_clean":"2024-01-30T08:10:13.904367+0000","last_became_active":"2024-01-30T08:10:11.908311+0000","last_became_peered":"2024-01-30T08:10:11.908311+0000","last_unstale":"2024-01-30T08:10:13.904367+0000","last_undegraded":"2024-01-30T08:10:13.904367+0000","last_fullsized":"2024-01-30T08:10:13.904367+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:34.378522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899090+0000","last_change":"2024-01-30T08:09:53.884047+0000","last_active":"2024-01-30T08:10:13.899090+0000","last_peered":"2024-01-30T08:10:13.899090+0000","last_clean":"2024-01-30T08:10:13.899090+0000","last_became_active":"2024-01-30T08:09:53.883765+0000","last_became_peered":"2024-01-30T08:09:53.883765+0000","last_unstale":"2024-01-30T08:10:13.899090+0000","last_undegraded":"2024-01-30T08:10:13.899090+0000","last_fullsized":"2024-01-30T08:10:13.899090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:54:01.174660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918762+0000","last_change":"2024-01-30T08:10:11.914067+0000","last_active":"2024-01-30T08:10:12.918762+0000","last_peered":"2024-01-30T08:10:12.918762+0000","last_clean":"2024-01-30T08:10:12.918762+0000","last_became_active":"2024-01-30T08:10:11.913126+0000","last_became_peered":"2024-01-30T08:10:11.913126+0000","last_unstale":"2024-01-30T08:10:12.918762+0000","last_undegraded":"2024-01-30T08:10:12.918762+0000","last_fullsized":"2024-01-30T08:10:12.918762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:15:42.380354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917611+0000","last_change":"2024-01-30T08:09:53.875159+0000","last_active":"2024-01-30T08:10:12.917611+0000","last_peered":"2024-01-30T08:10:12.917611+0000","last_clean":"2024-01-30T08:10:12.917611+0000","last_became_active":"2024-01-30T08:09:53.872405+0000","last_became_peered":"2024-01-30T08:09:53.872405+0000","last_unstale":"2024-01-30T08:10:12.917611+0000","last_undegraded":"2024-01-30T08:10:12.917611+0000","last_fullsized":"2024-01-30T08:10:12.917611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904672+0000","last_change":"2024-01-30T08:10:11.917501+0000","last_active":"2024-01-30T08:10:13.904672+0000","last_peered":"2024-01-30T08:10:13.904672+0000","last_clean":"2024-01-30T08:10:13.904672+0000","last_became_active":"2024-01-30T08:10:11.917148+0000","last_became_peered":"2024-01-30T08:10:11.917148+0000","last_unstale":"2024-01-30T08:10:13.904672+0000","last_undegraded":"2024-01-30T08:10:13.904672+0000","last_fullsized":"2024-01-30T08:10:13.904672+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:07:18.564861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507533+0000","last_change":"2024-01-30T08:09:53.889366+0000","last_active":"2024-01-30T08:10:13.507533+0000","last_peered":"2024-01-30T08:10:13.507533+0000","last_clean":"2024-01-30T08:10:13.507533+0000","last_became_active":"2024-01-30T08:09:53.889032+0000","last_became_peered":"2024-01-30T08:09:53.889032+0000","last_unstale":"2024-01-30T08:10:13.507533+0000","last_undegraded":"2024-01-30T08:10:13.507533+0000","last_fullsized":"2024-01-30T08:10:13.507533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:16:00.220792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902102+0000","last_change":"2024-01-30T08:10:11.922203+0000","last_active":"2024-01-30T08:10:13.902102+0000","last_peered":"2024-01-30T08:10:13.902102+0000","last_clean":"2024-01-30T08:10:13.902102+0000","last_became_active":"2024-01-30T08:10:11.921978+0000","last_became_peered":"2024-01-30T08:10:11.921978+0000","last_unstale":"2024-01-30T08:10:13.902102+0000","last_undegraded":"2024-01-30T08:10:13.902102+0000","last_fullsized":"2024-01-30T08:10:13.902102+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:20:00.743813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917453+0000","last_change":"2024-01-30T08:09:53.886598+0000","last_active":"2024-01-30T08:10:12.917453+0000","last_peered":"2024-01-30T08:10:12.917453+0000","last_clean":"2024-01-30T08:10:12.917453+0000","last_became_active":"2024-01-30T08:09:53.886309+0000","last_became_peered":"2024-01-30T08:09:53.886309+0000","last_unstale":"2024-01-30T08:10:12.917453+0000","last_undegraded":"2024-01-30T08:10:12.917453+0000","last_fullsized":"2024-01-30T08:10:12.917453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:22.789462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917472+0000","last_change":"2024-01-30T08:10:11.931281+0000","last_active":"2024-01-30T08:10:12.917472+0000","last_peered":"2024-01-30T08:10:12.917472+0000","last_clean":"2024-01-30T08:10:12.917472+0000","last_became_active":"2024-01-30T08:10:11.930845+0000","last_became_peered":"2024-01-30T08:10:11.930845+0000","last_unstale":"2024-01-30T08:10:12.917472+0000","last_undegraded":"2024-01-30T08:10:12.917472+0000","last_fullsized":"2024-01-30T08:10:12.917472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:01:10.135799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918890+0000","last_change":"2024-01-30T08:09:53.887696+0000","last_active":"2024-01-30T08:10:12.918890+0000","last_peered":"2024-01-30T08:10:12.918890+0000","last_clean":"2024-01-30T08:10:12.918890+0000","last_became_active":"2024-01-30T08:09:53.887379+0000","last_became_peered":"2024-01-30T08:09:53.887379+0000","last_unstale":"2024-01-30T08:10:12.918890+0000","last_undegraded":"2024-01-30T08:10:12.918890+0000","last_fullsized":"2024-01-30T08:10:12.918890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901512+0000","last_change":"2024-01-30T08:10:11.916385+0000","last_active":"2024-01-30T08:10:13.901512+0000","last_peered":"2024-01-30T08:10:13.901512+0000","last_clean":"2024-01-30T08:10:13.901512+0000","last_became_active":"2024-01-30T08:10:11.915981+0000","last_became_peered":"2024-01-30T08:10:11.915981+0000","last_unstale":"2024-01-30T08:10:13.901512+0000","last_undegraded":"2024-01-30T08:10:13.901512+0000","last_fullsized":"2024-01-30T08:10:13.901512+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:35:33.545140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903571+0000","last_change":"2024-01-30T08:09:53.887079+0000","last_active":"2024-01-30T08:10:13.903571+0000","last_peered":"2024-01-30T08:10:13.903571+0000","last_clean":"2024-01-30T08:10:13.903571+0000","last_became_active":"2024-01-30T08:09:53.886792+0000","last_became_peered":"2024-01-30T08:09:53.886792+0000","last_unstale":"2024-01-30T08:10:13.903571+0000","last_undegraded":"2024-01-30T08:10:13.903571+0000","last_fullsized":"2024-01-30T08:10:13.903571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918811+0000","last_change":"2024-01-30T08:10:11.915341+0000","last_active":"2024-01-30T08:10:12.918811+0000","last_peered":"2024-01-30T08:10:12.918811+0000","last_clean":"2024-01-30T08:10:12.918811+0000","last_became_active":"2024-01-30T08:10:11.915013+0000","last_became_peered":"2024-01-30T08:10:11.915013+0000","last_unstale":"2024-01-30T08:10:12.918811+0000","last_undegraded":"2024-01-30T08:10:12.918811+0000","last_fullsized":"2024-01-30T08:10:12.918811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:33.705197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919223+0000","last_change":"2024-01-30T08:09:53.878370+0000","last_active":"2024-01-30T08:10:12.919223+0000","last_peered":"2024-01-30T08:10:12.919223+0000","last_clean":"2024-01-30T08:10:12.919223+0000","last_became_active":"2024-01-30T08:09:53.878121+0000","last_became_peered":"2024-01-30T08:09:53.878121+0000","last_unstale":"2024-01-30T08:10:12.919223+0000","last_undegraded":"2024-01-30T08:10:12.919223+0000","last_fullsized":"2024-01-30T08:10:12.919223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:50.845348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901820+0000","last_change":"2024-01-30T08:10:11.923083+0000","last_active":"2024-01-30T08:10:13.901820+0000","last_peered":"2024-01-30T08:10:13.901820+0000","last_clean":"2024-01-30T08:10:13.901820+0000","last_became_active":"2024-01-30T08:10:11.922797+0000","last_became_peered":"2024-01-30T08:10:11.922797+0000","last_unstale":"2024-01-30T08:10:13.901820+0000","last_undegraded":"2024-01-30T08:10:13.901820+0000","last_fullsized":"2024-01-30T08:10:13.901820+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:34:26.777072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899531+0000","last_change":"2024-01-30T08:09:53.881127+0000","last_active":"2024-01-30T08:10:13.899531+0000","last_peered":"2024-01-30T08:10:13.899531+0000","last_clean":"2024-01-30T08:10:13.899531+0000","last_became_active":"2024-01-30T08:09:53.880821+0000","last_became_peered":"2024-01-30T08:09:53.880821+0000","last_unstale":"2024-01-30T08:10:13.899531+0000","last_undegraded":"2024-01-30T08:10:13.899531+0000","last_fullsized":"2024-01-30T08:10:13.899531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:34:00.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903634+0000","last_change":"2024-01-30T08:10:11.916154+0000","last_active":"2024-01-30T08:10:13.903634+0000","last_peered":"2024-01-30T08:10:13.903634+0000","last_clean":"2024-01-30T08:10:13.903634+0000","last_became_active":"2024-01-30T08:10:11.915888+0000","last_became_peered":"2024-01-30T08:10:11.915888+0000","last_unstale":"2024-01-30T08:10:13.903634+0000","last_undegraded":"2024-01-30T08:10:13.903634+0000","last_fullsized":"2024-01-30T08:10:13.903634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:48:47.037271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918921+0000","last_change":"2024-01-30T08:09:53.881676+0000","last_active":"2024-01-30T08:10:12.918921+0000","last_peered":"2024-01-30T08:10:12.918921+0000","last_clean":"2024-01-30T08:10:12.918921+0000","last_became_active":"2024-01-30T08:09:53.881375+0000","last_became_peered":"2024-01-30T08:09:53.881375+0000","last_unstale":"2024-01-30T08:10:12.918921+0000","last_undegraded":"2024-01-30T08:10:12.918921+0000","last_fullsized":"2024-01-30T08:10:12.918921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:52.819760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919063+0000","last_change":"2024-01-30T08:10:11.915659+0000","last_active":"2024-01-30T08:10:12.919063+0000","last_peered":"2024-01-30T08:10:12.919063+0000","last_clean":"2024-01-30T08:10:12.919063+0000","last_became_active":"2024-01-30T08:10:11.915403+0000","last_became_peered":"2024-01-30T08:10:11.915403+0000","last_unstale":"2024-01-30T08:10:12.919063+0000","last_undegraded":"2024-01-30T08:10:12.919063+0000","last_fullsized":"2024-01-30T08:10:12.919063+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:06:36.045513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918510+0000","last_change":"2024-01-30T08:09:53.888510+0000","last_active":"2024-01-30T08:10:12.918510+0000","last_peered":"2024-01-30T08:10:12.918510+0000","last_clean":"2024-01-30T08:10:12.918510+0000","last_became_active":"2024-01-30T08:09:53.888193+0000","last_became_peered":"2024-01-30T08:09:53.888193+0000","last_unstale":"2024-01-30T08:10:12.918510+0000","last_undegraded":"2024-01-30T08:10:12.918510+0000","last_fullsized":"2024-01-30T08:10:12.918510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:55.917374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904465+0000","last_change":"2024-01-30T08:10:11.910891+0000","last_active":"2024-01-30T08:10:13.904465+0000","last_peered":"2024-01-30T08:10:13.904465+0000","last_clean":"2024-01-30T08:10:13.904465+0000","last_became_active":"2024-01-30T08:10:11.910551+0000","last_became_peered":"2024-01-30T08:10:11.910551+0000","last_unstale":"2024-01-30T08:10:13.904465+0000","last_undegraded":"2024-01-30T08:10:13.904465+0000","last_fullsized":"2024-01-30T08:10:13.904465+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:22:03.964721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508014+0000","last_change":"2024-01-30T08:09:53.886709+0000","last_active":"2024-01-30T08:10:13.508014+0000","last_peered":"2024-01-30T08:10:13.508014+0000","last_clean":"2024-01-30T08:10:13.508014+0000","last_became_active":"2024-01-30T08:09:53.886411+0000","last_became_peered":"2024-01-30T08:09:53.886411+0000","last_unstale":"2024-01-30T08:10:13.508014+0000","last_undegraded":"2024-01-30T08:10:13.508014+0000","last_fullsized":"2024-01-30T08:10:13.508014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508202+0000","last_change":"2024-01-30T08:10:11.931040+0000","last_active":"2024-01-30T08:10:13.508202+0000","last_peered":"2024-01-30T08:10:13.508202+0000","last_clean":"2024-01-30T08:10:13.508202+0000","last_became_active":"2024-01-30T08:10:11.929344+0000","last_became_peered":"2024-01-30T08:10:11.929344+0000","last_unstale":"2024-01-30T08:10:13.508202+0000","last_undegraded":"2024-01-30T08:10:13.508202+0000","last_fullsized":"2024-01-30T08:10:13.508202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:30:41.523632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901594+0000","last_change":"2024-01-30T08:09:53.890735+0000","last_active":"2024-01-30T08:10:13.901594+0000","last_peered":"2024-01-30T08:10:13.901594+0000","last_clean":"2024-01-30T08:10:13.901594+0000","last_became_active":"2024-01-30T08:09:53.889181+0000","last_became_peered":"2024-01-30T08:09:53.889181+0000","last_unstale":"2024-01-30T08:10:13.901594+0000","last_undegraded":"2024-01-30T08:10:13.901594+0000","last_fullsized":"2024-01-30T08:10:13.901594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918505+0000","last_change":"2024-01-30T08:10:11.913476+0000","last_active":"2024-01-30T08:10:12.918505+0000","last_peered":"2024-01-30T08:10:12.918505+0000","last_clean":"2024-01-30T08:10:12.918505+0000","last_became_active":"2024-01-30T08:10:11.913168+0000","last_became_peered":"2024-01-30T08:10:11.913168+0000","last_unstale":"2024-01-30T08:10:12.918505+0000","last_undegraded":"2024-01-30T08:10:12.918505+0000","last_fullsized":"2024-01-30T08:10:12.918505+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:48:33.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903777+0000","last_change":"2024-01-30T08:10:10.899511+0000","last_active":"2024-01-30T08:10:13.903777+0000","last_peered":"2024-01-30T08:10:13.903777+0000","last_clean":"2024-01-30T08:10:13.903777+0000","last_became_active":"2024-01-30T08:10:10.899246+0000","last_became_peered":"2024-01-30T08:10:10.899246+0000","last_unstale":"2024-01-30T08:10:13.903777+0000","last_undegraded":"2024-01-30T08:10:13.903777+0000","last_fullsized":"2024-01-30T08:10:13.903777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:55.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507974+0000","last_change":"2024-01-30T08:09:53.885238+0000","last_active":"2024-01-30T08:10:13.507974+0000","last_peered":"2024-01-30T08:10:13.507974+0000","last_clean":"2024-01-30T08:10:13.507974+0000","last_became_active":"2024-01-30T08:09:53.884915+0000","last_became_peered":"2024-01-30T08:09:53.884915+0000","last_unstale":"2024-01-30T08:10:13.507974+0000","last_undegraded":"2024-01-30T08:10:13.507974+0000","last_fullsized":"2024-01-30T08:10:13.507974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919045+0000","last_change":"2024-01-30T08:09:52.923703+0000","last_active":"2024-01-30T08:10:12.919045+0000","last_peered":"2024-01-30T08:10:12.919045+0000","last_clean":"2024-01-30T08:10:12.919045+0000","last_became_active":"2024-01-30T08:09:52.923403+0000","last_became_peered":"2024-01-30T08:09:52.923403+0000","last_unstale":"2024-01-30T08:10:12.919045+0000","last_undegraded":"2024-01-30T08:10:12.919045+0000","last_fullsized":"2024-01-30T08:10:12.919045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:12:41.370369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901836+0000","last_change":"2024-01-30T08:10:11.917355+0000","last_active":"2024-01-30T08:10:13.901836+0000","last_peered":"2024-01-30T08:10:13.901836+0000","last_clean":"2024-01-30T08:10:13.901836+0000","last_became_active":"2024-01-30T08:10:11.917105+0000","last_became_peered":"2024-01-30T08:10:11.917105+0000","last_unstale":"2024-01-30T08:10:13.901836+0000","last_undegraded":"2024-01-30T08:10:13.901836+0000","last_fullsized":"2024-01-30T08:10:13.901836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:38:39.285632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899428+0000","last_change":"2024-01-30T08:10:10.907010+0000","last_active":"2024-01-30T08:10:13.899428+0000","last_peered":"2024-01-30T08:10:13.899428+0000","last_clean":"2024-01-30T08:10:13.899428+0000","last_became_active":"2024-01-30T08:10:10.906670+0000","last_became_peered":"2024-01-30T08:10:10.906670+0000","last_unstale":"2024-01-30T08:10:13.899428+0000","last_undegraded":"2024-01-30T08:10:13.899428+0000","last_fullsized":"2024-01-30T08:10:13.899428+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:40:26.246384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904012+0000","last_change":"2024-01-30T08:09:53.886267+0000","last_active":"2024-01-30T08:10:13.904012+0000","last_peered":"2024-01-30T08:10:13.904012+0000","last_clean":"2024-01-30T08:10:13.904012+0000","last_became_active":"2024-01-30T08:09:53.885942+0000","last_became_peered":"2024-01-30T08:09:53.885942+0000","last_unstale":"2024-01-30T08:10:13.904012+0000","last_undegraded":"2024-01-30T08:10:13.904012+0000","last_fullsized":"2024-01-30T08:10:13.904012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:20:36.989469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904570+0000","last_change":"2024-01-30T08:09:52.937196+0000","last_active":"2024-01-30T08:10:13.904570+0000","last_peered":"2024-01-30T08:10:13.904570+0000","last_clean":"2024-01-30T08:10:13.904570+0000","last_became_active":"2024-01-30T08:09:52.936878+0000","last_became_peered":"2024-01-30T08:09:52.936878+0000","last_unstale":"2024-01-30T08:10:13.904570+0000","last_undegraded":"2024-01-30T08:10:13.904570+0000","last_fullsized":"2024-01-30T08:10:13.904570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:18:20.639670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507251+0000","last_change":"2024-01-30T08:10:11.927138+0000","last_active":"2024-01-30T08:10:13.507251+0000","last_peered":"2024-01-30T08:10:13.507251+0000","last_clean":"2024-01-30T08:10:13.507251+0000","last_became_active":"2024-01-30T08:10:11.926774+0000","last_became_peered":"2024-01-30T08:10:11.926774+0000","last_unstale":"2024-01-30T08:10:13.507251+0000","last_undegraded":"2024-01-30T08:10:13.507251+0000","last_fullsized":"2024-01-30T08:10:13.507251+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:33:29.618226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"42'4","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918766+0000","last_change":"2024-01-30T08:10:10.895924+0000","last_active":"2024-01-30T08:10:12.918766+0000","last_peered":"2024-01-30T08:10:12.918766+0000","last_clean":"2024-01-30T08:10:12.918766+0000","last_became_active":"2024-01-30T08:10:10.895664+0000","last_became_peered":"2024-01-30T08:10:10.895664+0000","last_unstale":"2024-01-30T08:10:12.918766+0000","last_undegraded":"2024-01-30T08:10:12.918766+0000","last_fullsized":"2024-01-30T08:10:12.918766+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:46.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918076+0000","last_change":"2024-01-30T08:09:53.872107+0000","last_active":"2024-01-30T08:10:12.918076+0000","last_peered":"2024-01-30T08:10:12.918076+0000","last_clean":"2024-01-30T08:10:12.918076+0000","last_became_active":"2024-01-30T08:09:53.871227+0000","last_became_peered":"2024-01-30T08:09:53.871227+0000","last_unstale":"2024-01-30T08:10:12.918076+0000","last_undegraded":"2024-01-30T08:10:12.918076+0000","last_fullsized":"2024-01-30T08:10:12.918076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904171+0000","last_change":"2024-01-30T08:09:52.936936+0000","last_active":"2024-01-30T08:10:13.904171+0000","last_peered":"2024-01-30T08:10:13.904171+0000","last_clean":"2024-01-30T08:10:13.904171+0000","last_became_active":"2024-01-30T08:09:52.936648+0000","last_became_peered":"2024-01-30T08:09:52.936648+0000","last_unstale":"2024-01-30T08:10:13.904171+0000","last_undegraded":"2024-01-30T08:10:13.904171+0000","last_fullsized":"2024-01-30T08:10:13.904171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898692+0000","last_change":"2024-01-30T08:10:11.928520+0000","last_active":"2024-01-30T08:10:13.898692+0000","last_peered":"2024-01-30T08:10:13.898692+0000","last_clean":"2024-01-30T08:10:13.898692+0000","last_became_active":"2024-01-30T08:10:11.927399+0000","last_became_peered":"2024-01-30T08:10:11.927399+0000","last_unstale":"2024-01-30T08:10:13.898692+0000","last_undegraded":"2024-01-30T08:10:13.898692+0000","last_fullsized":"2024-01-30T08:10:13.898692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:30:30.760001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903650+0000","last_change":"2024-01-30T08:10:10.900383+0000","last_active":"2024-01-30T08:10:13.903650+0000","last_peered":"2024-01-30T08:10:13.903650+0000","last_clean":"2024-01-30T08:10:13.903650+0000","last_became_active":"2024-01-30T08:10:10.899899+0000","last_became_peered":"2024-01-30T08:10:10.899899+0000","last_unstale":"2024-01-30T08:10:13.903650+0000","last_undegraded":"2024-01-30T08:10:13.903650+0000","last_fullsized":"2024-01-30T08:10:13.903650+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:46.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902816+0000","last_change":"2024-01-30T08:09:53.894226+0000","last_active":"2024-01-30T08:10:13.902816+0000","last_peered":"2024-01-30T08:10:13.902816+0000","last_clean":"2024-01-30T08:10:13.902816+0000","last_became_active":"2024-01-30T08:09:53.892446+0000","last_became_peered":"2024-01-30T08:09:53.892446+0000","last_unstale":"2024-01-30T08:10:13.902816+0000","last_undegraded":"2024-01-30T08:10:13.902816+0000","last_fullsized":"2024-01-30T08:10:13.902816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:39:14.357288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918136+0000","last_change":"2024-01-30T08:09:52.931316+0000","last_active":"2024-01-30T08:10:12.918136+0000","last_peered":"2024-01-30T08:10:12.918136+0000","last_clean":"2024-01-30T08:10:12.918136+0000","last_became_active":"2024-01-30T08:09:52.931057+0000","last_became_peered":"2024-01-30T08:09:52.931057+0000","last_unstale":"2024-01-30T08:10:12.918136+0000","last_undegraded":"2024-01-30T08:10:12.918136+0000","last_fullsized":"2024-01-30T08:10:12.918136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:42:21.782354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902420+0000","last_change":"2024-01-30T08:10:11.922174+0000","last_active":"2024-01-30T08:10:13.902420+0000","last_peered":"2024-01-30T08:10:13.902420+0000","last_clean":"2024-01-30T08:10:13.902420+0000","last_became_active":"2024-01-30T08:10:11.921892+0000","last_became_peered":"2024-01-30T08:10:11.921892+0000","last_unstale":"2024-01-30T08:10:13.902420+0000","last_undegraded":"2024-01-30T08:10:13.902420+0000","last_fullsized":"2024-01-30T08:10:13.902420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:02:16.619749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.916851+0000","last_change":"2024-01-30T08:10:10.900526+0000","last_active":"2024-01-30T08:10:12.916851+0000","last_peered":"2024-01-30T08:10:12.916851+0000","last_clean":"2024-01-30T08:10:12.916851+0000","last_became_active":"2024-01-30T08:10:10.900249+0000","last_became_peered":"2024-01-30T08:10:10.900249+0000","last_unstale":"2024-01-30T08:10:12.916851+0000","last_undegraded":"2024-01-30T08:10:12.916851+0000","last_fullsized":"2024-01-30T08:10:12.916851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:11:05.648235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901102+0000","last_change":"2024-01-30T08:09:53.881438+0000","last_active":"2024-01-30T08:10:13.901102+0000","last_peered":"2024-01-30T08:10:13.901102+0000","last_clean":"2024-01-30T08:10:13.901102+0000","last_became_active":"2024-01-30T08:09:53.881166+0000","last_became_peered":"2024-01-30T08:09:53.881166+0000","last_unstale":"2024-01-30T08:10:13.901102+0000","last_undegraded":"2024-01-30T08:10:13.901102+0000","last_fullsized":"2024-01-30T08:10:13.901102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:37.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899106+0000","last_change":"2024-01-30T08:09:52.941032+0000","last_active":"2024-01-30T08:10:13.899106+0000","last_peered":"2024-01-30T08:10:13.899106+0000","last_clean":"2024-01-30T08:10:13.899106+0000","last_became_active":"2024-01-30T08:09:52.940728+0000","last_became_peered":"2024-01-30T08:09:52.940728+0000","last_unstale":"2024-01-30T08:10:13.899106+0000","last_undegraded":"2024-01-30T08:10:13.899106+0000","last_fullsized":"2024-01-30T08:10:13.899106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:57:43.172388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508190+0000","last_change":"2024-01-30T08:10:11.928639+0000","last_active":"2024-01-30T08:10:13.508190+0000","last_peered":"2024-01-30T08:10:13.508190+0000","last_clean":"2024-01-30T08:10:13.508190+0000","last_became_active":"2024-01-30T08:10:11.928399+0000","last_became_peered":"2024-01-30T08:10:11.928399+0000","last_unstale":"2024-01-30T08:10:13.508190+0000","last_undegraded":"2024-01-30T08:10:13.508190+0000","last_fullsized":"2024-01-30T08:10:13.508190+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:45:02.652613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901364+0000","last_change":"2024-01-30T08:10:10.905030+0000","last_active":"2024-01-30T08:10:13.901364+0000","last_peered":"2024-01-30T08:10:13.901364+0000","last_clean":"2024-01-30T08:10:13.901364+0000","last_became_active":"2024-01-30T08:10:10.901186+0000","last_became_peered":"2024-01-30T08:10:10.901186+0000","last_unstale":"2024-01-30T08:10:13.901364+0000","last_undegraded":"2024-01-30T08:10:13.901364+0000","last_fullsized":"2024-01-30T08:10:13.901364+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:54:30.092942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899129+0000","last_change":"2024-01-30T08:09:53.881466+0000","last_active":"2024-01-30T08:10:13.899129+0000","last_peered":"2024-01-30T08:10:13.899129+0000","last_clean":"2024-01-30T08:10:13.899129+0000","last_became_active":"2024-01-30T08:09:53.880847+0000","last_became_peered":"2024-01-30T08:09:53.880847+0000","last_unstale":"2024-01-30T08:10:13.899129+0000","last_undegraded":"2024-01-30T08:10:13.899129+0000","last_fullsized":"2024-01-30T08:10:13.899129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:24:30.424249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507788+0000","last_change":"2024-01-30T08:09:52.932527+0000","last_active":"2024-01-30T08:10:13.507788+0000","last_peered":"2024-01-30T08:10:13.507788+0000","last_clean":"2024-01-30T08:10:13.507788+0000","last_became_active":"2024-01-30T08:09:52.932278+0000","last_became_peered":"2024-01-30T08:09:52.932278+0000","last_unstale":"2024-01-30T08:10:13.507788+0000","last_undegraded":"2024-01-30T08:10:13.507788+0000","last_fullsized":"2024-01-30T08:10:13.507788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917794+0000","last_change":"2024-01-30T08:10:11.918318+0000","last_active":"2024-01-30T08:10:12.917794+0000","last_peered":"2024-01-30T08:10:12.917794+0000","last_clean":"2024-01-30T08:10:12.917794+0000","last_became_active":"2024-01-30T08:10:11.917861+0000","last_became_peered":"2024-01-30T08:10:11.917861+0000","last_unstale":"2024-01-30T08:10:12.917794+0000","last_undegraded":"2024-01-30T08:10:12.917794+0000","last_fullsized":"2024-01-30T08:10:12.917794+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:59:44.442066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901500+0000","last_change":"2024-01-30T08:10:10.903517+0000","last_active":"2024-01-30T08:10:13.901500+0000","last_peered":"2024-01-30T08:10:13.901500+0000","last_clean":"2024-01-30T08:10:13.901500+0000","last_became_active":"2024-01-30T08:10:10.903251+0000","last_became_peered":"2024-01-30T08:10:10.903251+0000","last_unstale":"2024-01-30T08:10:13.901500+0000","last_undegraded":"2024-01-30T08:10:13.901500+0000","last_fullsized":"2024-01-30T08:10:13.901500+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:26.792702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917662+0000","last_change":"2024-01-30T08:09:53.883461+0000","last_active":"2024-01-30T08:10:12.917662+0000","last_peered":"2024-01-30T08:10:12.917662+0000","last_clean":"2024-01-30T08:10:12.917662+0000","last_became_active":"2024-01-30T08:09:53.883216+0000","last_became_peered":"2024-01-30T08:09:53.883216+0000","last_unstale":"2024-01-30T08:10:12.917662+0000","last_undegraded":"2024-01-30T08:10:12.917662+0000","last_fullsized":"2024-01-30T08:10:12.917662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:31.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902183+0000","last_change":"2024-01-30T08:09:52.933257+0000","last_active":"2024-01-30T08:10:13.902183+0000","last_peered":"2024-01-30T08:10:13.902183+0000","last_clean":"2024-01-30T08:10:13.902183+0000","last_became_active":"2024-01-30T08:09:52.932958+0000","last_became_peered":"2024-01-30T08:09:52.932958+0000","last_unstale":"2024-01-30T08:10:13.902183+0000","last_undegraded":"2024-01-30T08:10:13.902183+0000","last_fullsized":"2024-01-30T08:10:13.902183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508319+0000","last_change":"2024-01-30T08:10:11.935854+0000","last_active":"2024-01-30T08:10:13.508319+0000","last_peered":"2024-01-30T08:10:13.508319+0000","last_clean":"2024-01-30T08:10:13.508319+0000","last_became_active":"2024-01-30T08:10:11.935556+0000","last_became_peered":"2024-01-30T08:10:11.935556+0000","last_unstale":"2024-01-30T08:10:13.508319+0000","last_undegraded":"2024-01-30T08:10:13.508319+0000","last_fullsized":"2024-01-30T08:10:13.508319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:20:00.507002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917356+0000","last_change":"2024-01-30T08:10:10.892381+0000","last_active":"2024-01-30T08:10:12.917356+0000","last_peered":"2024-01-30T08:10:12.917356+0000","last_clean":"2024-01-30T08:10:12.917356+0000","last_became_active":"2024-01-30T08:10:10.892065+0000","last_became_peered":"2024-01-30T08:10:10.892065+0000","last_unstale":"2024-01-30T08:10:12.917356+0000","last_undegraded":"2024-01-30T08:10:12.917356+0000","last_fullsized":"2024-01-30T08:10:12.917356+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:11:05.648235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902984+0000","last_change":"2024-01-30T08:09:53.886192+0000","last_active":"2024-01-30T08:10:13.902984+0000","last_peered":"2024-01-30T08:10:13.902984+0000","last_clean":"2024-01-30T08:10:13.902984+0000","last_became_active":"2024-01-30T08:09:53.885913+0000","last_became_peered":"2024-01-30T08:09:53.885913+0000","last_unstale":"2024-01-30T08:10:13.902984+0000","last_undegraded":"2024-01-30T08:10:13.902984+0000","last_fullsized":"2024-01-30T08:10:13.902984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917165+0000","last_change":"2024-01-30T08:09:52.921433+0000","last_active":"2024-01-30T08:10:12.917165+0000","last_peered":"2024-01-30T08:10:12.917165+0000","last_clean":"2024-01-30T08:10:12.917165+0000","last_became_active":"2024-01-30T08:09:52.921125+0000","last_became_peered":"2024-01-30T08:09:52.921125+0000","last_unstale":"2024-01-30T08:10:12.917165+0000","last_undegraded":"2024-01-30T08:10:12.917165+0000","last_fullsized":"2024-01-30T08:10:12.917165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:33:36.709229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902109+0000","last_change":"2024-01-30T08:10:11.909037+0000","last_active":"2024-01-30T08:10:13.902109+0000","last_peered":"2024-01-30T08:10:13.902109+0000","last_clean":"2024-01-30T08:10:13.902109+0000","last_became_active":"2024-01-30T08:10:11.908779+0000","last_became_peered":"2024-01-30T08:10:11.908779+0000","last_unstale":"2024-01-30T08:10:13.902109+0000","last_undegraded":"2024-01-30T08:10:13.902109+0000","last_fullsized":"2024-01-30T08:10:13.902109+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:41:10.684189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507732+0000","last_change":"2024-01-30T08:10:10.907186+0000","last_active":"2024-01-30T08:10:13.507732+0000","last_peered":"2024-01-30T08:10:13.507732+0000","last_clean":"2024-01-30T08:10:13.507732+0000","last_became_active":"2024-01-30T08:10:10.906913+0000","last_became_peered":"2024-01-30T08:10:10.906913+0000","last_unstale":"2024-01-30T08:10:13.507732+0000","last_undegraded":"2024-01-30T08:10:13.507732+0000","last_fullsized":"2024-01-30T08:10:13.507732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:15:41.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918105+0000","last_change":"2024-01-30T08:09:53.876088+0000","last_active":"2024-01-30T08:10:12.918105+0000","last_peered":"2024-01-30T08:10:12.918105+0000","last_clean":"2024-01-30T08:10:12.918105+0000","last_became_active":"2024-01-30T08:09:53.875533+0000","last_became_peered":"2024-01-30T08:09:53.875533+0000","last_unstale":"2024-01-30T08:10:12.918105+0000","last_undegraded":"2024-01-30T08:10:12.918105+0000","last_fullsized":"2024-01-30T08:10:12.918105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:23.401989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902950+0000","last_change":"2024-01-30T08:09:52.934231+0000","last_active":"2024-01-30T08:10:13.902950+0000","last_peered":"2024-01-30T08:10:13.902950+0000","last_clean":"2024-01-30T08:10:13.902950+0000","last_became_active":"2024-01-30T08:09:52.933973+0000","last_became_peered":"2024-01-30T08:09:52.933973+0000","last_unstale":"2024-01-30T08:10:13.902950+0000","last_undegraded":"2024-01-30T08:10:13.902950+0000","last_fullsized":"2024-01-30T08:10:13.902950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:07.482725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917892+0000","last_change":"2024-01-30T08:10:11.919796+0000","last_active":"2024-01-30T08:10:12.917892+0000","last_peered":"2024-01-30T08:10:12.917892+0000","last_clean":"2024-01-30T08:10:12.917892+0000","last_became_active":"2024-01-30T08:10:11.919542+0000","last_became_peered":"2024-01-30T08:10:11.919542+0000","last_unstale":"2024-01-30T08:10:12.917892+0000","last_undegraded":"2024-01-30T08:10:12.917892+0000","last_fullsized":"2024-01-30T08:10:12.917892+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:48:33.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"42'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902163+0000","last_change":"2024-01-30T08:10:10.902834+0000","last_active":"2024-01-30T08:10:13.902163+0000","last_peered":"2024-01-30T08:10:13.902163+0000","last_clean":"2024-01-30T08:10:13.902163+0000","last_became_active":"2024-01-30T08:10:10.902327+0000","last_became_peered":"2024-01-30T08:10:10.902327+0000","last_unstale":"2024-01-30T08:10:13.902163+0000","last_undegraded":"2024-01-30T08:10:13.902163+0000","last_fullsized":"2024-01-30T08:10:13.902163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:12:21.336314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507978+0000","last_change":"2024-01-30T08:09:53.881405+0000","last_active":"2024-01-30T08:10:13.507978+0000","last_peered":"2024-01-30T08:10:13.507978+0000","last_clean":"2024-01-30T08:10:13.507978+0000","last_became_active":"2024-01-30T08:09:53.880841+0000","last_became_peered":"2024-01-30T08:09:53.880841+0000","last_unstale":"2024-01-30T08:10:13.507978+0000","last_undegraded":"2024-01-30T08:10:13.507978+0000","last_fullsized":"2024-01-30T08:10:13.507978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:00:52.172429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899814+0000","last_change":"2024-01-30T08:09:52.933376+0000","last_active":"2024-01-30T08:10:13.899814+0000","last_peered":"2024-01-30T08:10:13.899814+0000","last_clean":"2024-01-30T08:10:13.899814+0000","last_became_active":"2024-01-30T08:09:52.932754+0000","last_became_peered":"2024-01-30T08:09:52.932754+0000","last_unstale":"2024-01-30T08:10:13.899814+0000","last_undegraded":"2024-01-30T08:10:13.899814+0000","last_fullsized":"2024-01-30T08:10:13.899814+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:37.710856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917135+0000","last_change":"2024-01-30T08:10:11.912363+0000","last_active":"2024-01-30T08:10:12.917135+0000","last_peered":"2024-01-30T08:10:12.917135+0000","last_clean":"2024-01-30T08:10:12.917135+0000","last_became_active":"2024-01-30T08:10:11.912095+0000","last_became_peered":"2024-01-30T08:10:11.912095+0000","last_unstale":"2024-01-30T08:10:12.917135+0000","last_undegraded":"2024-01-30T08:10:12.917135+0000","last_fullsized":"2024-01-30T08:10:12.917135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:52:26.746366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508044+0000","last_change":"2024-01-30T08:10:10.903128+0000","last_active":"2024-01-30T08:10:13.508044+0000","last_peered":"2024-01-30T08:10:13.508044+0000","last_clean":"2024-01-30T08:10:13.508044+0000","last_became_active":"2024-01-30T08:10:10.902794+0000","last_became_peered":"2024-01-30T08:10:10.902794+0000","last_unstale":"2024-01-30T08:10:13.508044+0000","last_undegraded":"2024-01-30T08:10:13.508044+0000","last_fullsized":"2024-01-30T08:10:13.508044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:21:26.713080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904268+0000","last_change":"2024-01-30T08:09:53.883329+0000","last_active":"2024-01-30T08:10:13.904268+0000","last_peered":"2024-01-30T08:10:13.904268+0000","last_clean":"2024-01-30T08:10:13.904268+0000","last_became_active":"2024-01-30T08:09:53.881025+0000","last_became_peered":"2024-01-30T08:09:53.881025+0000","last_unstale":"2024-01-30T08:10:13.904268+0000","last_undegraded":"2024-01-30T08:10:13.904268+0000","last_fullsized":"2024-01-30T08:10:13.904268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:11:38.717964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899590+0000","last_change":"2024-01-30T08:09:52.941133+0000","last_active":"2024-01-30T08:10:13.899590+0000","last_peered":"2024-01-30T08:10:13.899590+0000","last_clean":"2024-01-30T08:10:13.899590+0000","last_became_active":"2024-01-30T08:09:52.940818+0000","last_became_peered":"2024-01-30T08:09:52.940818+0000","last_unstale":"2024-01-30T08:10:13.899590+0000","last_undegraded":"2024-01-30T08:10:13.899590+0000","last_fullsized":"2024-01-30T08:10:13.899590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:51.615266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898663+0000","last_change":"2024-01-30T08:10:11.914923+0000","last_active":"2024-01-30T08:10:13.898663+0000","last_peered":"2024-01-30T08:10:13.898663+0000","last_clean":"2024-01-30T08:10:13.898663+0000","last_became_active":"2024-01-30T08:10:11.914536+0000","last_became_peered":"2024-01-30T08:10:11.914536+0000","last_unstale":"2024-01-30T08:10:13.898663+0000","last_undegraded":"2024-01-30T08:10:13.898663+0000","last_fullsized":"2024-01-30T08:10:13.898663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:01:42.498748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917903+0000","last_change":"2024-01-30T08:10:10.904799+0000","last_active":"2024-01-30T08:10:12.917903+0000","last_peered":"2024-01-30T08:10:12.917903+0000","last_clean":"2024-01-30T08:10:12.917903+0000","last_became_active":"2024-01-30T08:10:10.903907+0000","last_became_peered":"2024-01-30T08:10:10.903907+0000","last_unstale":"2024-01-30T08:10:12.917903+0000","last_undegraded":"2024-01-30T08:10:12.917903+0000","last_fullsized":"2024-01-30T08:10:12.917903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:15:46.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918214+0000","last_change":"2024-01-30T08:09:53.877092+0000","last_active":"2024-01-30T08:10:12.918214+0000","last_peered":"2024-01-30T08:10:12.918214+0000","last_clean":"2024-01-30T08:10:12.918214+0000","last_became_active":"2024-01-30T08:09:53.875428+0000","last_became_peered":"2024-01-30T08:09:53.875428+0000","last_unstale":"2024-01-30T08:10:12.918214+0000","last_undegraded":"2024-01-30T08:10:12.918214+0000","last_fullsized":"2024-01-30T08:10:12.918214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:06:32.868196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903095+0000","last_change":"2024-01-30T08:09:52.934501+0000","last_active":"2024-01-30T08:10:13.903095+0000","last_peered":"2024-01-30T08:10:13.903095+0000","last_clean":"2024-01-30T08:10:13.903095+0000","last_became_active":"2024-01-30T08:09:52.934257+0000","last_became_peered":"2024-01-30T08:09:52.934257+0000","last_unstale":"2024-01-30T08:10:13.903095+0000","last_undegraded":"2024-01-30T08:10:13.903095+0000","last_fullsized":"2024-01-30T08:10:13.903095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:25:49.838240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902258+0000","last_change":"2024-01-30T08:10:11.915301+0000","last_active":"2024-01-30T08:10:13.902258+0000","last_peered":"2024-01-30T08:10:13.902258+0000","last_clean":"2024-01-30T08:10:13.902258+0000","last_became_active":"2024-01-30T08:10:11.914547+0000","last_became_peered":"2024-01-30T08:10:11.914547+0000","last_unstale":"2024-01-30T08:10:13.902258+0000","last_undegraded":"2024-01-30T08:10:13.902258+0000","last_fullsized":"2024-01-30T08:10:13.902258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:41:40.230931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507303+0000","last_change":"2024-01-30T08:10:10.900588+0000","last_active":"2024-01-30T08:10:13.507303+0000","last_peered":"2024-01-30T08:10:13.507303+0000","last_clean":"2024-01-30T08:10:13.507303+0000","last_became_active":"2024-01-30T08:10:10.900303+0000","last_became_peered":"2024-01-30T08:10:10.900303+0000","last_unstale":"2024-01-30T08:10:13.507303+0000","last_undegraded":"2024-01-30T08:10:13.507303+0000","last_fullsized":"2024-01-30T08:10:13.507303+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:48:32.787279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901320+0000","last_change":"2024-01-30T08:09:53.889988+0000","last_active":"2024-01-30T08:10:13.901320+0000","last_peered":"2024-01-30T08:10:13.901320+0000","last_clean":"2024-01-30T08:10:13.901320+0000","last_became_active":"2024-01-30T08:09:53.888579+0000","last_became_peered":"2024-01-30T08:09:53.888579+0000","last_unstale":"2024-01-30T08:10:13.901320+0000","last_undegraded":"2024-01-30T08:10:13.901320+0000","last_fullsized":"2024-01-30T08:10:13.901320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:01:50.624934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904028+0000","last_change":"2024-01-30T08:09:52.940984+0000","last_active":"2024-01-30T08:10:13.904028+0000","last_peered":"2024-01-30T08:10:13.904028+0000","last_clean":"2024-01-30T08:10:13.904028+0000","last_became_active":"2024-01-30T08:09:52.940676+0000","last_became_peered":"2024-01-30T08:09:52.940676+0000","last_unstale":"2024-01-30T08:10:13.904028+0000","last_undegraded":"2024-01-30T08:10:13.904028+0000","last_fullsized":"2024-01-30T08:10:13.904028+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:53:51.812652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904892+0000","last_change":"2024-01-30T08:10:11.910494+0000","last_active":"2024-01-30T08:10:13.904892+0000","last_peered":"2024-01-30T08:10:13.904892+0000","last_clean":"2024-01-30T08:10:13.904892+0000","last_became_active":"2024-01-30T08:10:11.910244+0000","last_became_peered":"2024-01-30T08:10:11.910244+0000","last_unstale":"2024-01-30T08:10:13.904892+0000","last_undegraded":"2024-01-30T08:10:13.904892+0000","last_fullsized":"2024-01-30T08:10:13.904892+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:53:46.762840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"42'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901216+0000","last_change":"2024-01-30T08:10:10.899760+0000","last_active":"2024-01-30T08:10:13.901216+0000","last_peered":"2024-01-30T08:10:13.901216+0000","last_clean":"2024-01-30T08:10:13.901216+0000","last_became_active":"2024-01-30T08:10:10.899274+0000","last_became_peered":"2024-01-30T08:10:10.899274+0000","last_unstale":"2024-01-30T08:10:13.901216+0000","last_undegraded":"2024-01-30T08:10:13.901216+0000","last_fullsized":"2024-01-30T08:10:13.901216+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:45:50.623110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901166+0000","last_change":"2024-01-30T08:09:53.880746+0000","last_active":"2024-01-30T08:10:13.901166+0000","last_peered":"2024-01-30T08:10:13.901166+0000","last_clean":"2024-01-30T08:10:13.901166+0000","last_became_active":"2024-01-30T08:09:53.880360+0000","last_became_peered":"2024-01-30T08:09:53.880360+0000","last_unstale":"2024-01-30T08:10:13.901166+0000","last_undegraded":"2024-01-30T08:10:13.901166+0000","last_fullsized":"2024-01-30T08:10:13.901166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:06:09.029463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903124+0000","last_change":"2024-01-30T08:09:52.933590+0000","last_active":"2024-01-30T08:10:13.903124+0000","last_peered":"2024-01-30T08:10:13.903124+0000","last_clean":"2024-01-30T08:10:13.903124+0000","last_became_active":"2024-01-30T08:09:52.933335+0000","last_became_peered":"2024-01-30T08:09:52.933335+0000","last_unstale":"2024-01-30T08:10:13.903124+0000","last_undegraded":"2024-01-30T08:10:13.903124+0000","last_fullsized":"2024-01-30T08:10:13.903124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:20:54.910266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898946+0000","last_change":"2024-01-30T08:10:11.926413+0000","last_active":"2024-01-30T08:10:13.898946+0000","last_peered":"2024-01-30T08:10:13.898946+0000","last_clean":"2024-01-30T08:10:13.898946+0000","last_became_active":"2024-01-30T08:10:11.926117+0000","last_became_peered":"2024-01-30T08:10:11.926117+0000","last_unstale":"2024-01-30T08:10:13.898946+0000","last_undegraded":"2024-01-30T08:10:13.898946+0000","last_fullsized":"2024-01-30T08:10:13.898946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:24:39.718984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901634+0000","last_change":"2024-01-30T08:10:10.908780+0000","last_active":"2024-01-30T08:10:13.901634+0000","last_peered":"2024-01-30T08:10:13.901634+0000","last_clean":"2024-01-30T08:10:13.901634+0000","last_became_active":"2024-01-30T08:10:10.907095+0000","last_became_peered":"2024-01-30T08:10:10.907095+0000","last_unstale":"2024-01-30T08:10:13.901634+0000","last_undegraded":"2024-01-30T08:10:13.901634+0000","last_fullsized":"2024-01-30T08:10:13.901634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:58.832681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507659+0000","last_change":"2024-01-30T08:09:53.885903+0000","last_active":"2024-01-30T08:10:13.507659+0000","last_peered":"2024-01-30T08:10:13.507659+0000","last_clean":"2024-01-30T08:10:13.507659+0000","last_became_active":"2024-01-30T08:09:53.885668+0000","last_became_peered":"2024-01-30T08:09:53.885668+0000","last_unstale":"2024-01-30T08:10:13.507659+0000","last_undegraded":"2024-01-30T08:10:13.507659+0000","last_fullsized":"2024-01-30T08:10:13.507659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:24:09.510656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917015+0000","last_change":"2024-01-30T08:09:52.925961+0000","last_active":"2024-01-30T08:10:12.917015+0000","last_peered":"2024-01-30T08:10:12.917015+0000","last_clean":"2024-01-30T08:10:12.917015+0000","last_became_active":"2024-01-30T08:09:52.925147+0000","last_became_peered":"2024-01-30T08:09:52.925147+0000","last_unstale":"2024-01-30T08:10:12.917015+0000","last_undegraded":"2024-01-30T08:10:12.917015+0000","last_fullsized":"2024-01-30T08:10:12.917015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:31:11.818524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903785+0000","last_change":"2024-01-30T08:10:11.919713+0000","last_active":"2024-01-30T08:10:13.903785+0000","last_peered":"2024-01-30T08:10:13.903785+0000","last_clean":"2024-01-30T08:10:13.903785+0000","last_became_active":"2024-01-30T08:10:11.919423+0000","last_became_peered":"2024-01-30T08:10:11.919423+0000","last_unstale":"2024-01-30T08:10:13.903785+0000","last_undegraded":"2024-01-30T08:10:13.903785+0000","last_fullsized":"2024-01-30T08:10:13.903785+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:58:59.255331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918325+0000","last_change":"2024-01-30T08:10:10.904324+0000","last_active":"2024-01-30T08:10:12.918325+0000","last_peered":"2024-01-30T08:10:12.918325+0000","last_clean":"2024-01-30T08:10:12.918325+0000","last_became_active":"2024-01-30T08:10:10.903909+0000","last_became_peered":"2024-01-30T08:10:10.903909+0000","last_unstale":"2024-01-30T08:10:12.918325+0000","last_undegraded":"2024-01-30T08:10:12.918325+0000","last_fullsized":"2024-01-30T08:10:12.918325+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:21.535727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903098+0000","last_change":"2024-01-30T08:09:53.890643+0000","last_active":"2024-01-30T08:10:13.903098+0000","last_peered":"2024-01-30T08:10:13.903098+0000","last_clean":"2024-01-30T08:10:13.903098+0000","last_became_active":"2024-01-30T08:09:53.890357+0000","last_became_peered":"2024-01-30T08:09:53.890357+0000","last_unstale":"2024-01-30T08:10:13.903098+0000","last_undegraded":"2024-01-30T08:10:13.903098+0000","last_fullsized":"2024-01-30T08:10:13.903098+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:43:04.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507323+0000","last_change":"2024-01-30T08:09:52.931306+0000","last_active":"2024-01-30T08:10:13.507323+0000","last_peered":"2024-01-30T08:10:13.507323+0000","last_clean":"2024-01-30T08:10:13.507323+0000","last_became_active":"2024-01-30T08:09:52.929277+0000","last_became_peered":"2024-01-30T08:09:52.929277+0000","last_unstale":"2024-01-30T08:10:13.507323+0000","last_undegraded":"2024-01-30T08:10:13.507323+0000","last_fullsized":"2024-01-30T08:10:13.507323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:17:09.595631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917459+0000","last_change":"2024-01-30T08:10:11.910522+0000","last_active":"2024-01-30T08:10:12.917459+0000","last_peered":"2024-01-30T08:10:12.917459+0000","last_clean":"2024-01-30T08:10:12.917459+0000","last_became_active":"2024-01-30T08:10:11.910255+0000","last_became_peered":"2024-01-30T08:10:11.910255+0000","last_unstale":"2024-01-30T08:10:12.917459+0000","last_undegraded":"2024-01-30T08:10:12.917459+0000","last_fullsized":"2024-01-30T08:10:12.917459+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:57:54.819218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918643+0000","last_change":"2024-01-30T08:10:10.905548+0000","last_active":"2024-01-30T08:10:12.918643+0000","last_peered":"2024-01-30T08:10:12.918643+0000","last_clean":"2024-01-30T08:10:12.918643+0000","last_became_active":"2024-01-30T08:10:10.905175+0000","last_became_peered":"2024-01-30T08:10:10.905175+0000","last_unstale":"2024-01-30T08:10:12.918643+0000","last_undegraded":"2024-01-30T08:10:12.918643+0000","last_fullsized":"2024-01-30T08:10:12.918643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:55.118653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902873+0000","last_change":"2024-01-30T08:09:53.880715+0000","last_active":"2024-01-30T08:10:13.902873+0000","last_peered":"2024-01-30T08:10:13.902873+0000","last_clean":"2024-01-30T08:10:13.902873+0000","last_became_active":"2024-01-30T08:09:53.880407+0000","last_became_peered":"2024-01-30T08:09:53.880407+0000","last_unstale":"2024-01-30T08:10:13.902873+0000","last_undegraded":"2024-01-30T08:10:13.902873+0000","last_fullsized":"2024-01-30T08:10:13.902873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899561+0000","last_change":"2024-01-30T08:09:52.936210+0000","last_active":"2024-01-30T08:10:13.899561+0000","last_peered":"2024-01-30T08:10:13.899561+0000","last_clean":"2024-01-30T08:10:13.899561+0000","last_became_active":"2024-01-30T08:09:52.935943+0000","last_became_peered":"2024-01-30T08:09:52.935943+0000","last_unstale":"2024-01-30T08:10:13.899561+0000","last_undegraded":"2024-01-30T08:10:13.899561+0000","last_fullsized":"2024-01-30T08:10:13.899561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:31:36.960284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903769+0000","last_change":"2024-01-30T08:10:11.910999+0000","last_active":"2024-01-30T08:10:13.903769+0000","last_peered":"2024-01-30T08:10:13.903769+0000","last_clean":"2024-01-30T08:10:13.903769+0000","last_became_active":"2024-01-30T08:10:11.910726+0000","last_became_peered":"2024-01-30T08:10:11.910726+0000","last_unstale":"2024-01-30T08:10:13.903769+0000","last_undegraded":"2024-01-30T08:10:13.903769+0000","last_fullsized":"2024-01-30T08:10:13.903769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:01:06.679976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918820+0000","last_change":"2024-01-30T08:10:10.906100+0000","last_active":"2024-01-30T08:10:12.918820+0000","last_peered":"2024-01-30T08:10:12.918820+0000","last_clean":"2024-01-30T08:10:12.918820+0000","last_became_active":"2024-01-30T08:10:10.905800+0000","last_became_peered":"2024-01-30T08:10:10.905800+0000","last_unstale":"2024-01-30T08:10:12.918820+0000","last_undegraded":"2024-01-30T08:10:12.918820+0000","last_fullsized":"2024-01-30T08:10:12.918820+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:27:13.081166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899585+0000","last_change":"2024-01-30T08:09:53.883122+0000","last_active":"2024-01-30T08:10:13.899585+0000","last_peered":"2024-01-30T08:10:13.899585+0000","last_clean":"2024-01-30T08:10:13.899585+0000","last_became_active":"2024-01-30T08:09:53.882631+0000","last_became_peered":"2024-01-30T08:09:53.882631+0000","last_unstale":"2024-01-30T08:10:13.899585+0000","last_undegraded":"2024-01-30T08:10:13.899585+0000","last_fullsized":"2024-01-30T08:10:13.899585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:02:41.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918170+0000","last_change":"2024-01-30T08:09:52.934384+0000","last_active":"2024-01-30T08:10:12.918170+0000","last_peered":"2024-01-30T08:10:12.918170+0000","last_clean":"2024-01-30T08:10:12.918170+0000","last_became_active":"2024-01-30T08:09:52.934107+0000","last_became_peered":"2024-01-30T08:09:52.934107+0000","last_unstale":"2024-01-30T08:10:12.918170+0000","last_undegraded":"2024-01-30T08:10:12.918170+0000","last_fullsized":"2024-01-30T08:10:12.918170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901026+0000","last_change":"2024-01-30T08:10:11.912589+0000","last_active":"2024-01-30T08:10:13.901026+0000","last_peered":"2024-01-30T08:10:13.901026+0000","last_clean":"2024-01-30T08:10:13.901026+0000","last_became_active":"2024-01-30T08:10:11.912296+0000","last_became_peered":"2024-01-30T08:10:11.912296+0000","last_unstale":"2024-01-30T08:10:13.901026+0000","last_undegraded":"2024-01-30T08:10:13.901026+0000","last_fullsized":"2024-01-30T08:10:13.901026+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:50:39.293564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904610+0000","last_change":"2024-01-30T08:10:10.912271+0000","last_active":"2024-01-30T08:10:13.904610+0000","last_peered":"2024-01-30T08:10:13.904610+0000","last_clean":"2024-01-30T08:10:13.904610+0000","last_became_active":"2024-01-30T08:10:10.911787+0000","last_became_peered":"2024-01-30T08:10:10.911787+0000","last_unstale":"2024-01-30T08:10:13.904610+0000","last_undegraded":"2024-01-30T08:10:13.904610+0000","last_fullsized":"2024-01-30T08:10:13.904610+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:41:52.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918001+0000","last_change":"2024-01-30T08:09:53.878725+0000","last_active":"2024-01-30T08:10:12.918001+0000","last_peered":"2024-01-30T08:10:12.918001+0000","last_clean":"2024-01-30T08:10:12.918001+0000","last_became_active":"2024-01-30T08:09:53.878447+0000","last_became_peered":"2024-01-30T08:09:53.878447+0000","last_unstale":"2024-01-30T08:10:12.918001+0000","last_undegraded":"2024-01-30T08:10:12.918001+0000","last_fullsized":"2024-01-30T08:10:12.918001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:49:08.489833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918331+0000","last_change":"2024-01-30T08:09:52.926720+0000","last_active":"2024-01-30T08:10:12.918331+0000","last_peered":"2024-01-30T08:10:12.918331+0000","last_clean":"2024-01-30T08:10:12.918331+0000","last_became_active":"2024-01-30T08:09:52.926469+0000","last_became_peered":"2024-01-30T08:09:52.926469+0000","last_unstale":"2024-01-30T08:10:12.918331+0000","last_undegraded":"2024-01-30T08:10:12.918331+0000","last_fullsized":"2024-01-30T08:10:12.918331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:28:46.966829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901974+0000","last_change":"2024-01-30T08:10:11.906549+0000","last_active":"2024-01-30T08:10:13.901974+0000","last_peered":"2024-01-30T08:10:13.901974+0000","last_clean":"2024-01-30T08:10:13.901974+0000","last_became_active":"2024-01-30T08:10:11.906263+0000","last_became_peered":"2024-01-30T08:10:11.906263+0000","last_unstale":"2024-01-30T08:10:13.901974+0000","last_undegraded":"2024-01-30T08:10:13.901974+0000","last_fullsized":"2024-01-30T08:10:13.901974+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:00:01.806942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918339+0000","last_change":"2024-01-30T08:10:10.901997+0000","last_active":"2024-01-30T08:10:12.918339+0000","last_peered":"2024-01-30T08:10:12.918339+0000","last_clean":"2024-01-30T08:10:12.918339+0000","last_became_active":"2024-01-30T08:10:10.901704+0000","last_became_peered":"2024-01-30T08:10:10.901704+0000","last_unstale":"2024-01-30T08:10:12.918339+0000","last_undegraded":"2024-01-30T08:10:12.918339+0000","last_fullsized":"2024-01-30T08:10:12.918339+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:06:48.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918456+0000","last_change":"2024-01-30T08:09:53.884967+0000","last_active":"2024-01-30T08:10:12.918456+0000","last_peered":"2024-01-30T08:10:12.918456+0000","last_clean":"2024-01-30T08:10:12.918456+0000","last_became_active":"2024-01-30T08:09:53.884672+0000","last_became_peered":"2024-01-30T08:09:53.884672+0000","last_unstale":"2024-01-30T08:10:12.918456+0000","last_undegraded":"2024-01-30T08:10:12.918456+0000","last_fullsized":"2024-01-30T08:10:12.918456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:31.880278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903760+0000","last_change":"2024-01-30T08:09:52.940186+0000","last_active":"2024-01-30T08:10:13.903760+0000","last_peered":"2024-01-30T08:10:13.903760+0000","last_clean":"2024-01-30T08:10:13.903760+0000","last_became_active":"2024-01-30T08:09:52.939865+0000","last_became_peered":"2024-01-30T08:09:52.939865+0000","last_unstale":"2024-01-30T08:10:13.903760+0000","last_undegraded":"2024-01-30T08:10:13.903760+0000","last_fullsized":"2024-01-30T08:10:13.903760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:22:46.325640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904458+0000","last_change":"2024-01-30T08:10:11.912714+0000","last_active":"2024-01-30T08:10:13.904458+0000","last_peered":"2024-01-30T08:10:13.904458+0000","last_clean":"2024-01-30T08:10:13.904458+0000","last_became_active":"2024-01-30T08:10:11.912428+0000","last_became_peered":"2024-01-30T08:10:11.912428+0000","last_unstale":"2024-01-30T08:10:13.904458+0000","last_undegraded":"2024-01-30T08:10:13.904458+0000","last_fullsized":"2024-01-30T08:10:13.904458+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:51:48.222780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901366+0000","last_change":"2024-01-30T08:10:10.906011+0000","last_active":"2024-01-30T08:10:13.901366+0000","last_peered":"2024-01-30T08:10:13.901366+0000","last_clean":"2024-01-30T08:10:13.901366+0000","last_became_active":"2024-01-30T08:10:10.905777+0000","last_became_peered":"2024-01-30T08:10:10.905777+0000","last_unstale":"2024-01-30T08:10:13.901366+0000","last_undegraded":"2024-01-30T08:10:13.901366+0000","last_fullsized":"2024-01-30T08:10:13.901366+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:26:57.576769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507439+0000","last_change":"2024-01-30T08:09:53.889801+0000","last_active":"2024-01-30T08:10:13.507439+0000","last_peered":"2024-01-30T08:10:13.507439+0000","last_clean":"2024-01-30T08:10:13.507439+0000","last_became_active":"2024-01-30T08:09:53.889554+0000","last_became_peered":"2024-01-30T08:09:53.889554+0000","last_unstale":"2024-01-30T08:10:13.507439+0000","last_undegraded":"2024-01-30T08:10:13.507439+0000","last_fullsized":"2024-01-30T08:10:13.507439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:13:20.247550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918035+0000","last_change":"2024-01-30T08:09:52.942833+0000","last_active":"2024-01-30T08:10:12.918035+0000","last_peered":"2024-01-30T08:10:12.918035+0000","last_clean":"2024-01-30T08:10:12.918035+0000","last_became_active":"2024-01-30T08:09:52.942541+0000","last_became_peered":"2024-01-30T08:09:52.942541+0000","last_unstale":"2024-01-30T08:10:12.918035+0000","last_undegraded":"2024-01-30T08:10:12.918035+0000","last_fullsized":"2024-01-30T08:10:12.918035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:20:41.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903764+0000","last_change":"2024-01-30T08:10:11.913819+0000","last_active":"2024-01-30T08:10:13.903764+0000","last_peered":"2024-01-30T08:10:13.903764+0000","last_clean":"2024-01-30T08:10:13.903764+0000","last_became_active":"2024-01-30T08:10:11.912016+0000","last_became_peered":"2024-01-30T08:10:11.912016+0000","last_unstale":"2024-01-30T08:10:13.903764+0000","last_undegraded":"2024-01-30T08:10:13.903764+0000","last_fullsized":"2024-01-30T08:10:13.903764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:42:30.352856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917330+0000","last_change":"2024-01-30T08:10:10.903002+0000","last_active":"2024-01-30T08:10:12.917330+0000","last_peered":"2024-01-30T08:10:12.917330+0000","last_clean":"2024-01-30T08:10:12.917330+0000","last_became_active":"2024-01-30T08:10:10.902684+0000","last_became_peered":"2024-01-30T08:10:10.902684+0000","last_unstale":"2024-01-30T08:10:12.917330+0000","last_undegraded":"2024-01-30T08:10:12.917330+0000","last_fullsized":"2024-01-30T08:10:12.917330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:04:15.096282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902298+0000","last_change":"2024-01-30T08:09:53.883346+0000","last_active":"2024-01-30T08:10:13.902298+0000","last_peered":"2024-01-30T08:10:13.902298+0000","last_clean":"2024-01-30T08:10:13.902298+0000","last_became_active":"2024-01-30T08:09:53.878878+0000","last_became_peered":"2024-01-30T08:09:53.878878+0000","last_unstale":"2024-01-30T08:10:13.902298+0000","last_undegraded":"2024-01-30T08:10:13.902298+0000","last_fullsized":"2024-01-30T08:10:13.902298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:37:52.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917678+0000","last_change":"2024-01-30T08:09:52.922090+0000","last_active":"2024-01-30T08:10:12.917678+0000","last_peered":"2024-01-30T08:10:12.917678+0000","last_clean":"2024-01-30T08:10:12.917678+0000","last_became_active":"2024-01-30T08:09:52.921712+0000","last_became_peered":"2024-01-30T08:09:52.921712+0000","last_unstale":"2024-01-30T08:10:12.917678+0000","last_undegraded":"2024-01-30T08:10:12.917678+0000","last_fullsized":"2024-01-30T08:10:12.917678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:05:15.131254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898989+0000","last_change":"2024-01-30T08:10:11.913825+0000","last_active":"2024-01-30T08:10:13.898989+0000","last_peered":"2024-01-30T08:10:13.898989+0000","last_clean":"2024-01-30T08:10:13.898989+0000","last_became_active":"2024-01-30T08:10:11.913570+0000","last_became_peered":"2024-01-30T08:10:11.913570+0000","last_unstale":"2024-01-30T08:10:13.898989+0000","last_undegraded":"2024-01-30T08:10:13.898989+0000","last_fullsized":"2024-01-30T08:10:13.898989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:14:39.027622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903437+0000","last_change":"2024-01-30T08:10:10.901139+0000","last_active":"2024-01-30T08:10:13.903437+0000","last_peered":"2024-01-30T08:10:13.903437+0000","last_clean":"2024-01-30T08:10:13.903437+0000","last_became_active":"2024-01-30T08:10:10.900931+0000","last_became_peered":"2024-01-30T08:10:10.900931+0000","last_unstale":"2024-01-30T08:10:13.903437+0000","last_undegraded":"2024-01-30T08:10:13.903437+0000","last_fullsized":"2024-01-30T08:10:13.903437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:48.643863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898663+0000","last_change":"2024-01-30T08:09:53.886717+0000","last_active":"2024-01-30T08:10:13.898663+0000","last_peered":"2024-01-30T08:10:13.898663+0000","last_clean":"2024-01-30T08:10:13.898663+0000","last_became_active":"2024-01-30T08:09:53.884242+0000","last_became_peered":"2024-01-30T08:09:53.884242+0000","last_unstale":"2024-01-30T08:10:13.898663+0000","last_undegraded":"2024-01-30T08:10:13.898663+0000","last_fullsized":"2024-01-30T08:10:13.898663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:06:05.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508410+0000","last_change":"2024-01-30T08:09:52.930108+0000","last_active":"2024-01-30T08:10:13.508410+0000","last_peered":"2024-01-30T08:10:13.508410+0000","last_clean":"2024-01-30T08:10:13.508410+0000","last_became_active":"2024-01-30T08:09:52.929804+0000","last_became_peered":"2024-01-30T08:09:52.929804+0000","last_unstale":"2024-01-30T08:10:13.508410+0000","last_undegraded":"2024-01-30T08:10:13.508410+0000","last_fullsized":"2024-01-30T08:10:13.508410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:50:22.394882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918723+0000","last_change":"2024-01-30T08:10:11.914155+0000","last_active":"2024-01-30T08:10:12.918723+0000","last_peered":"2024-01-30T08:10:12.918723+0000","last_clean":"2024-01-30T08:10:12.918723+0000","last_became_active":"2024-01-30T08:10:11.913857+0000","last_became_peered":"2024-01-30T08:10:11.913857+0000","last_unstale":"2024-01-30T08:10:12.918723+0000","last_undegraded":"2024-01-30T08:10:12.918723+0000","last_fullsized":"2024-01-30T08:10:12.918723+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:21:27.718257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901305+0000","last_change":"2024-01-30T08:10:10.898471+0000","last_active":"2024-01-30T08:10:13.901305+0000","last_peered":"2024-01-30T08:10:13.901305+0000","last_clean":"2024-01-30T08:10:13.901305+0000","last_became_active":"2024-01-30T08:10:10.898196+0000","last_became_peered":"2024-01-30T08:10:10.898196+0000","last_unstale":"2024-01-30T08:10:13.901305+0000","last_undegraded":"2024-01-30T08:10:13.901305+0000","last_fullsized":"2024-01-30T08:10:13.901305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:06:35.040336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903928+0000","last_change":"2024-01-30T08:09:53.890071+0000","last_active":"2024-01-30T08:10:13.903928+0000","last_peered":"2024-01-30T08:10:13.903928+0000","last_clean":"2024-01-30T08:10:13.903928+0000","last_became_active":"2024-01-30T08:09:53.885624+0000","last_became_peered":"2024-01-30T08:09:53.885624+0000","last_unstale":"2024-01-30T08:10:13.903928+0000","last_undegraded":"2024-01-30T08:10:13.903928+0000","last_fullsized":"2024-01-30T08:10:13.903928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:26:56.122973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917512+0000","last_change":"2024-01-30T08:09:52.932389+0000","last_active":"2024-01-30T08:10:12.917512+0000","last_peered":"2024-01-30T08:10:12.917512+0000","last_clean":"2024-01-30T08:10:12.917512+0000","last_became_active":"2024-01-30T08:09:52.931763+0000","last_became_peered":"2024-01-30T08:09:52.931763+0000","last_unstale":"2024-01-30T08:10:12.917512+0000","last_undegraded":"2024-01-30T08:10:12.917512+0000","last_fullsized":"2024-01-30T08:10:12.917512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:15:08.756985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901861+0000","last_change":"2024-01-30T08:10:11.911028+0000","last_active":"2024-01-30T08:10:13.901861+0000","last_peered":"2024-01-30T08:10:13.901861+0000","last_clean":"2024-01-30T08:10:13.901861+0000","last_became_active":"2024-01-30T08:10:11.910777+0000","last_became_peered":"2024-01-30T08:10:11.910777+0000","last_unstale":"2024-01-30T08:10:13.901861+0000","last_undegraded":"2024-01-30T08:10:13.901861+0000","last_fullsized":"2024-01-30T08:10:13.901861+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:12:22.341491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507876+0000","last_change":"2024-01-30T08:10:10.907980+0000","last_active":"2024-01-30T08:10:13.507876+0000","last_peered":"2024-01-30T08:10:13.507876+0000","last_clean":"2024-01-30T08:10:13.507876+0000","last_became_active":"2024-01-30T08:10:10.907667+0000","last_became_peered":"2024-01-30T08:10:10.907667+0000","last_unstale":"2024-01-30T08:10:13.507876+0000","last_undegraded":"2024-01-30T08:10:13.507876+0000","last_fullsized":"2024-01-30T08:10:13.507876+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:32.700020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903177+0000","last_change":"2024-01-30T08:09:53.887124+0000","last_active":"2024-01-30T08:10:13.903177+0000","last_peered":"2024-01-30T08:10:13.903177+0000","last_clean":"2024-01-30T08:10:13.903177+0000","last_became_active":"2024-01-30T08:09:53.885253+0000","last_became_peered":"2024-01-30T08:09:53.885253+0000","last_unstale":"2024-01-30T08:10:13.903177+0000","last_undegraded":"2024-01-30T08:10:13.903177+0000","last_fullsized":"2024-01-30T08:10:13.903177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:03:58.138089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899700+0000","last_change":"2024-01-30T08:09:52.940728+0000","last_active":"2024-01-30T08:10:13.899700+0000","last_peered":"2024-01-30T08:10:13.899700+0000","last_clean":"2024-01-30T08:10:13.899700+0000","last_became_active":"2024-01-30T08:09:52.940364+0000","last_became_peered":"2024-01-30T08:09:52.940364+0000","last_unstale":"2024-01-30T08:10:13.899700+0000","last_undegraded":"2024-01-30T08:10:13.899700+0000","last_fullsized":"2024-01-30T08:10:13.899700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:23:51.914756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902923+0000","last_change":"2024-01-30T08:10:11.917172+0000","last_active":"2024-01-30T08:10:13.902923+0000","last_peered":"2024-01-30T08:10:13.902923+0000","last_clean":"2024-01-30T08:10:13.902923+0000","last_became_active":"2024-01-30T08:10:11.916907+0000","last_became_peered":"2024-01-30T08:10:11.916907+0000","last_unstale":"2024-01-30T08:10:13.902923+0000","last_undegraded":"2024-01-30T08:10:13.902923+0000","last_fullsized":"2024-01-30T08:10:13.902923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:51:50.191406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901644+0000","last_change":"2024-01-30T08:10:10.901224+0000","last_active":"2024-01-30T08:10:13.901644+0000","last_peered":"2024-01-30T08:10:13.901644+0000","last_clean":"2024-01-30T08:10:13.901644+0000","last_became_active":"2024-01-30T08:10:10.900957+0000","last_became_peered":"2024-01-30T08:10:10.900957+0000","last_unstale":"2024-01-30T08:10:13.901644+0000","last_undegraded":"2024-01-30T08:10:13.901644+0000","last_fullsized":"2024-01-30T08:10:13.901644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:23:17.774625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508191+0000","last_change":"2024-01-30T08:09:53.881598+0000","last_active":"2024-01-30T08:10:13.508191+0000","last_peered":"2024-01-30T08:10:13.508191+0000","last_clean":"2024-01-30T08:10:13.508191+0000","last_became_active":"2024-01-30T08:09:53.881156+0000","last_became_peered":"2024-01-30T08:09:53.881156+0000","last_unstale":"2024-01-30T08:10:13.508191+0000","last_undegraded":"2024-01-30T08:10:13.508191+0000","last_fullsized":"2024-01-30T08:10:13.508191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:10:48.690042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918464+0000","last_change":"2024-01-30T08:09:52.936421+0000","last_active":"2024-01-30T08:10:12.918464+0000","last_peered":"2024-01-30T08:10:12.918464+0000","last_clean":"2024-01-30T08:10:12.918464+0000","last_became_active":"2024-01-30T08:09:52.936159+0000","last_became_peered":"2024-01-30T08:09:52.936159+0000","last_unstale":"2024-01-30T08:10:12.918464+0000","last_undegraded":"2024-01-30T08:10:12.918464+0000","last_fullsized":"2024-01-30T08:10:12.918464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:59:27.883539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898644+0000","last_change":"2024-01-30T08:10:11.911523+0000","last_active":"2024-01-30T08:10:13.898644+0000","last_peered":"2024-01-30T08:10:13.898644+0000","last_clean":"2024-01-30T08:10:13.898644+0000","last_became_active":"2024-01-30T08:10:11.910812+0000","last_became_peered":"2024-01-30T08:10:11.910812+0000","last_unstale":"2024-01-30T08:10:13.898644+0000","last_undegraded":"2024-01-30T08:10:13.898644+0000","last_fullsized":"2024-01-30T08:10:13.898644+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:26:33.166979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.919016+0000","last_change":"2024-01-30T08:10:10.904370+0000","last_active":"2024-01-30T08:10:12.919016+0000","last_peered":"2024-01-30T08:10:12.919016+0000","last_clean":"2024-01-30T08:10:12.919016+0000","last_became_active":"2024-01-30T08:10:10.903904+0000","last_became_peered":"2024-01-30T08:10:10.903904+0000","last_unstale":"2024-01-30T08:10:12.919016+0000","last_undegraded":"2024-01-30T08:10:12.919016+0000","last_fullsized":"2024-01-30T08:10:12.919016+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:28:48.643863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902582+0000","last_change":"2024-01-30T08:09:53.890130+0000","last_active":"2024-01-30T08:10:13.902582+0000","last_peered":"2024-01-30T08:10:13.902582+0000","last_clean":"2024-01-30T08:10:13.902582+0000","last_became_active":"2024-01-30T08:09:53.889864+0000","last_became_peered":"2024-01-30T08:09:53.889864+0000","last_unstale":"2024-01-30T08:10:13.902582+0000","last_undegraded":"2024-01-30T08:10:13.902582+0000","last_fullsized":"2024-01-30T08:10:13.902582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:13:38.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.903983+0000","last_change":"2024-01-30T08:09:52.939807+0000","last_active":"2024-01-30T08:10:13.903983+0000","last_peered":"2024-01-30T08:10:13.903983+0000","last_clean":"2024-01-30T08:10:13.903983+0000","last_became_active":"2024-01-30T08:09:52.939527+0000","last_became_peered":"2024-01-30T08:09:52.939527+0000","last_unstale":"2024-01-30T08:10:13.903983+0000","last_undegraded":"2024-01-30T08:10:13.903983+0000","last_fullsized":"2024-01-30T08:10:13.903983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:30:27.351725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904345+0000","last_change":"2024-01-30T08:10:11.925753+0000","last_active":"2024-01-30T08:10:13.904345+0000","last_peered":"2024-01-30T08:10:13.904345+0000","last_clean":"2024-01-30T08:10:13.904345+0000","last_became_active":"2024-01-30T08:10:11.925478+0000","last_became_peered":"2024-01-30T08:10:11.925478+0000","last_unstale":"2024-01-30T08:10:13.904345+0000","last_undegraded":"2024-01-30T08:10:13.904345+0000","last_fullsized":"2024-01-30T08:10:13.904345+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T08:54:10.655468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917264+0000","last_change":"2024-01-30T08:10:10.894915+0000","last_active":"2024-01-30T08:10:12.917264+0000","last_peered":"2024-01-30T08:10:12.917264+0000","last_clean":"2024-01-30T08:10:12.917264+0000","last_became_active":"2024-01-30T08:10:10.894000+0000","last_became_peered":"2024-01-30T08:10:10.894000+0000","last_unstale":"2024-01-30T08:10:12.917264+0000","last_undegraded":"2024-01-30T08:10:12.917264+0000","last_fullsized":"2024-01-30T08:10:12.917264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:27:13.081166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901499+0000","last_change":"2024-01-30T08:09:53.882768+0000","last_active":"2024-01-30T08:10:13.901499+0000","last_peered":"2024-01-30T08:10:13.901499+0000","last_clean":"2024-01-30T08:10:13.901499+0000","last_became_active":"2024-01-30T08:09:53.882430+0000","last_became_peered":"2024-01-30T08:09:53.882430+0000","last_unstale":"2024-01-30T08:10:13.901499+0000","last_undegraded":"2024-01-30T08:10:13.901499+0000","last_fullsized":"2024-01-30T08:10:13.901499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T14:07:58.955284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902220+0000","last_change":"2024-01-30T08:09:52.940017+0000","last_active":"2024-01-30T08:10:13.902220+0000","last_peered":"2024-01-30T08:10:13.902220+0000","last_clean":"2024-01-30T08:10:13.902220+0000","last_became_active":"2024-01-30T08:09:52.939551+0000","last_became_peered":"2024-01-30T08:09:52.939551+0000","last_unstale":"2024-01-30T08:10:13.902220+0000","last_undegraded":"2024-01-30T08:10:13.902220+0000","last_fullsized":"2024-01-30T08:10:13.902220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:19:01.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902717+0000","last_change":"2024-01-30T08:10:11.918504+0000","last_active":"2024-01-30T08:10:13.902717+0000","last_peered":"2024-01-30T08:10:13.902717+0000","last_clean":"2024-01-30T08:10:13.902717+0000","last_became_active":"2024-01-30T08:10:11.918257+0000","last_became_peered":"2024-01-30T08:10:11.918257+0000","last_unstale":"2024-01-30T08:10:13.902717+0000","last_undegraded":"2024-01-30T08:10:13.902717+0000","last_fullsized":"2024-01-30T08:10:13.902717+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T18:31:59.618012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.898795+0000","last_change":"2024-01-30T08:10:10.902200+0000","last_active":"2024-01-30T08:10:13.898795+0000","last_peered":"2024-01-30T08:10:13.898795+0000","last_clean":"2024-01-30T08:10:13.898795+0000","last_became_active":"2024-01-30T08:10:10.901913+0000","last_became_peered":"2024-01-30T08:10:10.901913+0000","last_unstale":"2024-01-30T08:10:13.898795+0000","last_undegraded":"2024-01-30T08:10:13.898795+0000","last_fullsized":"2024-01-30T08:10:13.898795+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:58:26.634238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.902094+0000","last_change":"2024-01-30T08:09:53.889365+0000","last_active":"2024-01-30T08:10:13.902094+0000","last_peered":"2024-01-30T08:10:13.902094+0000","last_clean":"2024-01-30T08:10:13.902094+0000","last_became_active":"2024-01-30T08:09:53.884226+0000","last_became_peered":"2024-01-30T08:09:53.884226+0000","last_unstale":"2024-01-30T08:10:13.902094+0000","last_undegraded":"2024-01-30T08:10:13.902094+0000","last_fullsized":"2024-01-30T08:10:13.902094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T11:47:53.163114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.918555+0000","last_change":"2024-01-30T08:09:52.930217+0000","last_active":"2024-01-30T08:10:12.918555+0000","last_peered":"2024-01-30T08:10:12.918555+0000","last_clean":"2024-01-30T08:10:12.918555+0000","last_became_active":"2024-01-30T08:09:52.929931+0000","last_became_peered":"2024-01-30T08:09:52.929931+0000","last_unstale":"2024-01-30T08:10:12.918555+0000","last_undegraded":"2024-01-30T08:10:12.918555+0000","last_fullsized":"2024-01-30T08:10:12.918555+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:42:16.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901545+0000","last_change":"2024-01-30T08:10:11.919869+0000","last_active":"2024-01-30T08:10:13.901545+0000","last_peered":"2024-01-30T08:10:13.901545+0000","last_clean":"2024-01-30T08:10:13.901545+0000","last_became_active":"2024-01-30T08:10:11.916750+0000","last_became_peered":"2024-01-30T08:10:11.916750+0000","last_unstale":"2024-01-30T08:10:13.901545+0000","last_undegraded":"2024-01-30T08:10:13.901545+0000","last_fullsized":"2024-01-30T08:10:13.901545+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:26:33.166979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901901+0000","last_change":"2024-01-30T08:10:10.898772+0000","last_active":"2024-01-30T08:10:13.901901+0000","last_peered":"2024-01-30T08:10:13.901901+0000","last_clean":"2024-01-30T08:10:13.901901+0000","last_became_active":"2024-01-30T08:10:10.898513+0000","last_became_peered":"2024-01-30T08:10:10.898513+0000","last_unstale":"2024-01-30T08:10:13.901901+0000","last_undegraded":"2024-01-30T08:10:13.901901+0000","last_fullsized":"2024-01-30T08:10:13.901901+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:00:00.801765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917514+0000","last_change":"2024-01-30T08:09:53.885438+0000","last_active":"2024-01-30T08:10:12.917514+0000","last_peered":"2024-01-30T08:10:12.917514+0000","last_clean":"2024-01-30T08:10:12.917514+0000","last_became_active":"2024-01-30T08:09:53.884988+0000","last_became_peered":"2024-01-30T08:09:53.884988+0000","last_unstale":"2024-01-30T08:10:12.917514+0000","last_undegraded":"2024-01-30T08:10:12.917514+0000","last_fullsized":"2024-01-30T08:10:12.917514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T13:37:21.008804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.917511+0000","last_change":"2024-01-30T08:09:52.932025+0000","last_active":"2024-01-30T08:10:12.917511+0000","last_peered":"2024-01-30T08:10:12.917511+0000","last_clean":"2024-01-30T08:10:12.917511+0000","last_became_active":"2024-01-30T08:09:52.931756+0000","last_became_peered":"2024-01-30T08:09:52.931756+0000","last_unstale":"2024-01-30T08:10:12.917511+0000","last_undegraded":"2024-01-30T08:10:12.917511+0000","last_fullsized":"2024-01-30T08:10:12.917511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:13:20.100370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899303+0000","last_change":"2024-01-30T08:10:11.927980+0000","last_active":"2024-01-30T08:10:13.899303+0000","last_peered":"2024-01-30T08:10:13.899303+0000","last_clean":"2024-01-30T08:10:13.899303+0000","last_became_active":"2024-01-30T08:10:11.927664+0000","last_became_peered":"2024-01-30T08:10:11.927664+0000","last_unstale":"2024-01-30T08:10:13.899303+0000","last_undegraded":"2024-01-30T08:10:13.899303+0000","last_fullsized":"2024-01-30T08:10:13.899303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:37:22.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901612+0000","last_change":"2024-01-30T08:10:10.899914+0000","last_active":"2024-01-30T08:10:13.901612+0000","last_peered":"2024-01-30T08:10:13.901612+0000","last_clean":"2024-01-30T08:10:13.901612+0000","last_became_active":"2024-01-30T08:10:10.899549+0000","last_became_peered":"2024-01-30T08:10:10.899549+0000","last_unstale":"2024-01-30T08:10:13.901612+0000","last_undegraded":"2024-01-30T08:10:13.901612+0000","last_fullsized":"2024-01-30T08:10:13.901612+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T16:32:32.700020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508069+0000","last_change":"2024-01-30T08:09:53.879936+0000","last_active":"2024-01-30T08:10:13.508069+0000","last_peered":"2024-01-30T08:10:13.508069+0000","last_clean":"2024-01-30T08:10:13.508069+0000","last_became_active":"2024-01-30T08:09:53.879454+0000","last_became_peered":"2024-01-30T08:09:53.879454+0000","last_unstale":"2024-01-30T08:10:13.508069+0000","last_undegraded":"2024-01-30T08:10:13.508069+0000","last_fullsized":"2024-01-30T08:10:13.508069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T19:05:36.204400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.901237+0000","last_change":"2024-01-30T08:09:52.931760+0000","last_active":"2024-01-30T08:10:13.901237+0000","last_peered":"2024-01-30T08:10:13.901237+0000","last_clean":"2024-01-30T08:10:13.901237+0000","last_became_active":"2024-01-30T08:09:52.931497+0000","last_became_peered":"2024-01-30T08:09:52.931497+0000","last_unstale":"2024-01-30T08:10:13.901237+0000","last_undegraded":"2024-01-30T08:10:13.901237+0000","last_fullsized":"2024-01-30T08:10:13.901237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:18:57.076432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:12.916939+0000","last_change":"2024-01-30T08:10:11.903462+0000","last_active":"2024-01-30T08:10:12.916939+0000","last_peered":"2024-01-30T08:10:12.916939+0000","last_clean":"2024-01-30T08:10:12.916939+0000","last_became_active":"2024-01-30T08:10:11.903125+0000","last_became_peered":"2024-01-30T08:10:11.903125+0000","last_unstale":"2024-01-30T08:10:12.916939+0000","last_undegraded":"2024-01-30T08:10:12.916939+0000","last_fullsized":"2024-01-30T08:10:12.916939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:10.870409+0000","last_clean_scrub_stamp":"2024-01-30T08:10:10.870409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T17:59:44.442066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"43'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.904502+0000","last_change":"2024-01-30T08:10:10.907159+0000","last_active":"2024-01-30T08:10:13.904502+0000","last_peered":"2024-01-30T08:10:13.904502+0000","last_clean":"2024-01-30T08:10:13.904502+0000","last_became_active":"2024-01-30T08:10:10.906711+0000","last_became_peered":"2024-01-30T08:10:10.906711+0000","last_unstale":"2024-01-30T08:10:13.904502+0000","last_undegraded":"2024-01-30T08:10:13.904502+0000","last_fullsized":"2024-01-30T08:10:13.904502+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:10:09.865232+0000","last_clean_scrub_stamp":"2024-01-30T08:10:09.865232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:55:37.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.899433+0000","last_change":"2024-01-30T08:09:53.893858+0000","last_active":"2024-01-30T08:10:13.899433+0000","last_peered":"2024-01-30T08:10:13.899433+0000","last_clean":"2024-01-30T08:10:13.899433+0000","last_became_active":"2024-01-30T08:09:53.893613+0000","last_became_peered":"2024-01-30T08:09:53.893613+0000","last_unstale":"2024-01-30T08:10:13.899433+0000","last_undegraded":"2024-01-30T08:10:13.899433+0000","last_fullsized":"2024-01-30T08:10:13.899433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:52.907039+0000","last_clean_scrub_stamp":"2024-01-30T08:09:52.907039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T15:43:09.834509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.508258+0000","last_change":"2024-01-30T08:09:52.933263+0000","last_active":"2024-01-30T08:10:13.508258+0000","last_peered":"2024-01-30T08:10:13.508258+0000","last_clean":"2024-01-30T08:10:13.508258+0000","last_became_active":"2024-01-30T08:09:52.931887+0000","last_became_peered":"2024-01-30T08:09:52.931887+0000","last_unstale":"2024-01-30T08:10:13.508258+0000","last_undegraded":"2024-01-30T08:10:13.508258+0000","last_fullsized":"2024-01-30T08:10:13.508258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:09:51.899931+0000","last_clean_scrub_stamp":"2024-01-30T08:09:51.899931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T09:00:30.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-30T08:10:13.507472+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:13.507472+0000","last_peered":"2024-01-30T08:10:13.507472+0000","last_clean":"2024-01-30T08:10:13.507472+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:13.507472+0000","last_undegraded":"2024-01-30T08:10:13.507472+0000","last_fullsized":"2024-01-30T08:10:13.507472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":815493,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5059999999999998,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.83999999999999997}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.714,"5min":3.714,"15min":3.714},"last":0.89000000000000001}]},{"osd":3,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.92200000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.82099999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71099999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.75700000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":223058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.58699999999999997}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.0350000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.64700000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.48199999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":223010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.79700000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.877}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.86699999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":528384,"data_stored":226599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80200000000000005}]},{"osd":7,"last update":"Tue Jan 30 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.66000000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":512000,"data_stored":223506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67200000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47999999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.88600000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.90900000000000003}]},{"osd":5,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.044}]},{"osd":6,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.018}]},{"osd":7,"last update":"Tue Jan 30 08:09:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.94699999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":222074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.7050000000000001,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.318},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.39500000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.436},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.47399999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.383,"5min":5.383,"15min":5.383},"last":0.629}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:09:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.745}]},{"osd":4,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56499999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52600000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":812282,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.40100000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.30399999999999999}]},{"osd":3,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.88600000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.84899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:21.004 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-30T08:10:21.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-30T08:10:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a72c00640 1 Processor -- start 2024-01-30T08:10:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a72c00640 1 -- start start 2024-01-30T08:10:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a72c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0a6c0c7ae0 0x7f0a6c0c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a72c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0c8a50 con 0x7f0a6c1568a0 2024-01-30T08:10:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a72c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0c66d0 con 0x7f0a6c0c50d0 2024-01-30T08:10:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a72c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c7070 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a6b400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a6c1568a0 0x7f0a6c0c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49124/0 (socket says 172.21.15.50:49124) 2024-01-30T08:10:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a6b400640 1 -- 172.21.15.50:0/1507729993 learned_addr learned my addr 172.21.15.50:0/1507729993 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a70c00640 1 --2- 172.21.15.50:0/1507729993 >> v2:172.21.15.125:3300/0 conn(0x7f0a6c0c7ae0 0x7f0a6c0c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a6aa00640 1 -- 172.21.15.50:0/1507729993 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660889169 0 0) 0x7f0a6c0c8a50 con 0x7f0a6c1568a0 2024-01-30T08:10:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a6aa00640 1 -- 172.21.15.50:0/1507729993 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a4c003530 con 0x7f0a6c1568a0 2024-01-30T08:10:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a70c00640 1 -- 172.21.15.50:0/1507729993 >> v1:172.21.15.125:6789/0 conn(0x7f0a6c0c50d0 legacy=0x7f0a6c156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a70c00640 1 -- 172.21.15.50:0/1507729993 >> v1:172.21.15.50:6789/0 conn(0x7f0a6c1568a0 legacy=0x7f0a6c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a6aa00640 1 -- 172.21.15.50:0/1507729993 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207583027 0 0) 0x7f0a6c0c66d0 con 0x7f0a6c0c50d0 2024-01-30T08:10:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.188+0000 7f0a70c00640 1 -- 172.21.15.50:0/1507729993 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0c69b0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a70c00640 1 --2- 172.21.15.50:0/1507729993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c7ae0 0x7f0a6c0c37c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009d90 tx=0x7f0a6401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ede2dacdd9a8563 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a6aa00640 1 -- 172.21.15.50:0/1507729993 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640a5970 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a6aa00640 1 -- 172.21.15.50:0/1507729993 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a640a5ad0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a6aa00640 1 -- 172.21.15.50:0/1507729993 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640a5e60 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a72c00640 1 -- 172.21.15.50:0/1507729993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c7ae0 msgr2=0x7f0a6c0c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a72c00640 1 --2- 172.21.15.50:0/1507729993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c7ae0 0x7f0a6c0c37c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009d90 tx=0x7f0a6401c890 comp rx=0 tx=0).stop 2024-01-30T08:10:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a72c00640 1 -- 172.21.15.50:0/1507729993 shutdown_connections 2024-01-30T08:10:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a72c00640 1 --2- 172.21.15.50:0/1507729993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c7ae0 0x7f0a6c0c37c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a72c00640 1 -- 172.21.15.50:0/1507729993 >> 172.21.15.50:0/1507729993 conn(0x7f0a6c0727c0 msgr2=0x7f0a6c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a72c00640 1 -- 172.21.15.50:0/1507729993 shutdown_connections 2024-01-30T08:10:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.192+0000 7f0a72c00640 1 -- 172.21.15.50:0/1507729993 wait complete. 2024-01-30T08:10:21.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 Processor -- start 2024-01-30T08:10:21.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 -- start start 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c50d0 0x7f0a6c14a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a6c0c7ae0 0x7f0a6c142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a6c1568a0 0x7f0a6c143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c8d30 con 0x7f0a6c1568a0 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c143960 con 0x7f0a6c0c50d0 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0abcc0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6be00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c50d0 0x7f0a6c14a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a6c0c7ae0 0x7f0a6c142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a6c0c7ae0 0x7f0a6c142ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:37224/0 (socket says 172.21.15.50:37224) 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 -- 172.21.15.50:0/3409832455 learned_addr learned my addr 172.21.15.50:0/3409832455 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a70c00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a6c1568a0 0x7f0a6c143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 -- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c50d0 msgr2=0x7f0a6c14a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c50d0 0x7f0a6c14a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 -- 172.21.15.50:0/3409832455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a6c1568a0 msgr2=0x7f0a6c143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a6c1568a0 0x7f0a6c143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 -- 172.21.15.50:0/3409832455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009a70 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6be00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c50d0 0x7f0a6c14a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a6b400640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a6c0c7ae0 0x7f0a6c142ee0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c3c0 tx=0x7f0a5400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a63e00640 1 -- 172.21.15.50:0/3409832455 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54005cf0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a63e00640 1 -- 172.21.15.50:0/3409832455 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54005e70 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c0abfa0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a63e00640 1 -- 172.21.15.50:0/3409832455 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a540072f0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.196+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c0ac560 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.200+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c074a20 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.200+0000 7f0a63e00640 1 -- 172.21.15.50:0/3409832455 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0a54007450 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.200+0000 7f0a63e00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a44066500 0x7f0a440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.200+0000 7f0a63e00640 1 -- 172.21.15.50:0/3409832455 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0a54083880 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.200+0000 7f0a6be00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a44066500 0x7f0a440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.200+0000 7f0a6be00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a44066500 0x7f0a440689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c000f70 tx=0x7f0a5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:21.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.204+0000 7f0a63e00640 1 -- 172.21.15.50:0/3409832455 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0a540507e0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.420+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f0a6c0c1ae0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a63e00640 1 -- 172.21.15.50:0/3409832455 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7f0a540170e0 con 0x7f0a6c0c7ae0 2024-01-30T08:10:21.431 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2024-01-30T08:10:21.432 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYrrhlwkDyFRAAgm1JuVaCD1chL8w929N1hQ== 2024-01-30T08:10:21.432 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-01-30T08:10:21.432 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-01-30T08:10:21.432 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-30T08:10:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.1 2024-01-30T08:10:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a44066500 msgr2=0x7f0a440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a44066500 0x7f0a440689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c000f70 tx=0x7f0a5c009040 comp rx=0 tx=0).stop 2024-01-30T08:10:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a6c0c7ae0 msgr2=0x7f0a6c142ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a6c0c7ae0 0x7f0a6c142ee0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c3c0 tx=0x7f0a5400c880 comp rx=0 tx=0).stop 2024-01-30T08:10:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 shutdown_connections 2024-01-30T08:10:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a44066500 0x7f0a440689c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a6c1568a0 0x7f0a6c143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0a6c0c7ae0 0x7f0a6c142ee0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 --2- 172.21.15.50:0/3409832455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a6c0c50d0 0x7f0a6c14a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.428+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 >> 172.21.15.50:0/3409832455 conn(0x7f0a6c0727c0 msgr2=0x7f0a6c153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.432+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 shutdown_connections 2024-01-30T08:10:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.432+0000 7f0a72c00640 1 -- 172.21.15.50:0/3409832455 wait complete. 2024-01-30T08:10:21.453 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:21.453 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:21.463 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:21.463 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:21.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.652+0000 7fd1d1800640 1 Processor -- start 2024-01-30T08:10:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.652+0000 7fd1d1800640 1 -- start start 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1d1800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1d1800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1cc06e220 0x7fd1cc15f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1d1800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0c7b40 con 0x7fd1cc06de40 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1d1800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc0a7770 con 0x7fd1cc06e220 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1d1800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc155310 con 0x7fd1cc0a7120 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1cb400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1cc06e220 0x7fd1cc15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1cb400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1cc06e220 0x7fd1cc15f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33060/0 (socket says 172.21.15.50:33060) 2024-01-30T08:10:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1cb400640 1 -- 172.21.15.50:0/484785410 learned_addr learned my addr 172.21.15.50:0/484785410 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1caa00640 1 --1- 172.21.15.50:0/484785410 >> v1:172.21.15.50:6789/0 conn(0x7fd1cc06de40 0x7fd1cc157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49132/0 (socket says 172.21.15.50:49132) 2024-01-30T08:10:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1ca000640 1 --2- 172.21.15.50:0/484785410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1cb400640 1 -- 172.21.15.50:0/484785410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 msgr2=0x7fd1cc1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1cb400640 1 --2- 172.21.15.50:0/484785410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1cb400640 1 -- 172.21.15.50:0/484785410 >> v1:172.21.15.50:6789/0 conn(0x7fd1cc06de40 legacy=0x7fd1cc157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1cb400640 1 -- 172.21.15.50:0/484785410 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc155730 con 0x7fd1cc06e220 2024-01-30T08:10:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.656+0000 7fd1c9600640 1 -- 172.21.15.50:0/484785410 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386136170 0 0) 0x7fd1bc001120 con 0x7fd1cc06de40 2024-01-30T08:10:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1cb400640 1 --2- 172.21.15.50:0/484785410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc15f120 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009e50 tx=0x7fd1c401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f183cde14277b18e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1c9600640 1 -- 172.21.15.50:0/484785410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40a56e0 con 0x7fd1cc06e220 2024-01-30T08:10:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1c9600640 1 -- 172.21.15.50:0/484785410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c40a5840 con 0x7fd1cc06e220 2024-01-30T08:10:21.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1c9600640 1 -- 172.21.15.50:0/484785410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40a5bd0 con 0x7fd1cc06e220 2024-01-30T08:10:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 -- 172.21.15.50:0/484785410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 msgr2=0x7fd1cc15f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 --2- 172.21.15.50:0/484785410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc15f120 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009e50 tx=0x7fd1c401ca10 comp rx=0 tx=0).stop 2024-01-30T08:10:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 -- 172.21.15.50:0/484785410 shutdown_connections 2024-01-30T08:10:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 --2- 172.21.15.50:0/484785410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc15f120 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 --2- 172.21.15.50:0/484785410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 -- 172.21.15.50:0/484785410 >> 172.21.15.50:0/484785410 conn(0x7fd1cc0c4830 msgr2=0x7fd1cc0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 -- 172.21.15.50:0/484785410 shutdown_connections 2024-01-30T08:10:21.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 -- 172.21.15.50:0/484785410 wait complete. 2024-01-30T08:10:21.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 Processor -- start 2024-01-30T08:10:21.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.660+0000 7fd1d1800640 1 -- start start 2024-01-30T08:10:21.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1cc06de40 0x7fd1cc14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc1ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc14a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc1ecc60 con 0x7fd1cc06e220 2024-01-30T08:10:21.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc144e00 con 0x7fd1cc06de40 2024-01-30T08:10:21.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc1ed1c0 con 0x7fd1cc0a7120 2024-01-30T08:10:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc1ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc1ed650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33072/0 (socket says 172.21.15.50:33072) 2024-01-30T08:10:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 -- 172.21.15.50:0/292982834 learned_addr learned my addr 172.21.15.50:0/292982834 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1cb400640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc14a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1caa00640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1cc06de40 0x7fd1cc14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 -- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 msgr2=0x7fd1cc14a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc14a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 -- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1cc06de40 msgr2=0x7fd1cc14b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1cc06de40 0x7fd1cc14b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 -- 172.21.15.50:0/292982834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4009b30 con 0x7fd1cc06e220 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1ca000640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc1ed650 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d5f0 tx=0x7fd1b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1c2a00640 1 -- 172.21.15.50:0/292982834 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40125f0 con 0x7fd1cc06e220 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1c2a00640 1 -- 172.21.15.50:0/292982834 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4012750 con 0x7fd1cc06e220 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1c2a00640 1 -- 172.21.15.50:0/292982834 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4012ae0 con 0x7fd1cc06e220 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc14b7f0 con 0x7fd1cc06e220 2024-01-30T08:10:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc1f0ec0 con 0x7fd1cc06e220 2024-01-30T08:10:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.664+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc1ed350 con 0x7fd1cc06e220 2024-01-30T08:10:21.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.668+0000 7fd1c2a00640 1 -- 172.21.15.50:0/292982834 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd1b4012c40 con 0x7fd1cc06e220 2024-01-30T08:10:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.668+0000 7fd1c2a00640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd1a4066500 0x7fd1a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.668+0000 7fd1c2a00640 1 -- 172.21.15.50:0/292982834 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd1b4084660 con 0x7fd1cc06e220 2024-01-30T08:10:21.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.668+0000 7fd1caa00640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd1a4066500 0x7fd1a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:21.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.668+0000 7fd1caa00640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd1a4066500 0x7fd1a40689c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc007fd0 tx=0x7fd1bc007ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:21.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.672+0000 7fd1c2a00640 1 -- 172.21.15.50:0/292982834 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd1b40515a0 con 0x7fd1cc06e220 2024-01-30T08:10:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.832+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1cc074a20 con 0x7fd1cc06e220 2024-01-30T08:10:21.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.832+0000 7fd1c2a00640 1 -- 172.21.15.50:0/292982834 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20491 (secure 0 0 0) 0x7fd1b4054bc0 con 0x7fd1cc06e220 2024-01-30T08:10:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:21.836 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:12.907159+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:21.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd1a4066500 msgr2=0x7fd1a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd1a4066500 0x7fd1a40689c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc007fd0 tx=0x7fd1bc007ba0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 msgr2=0x7fd1cc1ed650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:21.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc1ed650 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d5f0 tx=0x7fd1b400dab0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 shutdown_connections 2024-01-30T08:10:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd1a4066500 0x7fd1a40689c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1cc0a7120 0x7fd1cc14a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1cc06e220 0x7fd1cc1ed650 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 --2- 172.21.15.50:0/292982834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1cc06de40 0x7fd1cc14b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 >> 172.21.15.50:0/292982834 conn(0x7fd1cc0c4830 msgr2=0x7fd1cc0c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 shutdown_connections 2024-01-30T08:10:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:21.836+0000 7fd1d1800640 1 -- 172.21.15.50:0/292982834 wait complete. 2024-01-30T08:10:21.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:09:51.121360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:09:52.315187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-30T08:10:09.022581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-30T08:10:10.287235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:10:21.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:10:22.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.000+0000 7f1dad200640 1 Processor -- start 2024-01-30T08:10:22.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.000+0000 7f1dad200640 1 -- start start 2024-01-30T08:10:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1dad200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da8156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1dad200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1da80c7ae0 0x7f1da81566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1dad200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80c8a50 con 0x7f1da80c5c90 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1dad200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da80c7070 con 0x7f1da80c7ae0 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1dad200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80c8d30 con 0x7f1da80c50d0 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1da80c7ae0 0x7f1da81566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1da80c7ae0 0x7f1da81566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33084/0 (socket says 172.21.15.50:33084) 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 -- 172.21.15.50:0/3297092348 learned_addr learned my addr 172.21.15.50:0/3297092348 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da6800640 1 --1- 172.21.15.50:0/3297092348 >> v1:172.21.15.50:6789/0 conn(0x7f1da80c5c90 0x7f1da80c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49144/0 (socket says 172.21.15.50:49144) 2024-01-30T08:10:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5e00640 1 --2- 172.21.15.50:0/3297092348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da8156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 -- 172.21.15.50:0/3297092348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 msgr2=0x7f1da8156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 --2- 172.21.15.50:0/3297092348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da8156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 -- 172.21.15.50:0/3297092348 >> v1:172.21.15.50:6789/0 conn(0x7f1da80c5c90 legacy=0x7f1da80c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 -- 172.21.15.50:0/3297092348 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80c66d0 con 0x7f1da80c7ae0 2024-01-30T08:10:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da4a00640 1 -- 172.21.15.50:0/3297092348 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416080556 0 0) 0x7f1da80c8a50 con 0x7f1da80c5c90 2024-01-30T08:10:22.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da5400640 1 --2- 172.21.15.50:0/3297092348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c7ae0 0x7f1da81566d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009870 tx=0x7f1d9001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc4e45cf1c6ef3a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da4a00640 1 -- 172.21.15.50:0/3297092348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900ab680 con 0x7f1da80c7ae0 2024-01-30T08:10:22.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.004+0000 7f1da4a00640 1 -- 172.21.15.50:0/3297092348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900ab7e0 con 0x7f1da80c7ae0 2024-01-30T08:10:22.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1da4a00640 1 -- 172.21.15.50:0/3297092348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900abb70 con 0x7f1da80c7ae0 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- 172.21.15.50:0/3297092348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c7ae0 msgr2=0x7f1da81566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 --2- 172.21.15.50:0/3297092348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c7ae0 0x7f1da81566d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009870 tx=0x7f1d9001c480 comp rx=0 tx=0).stop 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- 172.21.15.50:0/3297092348 shutdown_connections 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 --2- 172.21.15.50:0/3297092348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c7ae0 0x7f1da81566d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 --2- 172.21.15.50:0/3297092348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da8156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- 172.21.15.50:0/3297092348 >> 172.21.15.50:0/3297092348 conn(0x7f1da80727c0 msgr2=0x7f1da806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- 172.21.15.50:0/3297092348 shutdown_connections 2024-01-30T08:10:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- 172.21.15.50:0/3297092348 wait complete. 2024-01-30T08:10:22.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 Processor -- start 2024-01-30T08:10:22.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- start start 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da81f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c5c90 0x7f1da8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da80c7ae0 0x7f1da814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80a93c0 con 0x7f1da80c5c90 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80a7e40 con 0x7f1da80c7ae0 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1dad200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80a8650 con 0x7f1da80c50d0 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1da5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c5c90 0x7f1da8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1da5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c5c90 0x7f1da8151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33098/0 (socket says 172.21.15.50:33098) 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.008+0000 7f1da5400640 1 -- 172.21.15.50:0/3399979410 learned_addr learned my addr 172.21.15.50:0/3399979410 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da5e00640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da81f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da6800640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da80c7ae0 0x7f1da814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da5400640 1 -- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 msgr2=0x7f1da81f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da5400640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da81f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da5400640 1 -- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da80c7ae0 msgr2=0x7f1da814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da5400640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da80c7ae0 0x7f1da814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da5400640 1 -- 172.21.15.50:0/3399979410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900094d0 con 0x7f1da80c5c90 2024-01-30T08:10:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da6800640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da80c7ae0 0x7f1da814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1da5400640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c5c90 0x7f1da8151ee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ad040 tx=0x7f1d9001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1d9e000640 1 -- 172.21.15.50:0/3399979410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900b4800 con 0x7f1da80c5c90 2024-01-30T08:10:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1d9e000640 1 -- 172.21.15.50:0/3399979410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900b4960 con 0x7f1da80c5c90 2024-01-30T08:10:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da80accd0 con 0x7f1da80c5c90 2024-01-30T08:10:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1d9e000640 1 -- 172.21.15.50:0/3399979410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900b4d10 con 0x7f1da80c5c90 2024-01-30T08:10:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da80a8370 con 0x7f1da80c5c90 2024-01-30T08:10:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da80a9570 con 0x7f1da80c5c90 2024-01-30T08:10:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.012+0000 7f1d9e000640 1 -- 172.21.15.50:0/3399979410 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1d900be3f0 con 0x7f1da80c5c90 2024-01-30T08:10:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.016+0000 7f1d9e000640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1d80066500 0x7f1d800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.016+0000 7f1d9e000640 1 -- 172.21.15.50:0/3399979410 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1d9011f250 con 0x7f1da80c5c90 2024-01-30T08:10:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.016+0000 7f1da5e00640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1d80066500 0x7f1d800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.016+0000 7f1da5e00640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1d80066500 0x7f1d800689c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009b60 tx=0x7f1d98009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.020+0000 7f1d9e000640 1 -- 172.21.15.50:0/3399979410 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1d900ec0f0 con 0x7f1da80c5c90 2024-01-30T08:10:22.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1da8074a20 con 0x7f1da80c5c90 2024-01-30T08:10:22.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1d9e000640 1 -- 172.21.15.50:0/3399979410 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d900ef710 con 0x7f1da80c5c90 2024-01-30T08:10:22.182 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:10:22.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1d80066500 msgr2=0x7f1d800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1d80066500 0x7f1d800689c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009b60 tx=0x7f1d98009190 comp rx=0 tx=0).stop 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c5c90 msgr2=0x7f1da8151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c5c90 0x7f1da8151ee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ad040 tx=0x7f1d9001acc0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 shutdown_connections 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da80c7ae0 0x7f1da814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1d80066500 0x7f1d800689c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da80c5c90 0x7f1da8151ee0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 --2- 172.21.15.50:0/3399979410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1da80c50d0 0x7f1da81f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 >> 172.21.15.50:0/3399979410 conn(0x7f1da80727c0 msgr2=0x7f1da80c3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 shutdown_connections 2024-01-30T08:10:22.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.180+0000 7f1dad200640 1 -- 172.21.15.50:0/3399979410 wait complete. 2024-01-30T08:10:22.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:10:22.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.348+0000 7f60fa200640 1 Processor -- start 2024-01-30T08:10:22.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.348+0000 7f60fa200640 1 -- start start 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60fa200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f4155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60fa200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60f406d370 0x7f60f4151be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60fa200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f406d900 con 0x7f60f4152120 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60fa200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f4072e30 con 0x7f60f406d370 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60fa200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f406dbe0 con 0x7f60f40bf0c0 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60f406d370 0x7f60f4151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60f406d370 0x7f60f4151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33112/0 (socket says 172.21.15.50:33112) 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f3e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f60f4152120 0x7f60f40c3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49156/0 (socket says 172.21.15.50:49156) 2024-01-30T08:10:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 -- 172.21.15.50:0/1020107796 learned_addr learned my addr 172.21.15.50:0/1020107796 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f3400640 1 --2- 172.21.15.50:0/1020107796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 -- 172.21.15.50:0/1020107796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 msgr2=0x7f60f4155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 --2- 172.21.15.50:0/1020107796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f4155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 -- 172.21.15.50:0/1020107796 >> v1:172.21.15.50:6789/0 conn(0x7f60f4152120 legacy=0x7f60f40c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 -- 172.21.15.50:0/1020107796 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f406dec0 con 0x7f60f406d370 2024-01-30T08:10:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2000640 1 -- 172.21.15.50:0/1020107796 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949482927 0 0) 0x7f60f406d900 con 0x7f60f4152120 2024-01-30T08:10:22.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.352+0000 7f60f2a00640 1 --2- 172.21.15.50:0/1020107796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f4151be0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009870 tx=0x7f60dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8befc25a2489cb server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60f2000640 1 -- 172.21.15.50:0/1020107796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0ab680 con 0x7f60f406d370 2024-01-30T08:10:22.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60f2000640 1 -- 172.21.15.50:0/1020107796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc0ab7e0 con 0x7f60f406d370 2024-01-30T08:10:22.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60f2000640 1 -- 172.21.15.50:0/1020107796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0abb70 con 0x7f60f406d370 2024-01-30T08:10:22.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- 172.21.15.50:0/1020107796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 msgr2=0x7f60f4151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 --2- 172.21.15.50:0/1020107796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f4151be0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009870 tx=0x7f60dc01c480 comp rx=0 tx=0).stop 2024-01-30T08:10:22.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- 172.21.15.50:0/1020107796 shutdown_connections 2024-01-30T08:10:22.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 --2- 172.21.15.50:0/1020107796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f4151be0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 --2- 172.21.15.50:0/1020107796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f4155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- 172.21.15.50:0/1020107796 >> 172.21.15.50:0/1020107796 conn(0x7f60f40c5b30 msgr2=0x7f60f40c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:22.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- 172.21.15.50:0/1020107796 shutdown_connections 2024-01-30T08:10:22.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- 172.21.15.50:0/1020107796 wait complete. 2024-01-30T08:10:22.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 Processor -- start 2024-01-30T08:10:22.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- start start 2024-01-30T08:10:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f41ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60f4152120 0x7f60f41f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f41f05e0 con 0x7f60f406d370 2024-01-30T08:10:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4070300 con 0x7f60f4152120 2024-01-30T08:10:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.356+0000 7f60fa200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f41edb00 con 0x7f60f40bf0c0 2024-01-30T08:10:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f40a59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33114/0 (socket says 172.21.15.50:33114) 2024-01-30T08:10:22.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 -- 172.21.15.50:0/101739274 learned_addr learned my addr 172.21.15.50:0/101739274 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f2a00640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f41ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3e00640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60f4152120 0x7f60f41f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 -- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 msgr2=0x7f60f41ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f41ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 -- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60f4152120 msgr2=0x7f60f41f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60f4152120 0x7f60f41f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 -- 172.21.15.50:0/101739274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0094d0 con 0x7f60f406d370 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f2a00640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f41ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3e00640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60f4152120 0x7f60f41f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60f3400640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f40a59c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f60e400d830 tx=0x7f60e400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60eb400640 1 -- 172.21.15.50:0/101739274 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400b6c0 con 0x7f60f406d370 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60eb400640 1 -- 172.21.15.50:0/101739274 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e400b820 con 0x7f60f406d370 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f40a75c0 con 0x7f60f406d370 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60eb400640 1 -- 172.21.15.50:0/101739274 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400bb90 con 0x7f60f406d370 2024-01-30T08:10:22.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f40a72e0 con 0x7f60f406d370 2024-01-30T08:10:22.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f41f0850 con 0x7f60f406d370 2024-01-30T08:10:22.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.360+0000 7f60eb400640 1 -- 172.21.15.50:0/101739274 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f60e401e460 con 0x7f60f406d370 2024-01-30T08:10:22.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.364+0000 7f60eb400640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f60cc066530 0x7f60cc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.364+0000 7f60eb400640 1 -- 172.21.15.50:0/101739274 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f60e4084ae0 con 0x7f60f406d370 2024-01-30T08:10:22.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.364+0000 7f60f2a00640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f60cc066530 0x7f60cc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.364+0000 7f60f2a00640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f60cc066530 0x7f60cc0689f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0af000 tx=0x7f60dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.368+0000 7f60eb400640 1 -- 172.21.15.50:0/101739274 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f60e40518d0 con 0x7f60f406d370 2024-01-30T08:10:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.524+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60f4074a20 con 0x7f60f406d370 2024-01-30T08:10:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60eb400640 1 -- 172.21.15.50:0/101739274 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60e4054ef0 con 0x7f60f406d370 2024-01-30T08:10:22.529 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f60cc066530 msgr2=0x7f60cc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f60cc066530 0x7f60cc0689f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0af000 tx=0x7f60dc008040 comp rx=0 tx=0).stop 2024-01-30T08:10:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 msgr2=0x7f60f40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f40a59c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f60e400d830 tx=0x7f60e400dcf0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 shutdown_connections 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60f4152120 0x7f60f41f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f60cc066530 0x7f60cc0689f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60f40bf0c0 0x7f60f41ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 --2- 172.21.15.50:0/101739274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60f406d370 0x7f60f40a59c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 >> 172.21.15.50:0/101739274 conn(0x7f60f40c5b30 msgr2=0x7f60f4152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 shutdown_connections 2024-01-30T08:10:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.528+0000 7f60fa200640 1 -- 172.21.15.50:0/101739274 wait complete. 2024-01-30T08:10:22.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:10:22.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd92bc00640 1 Processor -- start 2024-01-30T08:10:22.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd92bc00640 1 -- start start 2024-01-30T08:10:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd92bc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924071e10 0x7fd9240727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd92bc00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd924154290 0x7fd924154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd92bc00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9240c22b0 con 0x7fd92406c960 2024-01-30T08:10:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd92bc00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9240c5890 con 0x7fd924154290 2024-01-30T08:10:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd92bc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240c52d0 con 0x7fd924071e10 2024-01-30T08:10:22.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd929200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924071e10 0x7fd9240727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd929c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd924154290 0x7fd924154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd929200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924071e10 0x7fd9240727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:37282/0 (socket says 172.21.15.50:37282) 2024-01-30T08:10:22.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd929200640 1 -- 172.21.15.50:0/1951660915 learned_addr learned my addr 172.21.15.50:0/1951660915 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:22.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.692+0000 7fd923e00640 1 --1- 172.21.15.50:0/1951660915 >> v1:172.21.15.125:6789/0 conn(0x7fd92406c960 0x7fd9240c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:48754/0 (socket says 172.21.15.50:48754) 2024-01-30T08:10:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd929200640 1 -- 172.21.15.50:0/1951660915 >> v2:172.21.15.125:3300/0 conn(0x7fd924154290 msgr2=0x7fd924154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd929200640 1 --2- 172.21.15.50:0/1951660915 >> v2:172.21.15.125:3300/0 conn(0x7fd924154290 0x7fd924154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd929200640 1 -- 172.21.15.50:0/1951660915 >> v1:172.21.15.125:6789/0 conn(0x7fd92406c960 legacy=0x7fd9240c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd929200640 1 -- 172.21.15.50:0/1951660915 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240c55b0 con 0x7fd924071e10 2024-01-30T08:10:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd923400640 1 -- 172.21.15.50:0/1951660915 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352329483 0 0) 0x7fd9240c22b0 con 0x7fd92406c960 2024-01-30T08:10:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd929200640 1 --2- 172.21.15.50:0/1951660915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924071e10 0x7fd9240727b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd914009870 tx=0x7fd91401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad31194bb025b12a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd923400640 1 -- 172.21.15.50:0/1951660915 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9140ab600 con 0x7fd924071e10 2024-01-30T08:10:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd923400640 1 -- 172.21.15.50:0/1951660915 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9140a7050 con 0x7fd924071e10 2024-01-30T08:10:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.696+0000 7fd923400640 1 -- 172.21.15.50:0/1951660915 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9140ab980 con 0x7fd924071e10 2024-01-30T08:10:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- 172.21.15.50:0/1951660915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924071e10 msgr2=0x7fd9240727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 --2- 172.21.15.50:0/1951660915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924071e10 0x7fd9240727b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd914009870 tx=0x7fd91401c420 comp rx=0 tx=0).stop 2024-01-30T08:10:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- 172.21.15.50:0/1951660915 shutdown_connections 2024-01-30T08:10:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 --2- 172.21.15.50:0/1951660915 >> v2:172.21.15.125:3300/0 conn(0x7fd924154290 0x7fd924154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 --2- 172.21.15.50:0/1951660915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924071e10 0x7fd9240727b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- 172.21.15.50:0/1951660915 >> 172.21.15.50:0/1951660915 conn(0x7fd9240c5b30 msgr2=0x7fd9240c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- 172.21.15.50:0/1951660915 shutdown_connections 2024-01-30T08:10:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- 172.21.15.50:0/1951660915 wait complete. 2024-01-30T08:10:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 Processor -- start 2024-01-30T08:10:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- start start 2024-01-30T08:10:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd92406c960 0x7fd9240a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd924071e10 0x7fd9241599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924154290 0x7fd924151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd924149af0 con 0x7fd924071e10 2024-01-30T08:10:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240a8df0 con 0x7fd92406c960 2024-01-30T08:10:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd92bc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd924149470 con 0x7fd924154290 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd924071e10 0x7fd9241599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd924071e10 0x7fd9241599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33120/0 (socket says 172.21.15.50:33120) 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 -- 172.21.15.50:0/2110584976 learned_addr learned my addr 172.21.15.50:0/2110584976 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd929c00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924154290 0x7fd924151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd929200640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd92406c960 0x7fd9240a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 -- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924154290 msgr2=0x7fd924151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924154290 0x7fd924151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 -- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd92406c960 msgr2=0x7fd9240a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd92406c960 0x7fd9240a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.700+0000 7fd923e00640 1 -- 172.21.15.50:0/2110584976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140094d0 con 0x7fd924071e10 2024-01-30T08:10:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd923e00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd924071e10 0x7fd9241599a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0011f0 tx=0x7fd90c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd920c00640 1 -- 172.21.15.50:0/2110584976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0074e0 con 0x7fd924071e10 2024-01-30T08:10:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd920c00640 1 -- 172.21.15.50:0/2110584976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c007640 con 0x7fd924071e10 2024-01-30T08:10:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd920c00640 1 -- 172.21.15.50:0/2110584976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c004a10 con 0x7fd924071e10 2024-01-30T08:10:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9241f0d60 con 0x7fd924071e10 2024-01-30T08:10:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9241f1040 con 0x7fd924071e10 2024-01-30T08:10:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd924074a20 con 0x7fd924071e10 2024-01-30T08:10:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd920c00640 1 -- 172.21.15.50:0/2110584976 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd90c004b70 con 0x7fd924071e10 2024-01-30T08:10:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd920c00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd8fc066500 0x7fd8fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.704+0000 7fd920c00640 1 -- 172.21.15.50:0/2110584976 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd90c0834e0 con 0x7fd924071e10 2024-01-30T08:10:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.708+0000 7fd929200640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd8fc066500 0x7fd8fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.708+0000 7fd929200640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd8fc066500 0x7fd8fc0689c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd9140ad000 tx=0x7fd9140a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:22.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.708+0000 7fd920c00640 1 -- 172.21.15.50:0/2110584976 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd90c050420 con 0x7fd924071e10 2024-01-30T08:10:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd92415b560 con 0x7fd924071e10 2024-01-30T08:10:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd920c00640 1 -- 172.21.15.50:0/2110584976 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd90c018020 con 0x7fd924071e10 2024-01-30T08:10:22.871 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd8fc066500 msgr2=0x7fd8fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd8fc066500 0x7fd8fc0689c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd9140ad000 tx=0x7fd9140a6000 comp rx=0 tx=0).stop 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd924071e10 msgr2=0x7fd9241599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd924071e10 0x7fd9241599a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0011f0 tx=0x7fd90c00c9b0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 shutdown_connections 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd8fc066500 0x7fd8fc0689c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd924154290 0x7fd924151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd924071e10 0x7fd9241599a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 --2- 172.21.15.50:0/2110584976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd92406c960 0x7fd9240a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 >> 172.21.15.50:0/2110584976 conn(0x7fd9240c5b30 msgr2=0x7fd9240c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 shutdown_connections 2024-01-30T08:10:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:22.868+0000 7fd92bc00640 1 -- 172.21.15.50:0/2110584976 wait complete. 2024-01-30T08:10:22.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-30T08:10:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83acc00640 1 Processor -- start 2024-01-30T08:10:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83acc00640 1 -- start start 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83acc00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83a806f240 0x7f83a806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83acc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83a80c1200 0x7f83a80c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83acc00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a8158b70 con 0x7f83a8155500 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83acc00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a80c8cf0 con 0x7f83a80c1200 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83acc00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a8157f60 con 0x7f83a806f240 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a6800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83a80c1200 0x7f83a80c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a6800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83a80c1200 0x7f83a80c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33128/0 (socket says 172.21.15.50:33128) 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a6800640 1 -- 172.21.15.50:0/1889523068 learned_addr learned my addr 172.21.15.50:0/1889523068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a5400640 1 --2- 172.21.15.50:0/1889523068 >> v2:172.21.15.125:3300/0 conn(0x7f83a806f240 0x7f83a806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a6800640 1 -- 172.21.15.50:0/1889523068 >> v2:172.21.15.125:3300/0 conn(0x7f83a806f240 msgr2=0x7f83a806f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a6800640 1 --2- 172.21.15.50:0/1889523068 >> v2:172.21.15.125:3300/0 conn(0x7f83a806f240 0x7f83a806f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a6800640 1 -- 172.21.15.50:0/1889523068 >> v1:172.21.15.50:6789/0 conn(0x7f83a8155500 legacy=0x7f83a80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.036+0000 7f83a6800640 1 -- 172.21.15.50:0/1889523068 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8158240 con 0x7f83a80c1200 2024-01-30T08:10:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83a6800640 1 --2- 172.21.15.50:0/1889523068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a80c1200 0x7f83a80c1630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f83a8071f80 tx=0x7f83a001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6f290de627682f server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83a4a00640 1 -- 172.21.15.50:0/1889523068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00a5650 con 0x7f83a80c1200 2024-01-30T08:10:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83a4a00640 1 -- 172.21.15.50:0/1889523068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00a57b0 con 0x7f83a80c1200 2024-01-30T08:10:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83a4a00640 1 -- 172.21.15.50:0/1889523068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00a5b40 con 0x7f83a80c1200 2024-01-30T08:10:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 -- 172.21.15.50:0/1889523068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a80c1200 msgr2=0x7f83a80c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 --2- 172.21.15.50:0/1889523068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a80c1200 0x7f83a80c1630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f83a8071f80 tx=0x7f83a001c880 comp rx=0 tx=0).stop 2024-01-30T08:10:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 -- 172.21.15.50:0/1889523068 shutdown_connections 2024-01-30T08:10:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 --2- 172.21.15.50:0/1889523068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a80c1200 0x7f83a80c1630 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 --2- 172.21.15.50:0/1889523068 >> v2:172.21.15.125:3300/0 conn(0x7f83a806f240 0x7f83a806f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 -- 172.21.15.50:0/1889523068 >> 172.21.15.50:0/1889523068 conn(0x7f83a80727c0 msgr2=0x7f83a806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 -- 172.21.15.50:0/1889523068 shutdown_connections 2024-01-30T08:10:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.040+0000 7f83acc00640 1 -- 172.21.15.50:0/1889523068 wait complete. 2024-01-30T08:10:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 Processor -- start 2024-01-30T08:10:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 -- start start 2024-01-30T08:10:23.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a806f240 0x7f83a80a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83a80c1200 0x7f83a8155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a8155500 0x7f83a81ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81ed1a0 con 0x7f83a8155500 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81ed440 con 0x7f83a806f240 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80a7950 con 0x7f83a80c1200 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a8155500 0x7f83a81ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a8155500 0x7f83a81ed8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33136/0 (socket says 172.21.15.50:33136) 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 -- 172.21.15.50:0/2747553153 learned_addr learned my addr 172.21.15.50:0/2747553153 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a5e00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a806f240 0x7f83a80a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a5400640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83a80c1200 0x7f83a8155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 -- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83a80c1200 msgr2=0x7f83a8155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83a80c1200 0x7f83a8155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 -- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a806f240 msgr2=0x7f83a80a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a806f240 0x7f83a80a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 -- 172.21.15.50:0/2747553153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a0009b30 con 0x7f83a8155500 2024-01-30T08:10:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83a6800640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a8155500 0x7f83a81ed8d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f83a001a4b0 tx=0x7f83a0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f839e000640 1 -- 172.21.15.50:0/2747553153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00b8670 con 0x7f83a8155500 2024-01-30T08:10:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f839e000640 1 -- 172.21.15.50:0/2747553153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00b87f0 con 0x7f83a8155500 2024-01-30T08:10:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f839e000640 1 -- 172.21.15.50:0/2747553153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00b8ba0 con 0x7f83a8155500 2024-01-30T08:10:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a81f1500 con 0x7f83a8155500 2024-01-30T08:10:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.044+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a80a8cd0 con 0x7f83a8155500 2024-01-30T08:10:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.048+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a81ed5f0 con 0x7f83a8155500 2024-01-30T08:10:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.048+0000 7f839e000640 1 -- 172.21.15.50:0/2747553153 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f83a00b8d00 con 0x7f83a8155500 2024-01-30T08:10:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.048+0000 7f839e000640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8380066530 0x7f83800689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.048+0000 7f839e000640 1 -- 172.21.15.50:0/2747553153 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f83a011f5a0 con 0x7f83a8155500 2024-01-30T08:10:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.048+0000 7f83a5e00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8380066530 0x7f83800689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.048+0000 7f83a5e00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8380066530 0x7f83800689f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8398001770 tx=0x7f8398009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.052+0000 7f839e000640 1 -- 172.21.15.50:0/2747553153 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f83a81ed5f0 con 0x7f83a8155500 2024-01-30T08:10:23.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83a81ed5f0 con 0x7f83a8155500 2024-01-30T08:10:23.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f839e000640 1 -- 172.21.15.50:0/2747553153 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7f83a81ed5f0 con 0x7f83a8155500 2024-01-30T08:10:23.219 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:23.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8380066530 msgr2=0x7f83800689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8380066530 0x7f83800689f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8398001770 tx=0x7f8398009040 comp rx=0 tx=0).stop 2024-01-30T08:10:23.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a8155500 msgr2=0x7f83a81ed8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a8155500 0x7f83a81ed8d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f83a001a4b0 tx=0x7f83a0019620 comp rx=0 tx=0).stop 2024-01-30T08:10:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 shutdown_connections 2024-01-30T08:10:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8380066530 0x7f83800689f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83a8155500 0x7f83a81ed8d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83a80c1200 0x7f83a8155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 --2- 172.21.15.50:0/2747553153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a806f240 0x7f83a80a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 >> 172.21.15.50:0/2747553153 conn(0x7f83a80727c0 msgr2=0x7f83a80c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:23.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 shutdown_connections 2024-01-30T08:10:23.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.216+0000 7f83acc00640 1 -- 172.21.15.50:0/2747553153 wait complete. 2024-01-30T08:10:23.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-30T08:10:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.380+0000 7ff9fc000640 1 Processor -- start 2024-01-30T08:10:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.380+0000 7ff9fc000640 1 -- start start 2024-01-30T08:10:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9fc000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9f406bfe0 0x7ff9f40c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9fc000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9f40c3c50 0x7ff9f40c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9fc000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f406c4c0 con 0x7ff9f4072b60 2024-01-30T08:10:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9fc000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40c0550 con 0x7ff9f406bfe0 2024-01-30T08:10:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9fc000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40c07c0 con 0x7ff9f40c3c50 2024-01-30T08:10:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f8c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9f406bfe0 0x7ff9f40c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f9600640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9f4072b60 0x7ff9f40a4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49188/0 (socket says 172.21.15.50:49188) 2024-01-30T08:10:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f9600640 1 -- 172.21.15.50:0/433854730 learned_addr learned my addr 172.21.15.50:0/433854730 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9fa000640 1 --2- 172.21.15.50:0/433854730 >> v2:172.21.15.125:3300/0 conn(0x7ff9f40c3c50 0x7ff9f40c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f8c00640 1 -- 172.21.15.50:0/433854730 >> v2:172.21.15.125:3300/0 conn(0x7ff9f40c3c50 msgr2=0x7ff9f40c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f8c00640 1 --2- 172.21.15.50:0/433854730 >> v2:172.21.15.125:3300/0 conn(0x7ff9f40c3c50 0x7ff9f40c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f8c00640 1 -- 172.21.15.50:0/433854730 >> v1:172.21.15.50:6789/0 conn(0x7ff9f4072b60 legacy=0x7ff9f40a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f8c00640 1 -- 172.21.15.50:0/433854730 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40c0aa0 con 0x7ff9f406bfe0 2024-01-30T08:10:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9f3e00640 1 -- 172.21.15.50:0/433854730 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817521654 0 0) 0x7ff9f406c4c0 con 0x7ff9f4072b60 2024-01-30T08:10:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.384+0000 7ff9fa000640 1 --2- 172.21.15.50:0/433854730 >> v2:172.21.15.125:3300/0 conn(0x7ff9f40c3c50 0x7ff9f40c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9f8c00640 1 --2- 172.21.15.50:0/433854730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f406bfe0 0x7ff9f40c12a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff9f414ef20 tx=0x7ff9dc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff6636a521bb281 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9f3e00640 1 -- 172.21.15.50:0/433854730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0ab600 con 0x7ff9f406bfe0 2024-01-30T08:10:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9f3e00640 1 -- 172.21.15.50:0/433854730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0a7050 con 0x7ff9f406bfe0 2024-01-30T08:10:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9f3e00640 1 -- 172.21.15.50:0/433854730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0ab980 con 0x7ff9f406bfe0 2024-01-30T08:10:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 -- 172.21.15.50:0/433854730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f406bfe0 msgr2=0x7ff9f40c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 --2- 172.21.15.50:0/433854730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f406bfe0 0x7ff9f40c12a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff9f414ef20 tx=0x7ff9dc01c3a0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 -- 172.21.15.50:0/433854730 shutdown_connections 2024-01-30T08:10:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 --2- 172.21.15.50:0/433854730 >> v2:172.21.15.125:3300/0 conn(0x7ff9f40c3c50 0x7ff9f40c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 --2- 172.21.15.50:0/433854730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f406bfe0 0x7ff9f40c12a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 -- 172.21.15.50:0/433854730 >> 172.21.15.50:0/433854730 conn(0x7ff9f40c5b30 msgr2=0x7ff9f40c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:23.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 -- 172.21.15.50:0/433854730 shutdown_connections 2024-01-30T08:10:23.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 -- 172.21.15.50:0/433854730 wait complete. 2024-01-30T08:10:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 Processor -- start 2024-01-30T08:10:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.388+0000 7ff9fc000640 1 -- start start 2024-01-30T08:10:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f406bfe0 0x7ff9f40bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f4072b60 0x7ff9f4144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f40c3c50 0x7ff9f41452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40a8ea0 con 0x7ff9f4072b60 2024-01-30T08:10:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f414af00 con 0x7ff9f40c3c50 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40a98b0 con 0x7ff9f406bfe0 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f4072b60 0x7ff9f4144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f4072b60 0x7ff9f4144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33158/0 (socket says 172.21.15.50:33158) 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 -- 172.21.15.50:0/3250983624 learned_addr learned my addr 172.21.15.50:0/3250983624 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f9600640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f406bfe0 0x7ff9f40bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fa000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f40c3c50 0x7ff9f41452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 -- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f406bfe0 msgr2=0x7ff9f40bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f406bfe0 0x7ff9f40bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 -- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f40c3c50 msgr2=0x7ff9f41452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f40c3c50 0x7ff9f41452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 -- 172.21.15.50:0/3250983624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc009420 con 0x7ff9f4072b60 2024-01-30T08:10:23.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f9600640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f406bfe0 0x7ff9f40bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fa000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f40c3c50 0x7ff9f41452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f8c00640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f4072b60 0x7ff9f4144da0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc018fb0 tx=0x7ff9dc01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f1600640 1 -- 172.21.15.50:0/3250983624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0b7650 con 0x7ff9f4072b60 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f1600640 1 -- 172.21.15.50:0/3250983624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0b77b0 con 0x7ff9f4072b60 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9f1600640 1 -- 172.21.15.50:0/3250983624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0b7b40 con 0x7ff9f4072b60 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f414b150 con 0x7ff9f4072b60 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f40a90b0 con 0x7ff9f4072b60 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.392+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f414b600 con 0x7ff9f4072b60 2024-01-30T08:10:23.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.396+0000 7ff9f1600640 1 -- 172.21.15.50:0/3250983624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff9dc0b7ca0 con 0x7ff9f4072b60 2024-01-30T08:10:23.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.396+0000 7ff9f1600640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff9cc066580 0x7ff9cc068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.396+0000 7ff9f1600640 1 -- 172.21.15.50:0/3250983624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff9dc11ecd0 con 0x7ff9f4072b60 2024-01-30T08:10:23.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.396+0000 7ff9f9600640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff9cc066580 0x7ff9cc068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.396+0000 7ff9f9600640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff9cc066580 0x7ff9cc068a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007fd0 tx=0x7ff9e4007c80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.400+0000 7ff9f1600640 1 -- 172.21.15.50:0/3250983624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff9dc0ebc40 con 0x7ff9f4072b60 2024-01-30T08:10:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.560+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff9f4074a20 con 0x7ff9f4072b60 2024-01-30T08:10:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9f1600640 1 -- 172.21.15.50:0/3250983624 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff9dc0ef260 con 0x7ff9f4072b60 2024-01-30T08:10:23.565 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff9cc066580 msgr2=0x7ff9cc068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff9cc066580 0x7ff9cc068a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007fd0 tx=0x7ff9e4007c80 comp rx=0 tx=0).stop 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f4072b60 msgr2=0x7ff9f4144da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f4072b60 0x7ff9f4144da0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc018fb0 tx=0x7ff9dc01abe0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 shutdown_connections 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9f40c3c50 0x7ff9f41452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff9cc066580 0x7ff9cc068a40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9f4072b60 0x7ff9f4144da0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 --2- 172.21.15.50:0/3250983624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9f406bfe0 0x7ff9f40bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 >> 172.21.15.50:0/3250983624 conn(0x7ff9f40c5b30 msgr2=0x7ff9f40c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 shutdown_connections 2024-01-30T08:10:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.564+0000 7ff9fc000640 1 -- 172.21.15.50:0/3250983624 wait complete. 2024-01-30T08:10:23.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-30T08:10:23.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.728+0000 7f9e14c00640 1 Processor -- start 2024-01-30T08:10:23.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.728+0000 7f9e14c00640 1 -- start start 2024-01-30T08:10:23.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.728+0000 7f9e14c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10151d90 0x7f9e100c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.728+0000 7f9e14c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e10152170 0x7f9e100c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.728+0000 7f9e14c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e100c2f20 con 0x7f9e10158640 2024-01-30T08:10:23.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.728+0000 7f9e14c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e100c34e0 con 0x7f9e10152170 2024-01-30T08:10:23.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.728+0000 7f9e14c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e100c3200 con 0x7f9e10151d90 2024-01-30T08:10:23.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0e800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9e10158640 0x7f9e10154730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49202/0 (socket says 172.21.15.50:49202) 2024-01-30T08:10:23.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0e800640 1 -- 172.21.15.50:0/2492893471 learned_addr learned my addr 172.21.15.50:0/2492893471 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:23.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0de00640 1 --2- 172.21.15.50:0/2492893471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10151d90 0x7f9e100c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0d400640 1 --2- 172.21.15.50:0/2492893471 >> v2:172.21.15.125:3300/0 conn(0x7f9e10152170 0x7f9e100c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0ca00640 1 -- 172.21.15.50:0/2492893471 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260893168 0 0) 0x7f9e100c2f20 con 0x7f9e10158640 2024-01-30T08:10:23.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0ca00640 1 -- 172.21.15.50:0/2492893471 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df0003530 con 0x7f9e10158640 2024-01-30T08:10:23.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0de00640 1 -- 172.21.15.50:0/2492893471 >> v2:172.21.15.125:3300/0 conn(0x7f9e10152170 msgr2=0x7f9e100c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:23.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0de00640 1 --2- 172.21.15.50:0/2492893471 >> v2:172.21.15.125:3300/0 conn(0x7f9e10152170 0x7f9e100c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0de00640 1 -- 172.21.15.50:0/2492893471 >> v1:172.21.15.50:6789/0 conn(0x7f9e10158640 legacy=0x7f9e10154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0de00640 1 -- 172.21.15.50:0/2492893471 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10157e40 con 0x7f9e10151d90 2024-01-30T08:10:23.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0d400640 1 --2- 172.21.15.50:0/2492893471 >> v2:172.21.15.125:3300/0 conn(0x7f9e10152170 0x7f9e100c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.732+0000 7f9e0de00640 1 --2- 172.21.15.50:0/2492893471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10151d90 0x7f9e100c5d20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e000097c0 tx=0x7f9e0001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=374ec02a491a07d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e0ca00640 1 -- 172.21.15.50:0/2492893471 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000ab600 con 0x7f9e10151d90 2024-01-30T08:10:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e0ca00640 1 -- 172.21.15.50:0/2492893471 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000a7050 con 0x7f9e10151d90 2024-01-30T08:10:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e0ca00640 1 -- 172.21.15.50:0/2492893471 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000ab980 con 0x7f9e10151d90 2024-01-30T08:10:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- 172.21.15.50:0/2492893471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10151d90 msgr2=0x7f9e100c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 --2- 172.21.15.50:0/2492893471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10151d90 0x7f9e100c5d20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e000097c0 tx=0x7f9e0001c360 comp rx=0 tx=0).stop 2024-01-30T08:10:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- 172.21.15.50:0/2492893471 shutdown_connections 2024-01-30T08:10:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 --2- 172.21.15.50:0/2492893471 >> v2:172.21.15.125:3300/0 conn(0x7f9e10152170 0x7f9e100c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 --2- 172.21.15.50:0/2492893471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10151d90 0x7f9e100c5d20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- 172.21.15.50:0/2492893471 >> 172.21.15.50:0/2492893471 conn(0x7f9e1006ad40 msgr2=0x7f9e100c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- 172.21.15.50:0/2492893471 shutdown_connections 2024-01-30T08:10:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- 172.21.15.50:0/2492893471 wait complete. 2024-01-30T08:10:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 Processor -- start 2024-01-30T08:10:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- start start 2024-01-30T08:10:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e10151d90 0x7f9e1006f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10152170 0x7f9e10144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e10158640 0x7f9e10145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10152910 con 0x7f9e10158640 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10154b30 con 0x7f9e10151d90 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e14c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10145740 con 0x7f9e10152170 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.736+0000 7f9e0e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e10158640 0x7f9e10145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0de00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e10151d90 0x7f9e1006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e10158640 0x7f9e10145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33160/0 (socket says 172.21.15.50:33160) 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0e800640 1 -- 172.21.15.50:0/1662958115 learned_addr learned my addr 172.21.15.50:0/1662958115 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0d400640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10152170 0x7f9e10144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0de00640 1 -- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10152170 msgr2=0x7f9e10144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0de00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10152170 0x7f9e10144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0de00640 1 -- 172.21.15.50:0/1662958115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e10158640 msgr2=0x7f9e10145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0de00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e10158640 0x7f9e10145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0de00640 1 -- 172.21.15.50:0/1662958115 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8009420 con 0x7f9e10151d90 2024-01-30T08:10:23.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0e800640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e10158640 0x7f9e10145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:23.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e0de00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e10151d90 0x7f9e1006f180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e000ab000 tx=0x7f9e0001aba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e06000640 1 -- 172.21.15.50:0/1662958115 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000b7450 con 0x7f9e10151d90 2024-01-30T08:10:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e06000640 1 -- 172.21.15.50:0/1662958115 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000b75b0 con 0x7f9e10151d90 2024-01-30T08:10:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e00009420 con 0x7f9e10151d90 2024-01-30T08:10:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e06000640 1 -- 172.21.15.50:0/1662958115 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000b7960 con 0x7f9e10151d90 2024-01-30T08:10:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e10150ac0 con 0x7f9e10151d90 2024-01-30T08:10:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1004ead0 con 0x7f9e10151d90 2024-01-30T08:10:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.740+0000 7f9e06000640 1 -- 172.21.15.50:0/1662958115 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9e000b7ac0 con 0x7f9e10151d90 2024-01-30T08:10:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.744+0000 7f9e06000640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9de8066500 0x7f9de80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.744+0000 7f9e06000640 1 -- 172.21.15.50:0/1662958115 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9e0011f390 con 0x7f9e10151d90 2024-01-30T08:10:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.744+0000 7f9e0d400640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9de8066500 0x7f9de80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.744+0000 7f9e0d400640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9de8066500 0x7f9de80689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e10070050 tx=0x7f9df8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:23.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.748+0000 7f9e06000640 1 -- 172.21.15.50:0/1662958115 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9e000ec2b0 con 0x7f9e10151d90 2024-01-30T08:10:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.916+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9e1006f6c0 con 0x7f9e10151d90 2024-01-30T08:10:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e06000640 1 -- 172.21.15.50:0/1662958115 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9e000ef8d0 con 0x7f9e10151d90 2024-01-30T08:10:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9de8066500 msgr2=0x7f9de80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9de8066500 0x7f9de80689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e10070050 tx=0x7f9df8009190 comp rx=0 tx=0).stop 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e10151d90 msgr2=0x7f9e1006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e10151d90 0x7f9e1006f180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e000ab000 tx=0x7f9e0001aba0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 shutdown_connections 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9de8066500 0x7f9de80689c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e10158640 0x7f9e10145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e10152170 0x7f9e10144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 --2- 172.21.15.50:0/1662958115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e10151d90 0x7f9e1006f180 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:23.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 >> 172.21.15.50:0/1662958115 conn(0x7f9e1006ad40 msgr2=0x7f9e101569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:23.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 shutdown_connections 2024-01-30T08:10:23.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:23.920+0000 7f9e14c00640 1 -- 172.21.15.50:0/1662958115 wait complete. 2024-01-30T08:10:23.944 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-30T08:10:23.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:23.944 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:23.973 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:10:23.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:23.974 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-30T08:10:24.028 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:24.028 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:24.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354580k,nr_inodes=4088645,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275360k,nr_inodes=818840,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-30T08:10:24.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-30T08:10:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feae0c00640 1 Processor -- start 2024-01-30T08:10:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feae0c00640 1 -- start start 2024-01-30T08:10:24.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feae0c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feadc06de40 0x7feadc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feae0c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feadc153390 0x7feadc0a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feae0c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc152f00 con 0x7feadc0c4310 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feae0c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc1525f0 con 0x7feadc153390 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feae0c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc0a7680 con 0x7feadc06de40 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead9400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feadc153390 0x7feadc0a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feada800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feadc0c4310 0x7feadc155be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49216/0 (socket says 172.21.15.50:49216) 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead9400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feadc153390 0x7feadc0a6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33164/0 (socket says 172.21.15.50:33164) 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7feada800640 1 -- 172.21.15.50:0/433536567 learned_addr learned my addr 172.21.15.50:0/433536567 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead9e00640 1 --2- 172.21.15.50:0/433536567 >> v2:172.21.15.125:3300/0 conn(0x7feadc06de40 0x7feadc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead9400640 1 -- 172.21.15.50:0/433536567 >> v2:172.21.15.125:3300/0 conn(0x7feadc06de40 msgr2=0x7feadc06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead9400640 1 --2- 172.21.15.50:0/433536567 >> v2:172.21.15.125:3300/0 conn(0x7feadc06de40 0x7feadc06e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead9400640 1 -- 172.21.15.50:0/433536567 >> v1:172.21.15.50:6789/0 conn(0x7feadc0c4310 legacy=0x7feadc155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead9400640 1 -- 172.21.15.50:0/433536567 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc1528b0 con 0x7feadc153390 2024-01-30T08:10:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.220+0000 7fead8a00640 1 -- 172.21.15.50:0/433536567 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411514942 0 0) 0x7feadc152f00 con 0x7feadc0c4310 2024-01-30T08:10:24.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7fead9400640 1 --2- 172.21.15.50:0/433536567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc153390 0x7feadc0a6de0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7feadc073f80 tx=0x7feac401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928fd2bbf66b8039 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:24.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7fead8a00640 1 -- 172.21.15.50:0/433536567 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40ab600 con 0x7feadc153390 2024-01-30T08:10:24.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7fead8a00640 1 -- 172.21.15.50:0/433536567 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac40a7050 con 0x7feadc153390 2024-01-30T08:10:24.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7fead8a00640 1 -- 172.21.15.50:0/433536567 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40ab980 con 0x7feadc153390 2024-01-30T08:10:24.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 -- 172.21.15.50:0/433536567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc153390 msgr2=0x7feadc0a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:24.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 --2- 172.21.15.50:0/433536567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc153390 0x7feadc0a6de0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7feadc073f80 tx=0x7feac401c310 comp rx=0 tx=0).stop 2024-01-30T08:10:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 -- 172.21.15.50:0/433536567 shutdown_connections 2024-01-30T08:10:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 --2- 172.21.15.50:0/433536567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc153390 0x7feadc0a6de0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 --2- 172.21.15.50:0/433536567 >> v2:172.21.15.125:3300/0 conn(0x7feadc06de40 0x7feadc06e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 -- 172.21.15.50:0/433536567 >> 172.21.15.50:0/433536567 conn(0x7feadc0c4830 msgr2=0x7feadc0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 -- 172.21.15.50:0/433536567 shutdown_connections 2024-01-30T08:10:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.224+0000 7feae0c00640 1 -- 172.21.15.50:0/433536567 wait complete. 2024-01-30T08:10:24.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 Processor -- start 2024-01-30T08:10:24.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 -- start start 2024-01-30T08:10:24.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feadc06de40 0x7feadc1ecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:24.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc0c4310 0x7feadc0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:24.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feadc153390 0x7feadc0aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:24.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc152410 con 0x7feadc0c4310 2024-01-30T08:10:24.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc155d30 con 0x7feadc153390 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc156010 con 0x7feadc06de40 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc0c4310 0x7feadc0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc0c4310 0x7feadc0ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33176/0 (socket says 172.21.15.50:33176) 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 -- 172.21.15.50:0/1745666049 learned_addr learned my addr 172.21.15.50:0/1745666049 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9e00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feadc06de40 0x7feadc1ecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feada800640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feadc153390 0x7feadc0aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 -- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feadc06de40 msgr2=0x7feadc1ecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feadc06de40 0x7feadc1ecbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 -- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feadc153390 msgr2=0x7feadc0aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feadc153390 0x7feadc0aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 -- 172.21.15.50:0/1745666049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4009420 con 0x7feadc0c4310 2024-01-30T08:10:24.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead9400640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc0c4310 0x7feadc0ad150 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7feac40ae040 tx=0x7feac40190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:24.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead2000640 1 -- 172.21.15.50:0/1745666049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40b4410 con 0x7feadc0c4310 2024-01-30T08:10:24.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead2000640 1 -- 172.21.15.50:0/1745666049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac40b4570 con 0x7feadc0c4310 2024-01-30T08:10:24.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc0acc30 con 0x7feadc0c4310 2024-01-30T08:10:24.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7fead2000640 1 -- 172.21.15.50:0/1745666049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40b4920 con 0x7feadc0c4310 2024-01-30T08:10:24.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.228+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc0ad690 con 0x7feadc0c4310 2024-01-30T08:10:24.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.232+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc074a20 con 0x7feadc0c4310 2024-01-30T08:10:24.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.232+0000 7fead2000640 1 -- 172.21.15.50:0/1745666049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7feac40b2040 con 0x7feadc0c4310 2024-01-30T08:10:24.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.232+0000 7fead2000640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feab4066530 0x7feab40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:24.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.232+0000 7fead2000640 1 -- 172.21.15.50:0/1745666049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7feac411e810 con 0x7feadc0c4310 2024-01-30T08:10:24.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.232+0000 7fead9e00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feab4066530 0x7feab40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:24.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.232+0000 7fead9e00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feab4066530 0x7feab40689f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feacc009b60 tx=0x7feacc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:24.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.236+0000 7fead2000640 1 -- 172.21.15.50:0/1745666049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7feac40eb830 con 0x7feadc0c4310 2024-01-30T08:10:24.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.432+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feadc06ec60 con 0x7feadc0c4310 2024-01-30T08:10:24.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7fead2000640 1 -- 172.21.15.50:0/1745666049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+149 (secure 0 0 0) 0x7feac40b0070 con 0x7feadc0c4310 2024-01-30T08:10:24.438 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-30T08:10:24.438 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feab4066530 msgr2=0x7feab40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feab4066530 0x7feab40689f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feacc009b60 tx=0x7feacc009190 comp rx=0 tx=0).stop 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc0c4310 msgr2=0x7feadc0ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc0c4310 0x7feadc0ad150 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7feac40ae040 tx=0x7feac40190b0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 shutdown_connections 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feadc153390 0x7feadc0aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feab4066530 0x7feab40689f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feadc0c4310 0x7feadc0ad150 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 --2- 172.21.15.50:0/1745666049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feadc06de40 0x7feadc1ecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 >> 172.21.15.50:0/1745666049 conn(0x7feadc0c4830 msgr2=0x7feadc0bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 shutdown_connections 2024-01-30T08:10:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:24.436+0000 7feae0c00640 1 -- 172.21.15.50:0/1745666049 wait complete. 2024-01-30T08:10:24.459 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-30T08:10:24.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-30T08:10:24.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2024-01-30T08:10:24.459 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-30T08:10:24.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:24.459 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-30T08:10:24.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-30T08:10:24.460 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-30T08:10:24.460 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:10:24.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:24.460 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:24.470 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42392sec preferred_lft 42392sec 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:a8:fd:47:70 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:24.471 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-30T08:10:24.472 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:24.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:24.473 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-30T08:10:24.534 INFO:teuthology.orchestra.run.smithi125.stdout:1 2024-01-30T08:10:24.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:24.537 DEBUG:teuthology.orchestra.run.smithi125:> route 2024-01-30T08:10:24.593 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2024-01-30T08:10:24.593 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-30T08:10:24.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:24.594 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-01-30T08:10:24.594 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-01-30T08:10:24.595 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-30T08:10:24.595 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-30T08:10:24.595 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-30T08:10:24.595 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-01-30T08:10:24.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:24.687 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-01-30T08:10:24.697 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-30T08:10:24.697 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:10:24.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:24.697 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2024-01-30T08:10:24.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:24.759 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:24.811 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-30T08:10:24.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:24.811 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:24.862 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-30T08:10:24.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:24.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-01-30T08:10:24.977 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-01-30T08:10:24.977 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-01-30T08:10:24.978 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:10:24.993 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-01-30T08:10:24.993 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-01-30T08:10:24.993 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:10:24.993 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:24.994 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790" 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790:/ 2024-01-30T08:10:25.003 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=d5419c7a-21ba-491f-86e9-4d6001549d1c" will pass to kernel 2024-01-30T08:10:25.008 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-30T08:10:25.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:25.008 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:25.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-30T08:10:25.089 INFO:teuthology.orchestra.run.smithi125.stdout:client5560 2024-01-30T08:10:25.090 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:25.090 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:25.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2024-01-30T08:10:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b7400640 1 Processor -- start 2024-01-30T08:10:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b7400640 1 -- start start 2024-01-30T08:10:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17b00a70d0 0x7f17b00c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b7400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17b00c4420 0x7f17b00c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b7400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b01535e0 con 0x7f17b006e1f0 2024-01-30T08:10:25.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b7400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b006f2e0 con 0x7f17b00a70d0 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b7400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b0152a60 con 0x7f17b00c4420 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b4a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17b00a70d0 0x7f17b00c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17afe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17b006e1f0 0x7f17b014f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49228/0 (socket says 172.21.15.50:49228) 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17afe00640 1 -- 172.21.15.50:0/4147809628 learned_addr learned my addr 172.21.15.50:0/4147809628 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b5400640 1 --2- 172.21.15.50:0/4147809628 >> v2:172.21.15.125:3300/0 conn(0x7f17b00c4420 0x7f17b00c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b4a00640 1 -- 172.21.15.50:0/4147809628 >> v2:172.21.15.125:3300/0 conn(0x7f17b00c4420 msgr2=0x7f17b00c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b4a00640 1 --2- 172.21.15.50:0/4147809628 >> v2:172.21.15.125:3300/0 conn(0x7f17b00c4420 0x7f17b00c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b4a00640 1 -- 172.21.15.50:0/4147809628 >> v1:172.21.15.50:6789/0 conn(0x7f17b006e1f0 legacy=0x7f17b014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.292+0000 7f17b4a00640 1 -- 172.21.15.50:0/4147809628 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b0152d40 con 0x7f17b00a70d0 2024-01-30T08:10:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b4a00640 1 --2- 172.21.15.50:0/4147809628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00a70d0 0x7f17b00c7660 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f17b006de60 tx=0x7f17a001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320d2a21b45e08d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17af400640 1 -- 172.21.15.50:0/4147809628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00ab600 con 0x7f17b00a70d0 2024-01-30T08:10:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17af400640 1 -- 172.21.15.50:0/4147809628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a00a7050 con 0x7f17b00a70d0 2024-01-30T08:10:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17af400640 1 -- 172.21.15.50:0/4147809628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00ab980 con 0x7f17b00a70d0 2024-01-30T08:10:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 -- 172.21.15.50:0/4147809628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00a70d0 msgr2=0x7f17b00c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 --2- 172.21.15.50:0/4147809628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00a70d0 0x7f17b00c7660 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f17b006de60 tx=0x7f17a001c3d0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 -- 172.21.15.50:0/4147809628 shutdown_connections 2024-01-30T08:10:25.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 --2- 172.21.15.50:0/4147809628 >> v2:172.21.15.125:3300/0 conn(0x7f17b00c4420 0x7f17b00c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 --2- 172.21.15.50:0/4147809628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b00a70d0 0x7f17b00c7660 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 -- 172.21.15.50:0/4147809628 >> 172.21.15.50:0/4147809628 conn(0x7f17b00a9a80 msgr2=0x7f17b00a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:25.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 -- 172.21.15.50:0/4147809628 shutdown_connections 2024-01-30T08:10:25.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 -- 172.21.15.50:0/4147809628 wait complete. 2024-01-30T08:10:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 Processor -- start 2024-01-30T08:10:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.296+0000 7f17b7400640 1 -- start start 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b006e1f0 0x7f17b0143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b00a70d0 0x7f17b014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17b00c4420 0x7f17b0145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0149ba0 con 0x7f17b006e1f0 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00ae0a0 con 0x7f17b00a70d0 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0143080 con 0x7f17b00c4420 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b006e1f0 0x7f17b0143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b5400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17b00c4420 0x7f17b0145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b006e1f0 0x7f17b0143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33184/0 (socket says 172.21.15.50:33184) 2024-01-30T08:10:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 -- 172.21.15.50:0/695265733 learned_addr learned my addr 172.21.15.50:0/695265733 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17afe00640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b00a70d0 0x7f17b014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 -- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17b00c4420 msgr2=0x7f17b0145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17b00c4420 0x7f17b0145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 -- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b00a70d0 msgr2=0x7f17b014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b00a70d0 0x7f17b014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 -- 172.21.15.50:0/695265733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0009420 con 0x7f17b006e1f0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b4a00640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b006e1f0 0x7f17b0143510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f17a00ae040 tx=0x7f17a0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17acc00640 1 -- 172.21.15.50:0/695265733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00b4430 con 0x7f17b006e1f0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17acc00640 1 -- 172.21.15.50:0/695265733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a00b4590 con 0x7f17b006e1f0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17acc00640 1 -- 172.21.15.50:0/695265733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00b4920 con 0x7f17b006e1f0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b01495e0 con 0x7f17b006e1f0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b0142d10 con 0x7f17b006e1f0 2024-01-30T08:10:25.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.300+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b0142b70 con 0x7f17b006e1f0 2024-01-30T08:10:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.304+0000 7f17acc00640 1 -- 172.21.15.50:0/695265733 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f17a00b2040 con 0x7f17b006e1f0 2024-01-30T08:10:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.304+0000 7f17acc00640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1788066550 0x7f1788068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.304+0000 7f17acc00640 1 -- 172.21.15.50:0/695265733 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f17a011e150 con 0x7f17b006e1f0 2024-01-30T08:10:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.304+0000 7f17afe00640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1788066550 0x7f1788068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.304+0000 7f17afe00640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1788066550 0x7f1788068a10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17b0150960 tx=0x7f1798007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.308+0000 7f17acc00640 1 -- 172.21.15.50:0/695265733 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f17b0142b70 con 0x7f17b006e1f0 2024-01-30T08:10:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.504+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f17b0142b70 con 0x7f17b006e1f0 2024-01-30T08:10:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.504+0000 7f17acc00640 1 -- 172.21.15.50:0/695265733 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v15) v1 ==== 134+0+185 (secure 0 0 0) 0x7f17b0142b70 con 0x7f17b006e1f0 2024-01-30T08:10:25.509 INFO:teuthology.orchestra.run.smithi050.stdout:[client.testuser] 2024-01-30T08:10:25.509 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDxrrhlN0JGHhAAggUf1rsu9S865GshHeEHzA== 2024-01-30T08:10:25.509 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow rw fsname=cephfs" 2024-01-30T08:10:25.509 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r fsname=cephfs" 2024-01-30T08:10:25.509 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-30T08:10:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1788066550 msgr2=0x7f1788068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1788066550 0x7f1788068a10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17b0150960 tx=0x7f1798007e90 comp rx=0 tx=0).stop 2024-01-30T08:10:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b006e1f0 msgr2=0x7f17b0143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b006e1f0 0x7f17b0143510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f17a00ae040 tx=0x7f17a0019170 comp rx=0 tx=0).stop 2024-01-30T08:10:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 shutdown_connections 2024-01-30T08:10:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b00a70d0 0x7f17b014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f1788066550 0x7f1788068a10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17b00c4420 0x7f17b0145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 --2- 172.21.15.50:0/695265733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17b006e1f0 0x7f17b0143510 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 >> 172.21.15.50:0/695265733 conn(0x7f17b00a9a80 msgr2=0x7f17b00c25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 shutdown_connections 2024-01-30T08:10:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.508+0000 7f17b7400640 1 -- 172.21.15.50:0/695265733 wait complete. 2024-01-30T08:10:25.530 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-01-30T08:10:25.540 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.zqriYmqfwN 2024-01-30T08:10:25.540 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:25.540 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/tmp/tmp.zqriYmqfwN 2024-01-30T08:10:25.589 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:25.590 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:25.643 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:25.643 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:25.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:25.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ea00640 1 Processor -- start 2024-01-30T08:10:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ea00640 1 -- start start 2024-01-30T08:10:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ea00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fea1806c3d0 0x7fea18071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ea00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180c55c0 con 0x7fea180c1b20 2024-01-30T08:10:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ea00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180c5e60 con 0x7fea1806b4e0 2024-01-30T08:10:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ea00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1806be30 con 0x7fea1806c3d0 2024-01-30T08:10:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ca00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea180c1b20 0x7fea18071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49238/0 (socket says 172.21.15.50:49238) 2024-01-30T08:10:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ca00640 1 -- 172.21.15.50:0/662683397 learned_addr learned my addr 172.21.15.50:0/662683397 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17400640 1 --2- 172.21.15.50:0/662683397 >> v2:172.21.15.125:3300/0 conn(0x7fea1806c3d0 0x7fea18071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039399104 0 0) 0x7fea180c55c0 con 0x7fea180c1b20 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f8003530 con 0x7fea180c1b20 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3705390065 0 0) 0x7fe9f8003530 con 0x7fea180c1b20 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 >> v2:172.21.15.125:3300/0 conn(0x7fea1806c3d0 msgr2=0x7fea18071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 --2- 172.21.15.50:0/662683397 >> v2:172.21.15.125:3300/0 conn(0x7fea1806c3d0 0x7fea18071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 >> v1:172.21.15.125:6789/0 conn(0x7fea1806b4e0 legacy=0x7fea18156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180c5810 con 0x7fea180c1b20 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7fea10001a00 con 0x7fea180c1b20 2024-01-30T08:10:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 >> v1:172.21.15.50:6789/0 conn(0x7fea180c1b20 legacy=0x7fea18071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f8003980 0x7fe9f8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f80047d0 0x7fe9f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f8005190 0x7fe9f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1806be30 con 0x7fe9f8003980 2024-01-30T08:10:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f800c0e0 con 0x7fe9f8005190 2024-01-30T08:10:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f800c2a0 con 0x7fe9f80047d0 2024-01-30T08:10:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17e00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f8003980 0x7fe9f8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17400640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f80047d0 0x7fe9f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ca00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f8005190 0x7fe9f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17e00640 1 -- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f80047d0 msgr2=0x7fe9f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17e00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f80047d0 0x7fe9f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17e00640 1 -- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f8005190 msgr2=0x7fe9f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17e00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f8005190 0x7fe9f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea17e00640 1 -- 172.21.15.50:0/662683397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8003530 con 0x7fe9f8003980 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ca00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f8005190 0x7fe9f800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.888+0000 7fea1ca00640 1 -- 172.21.15.50:0/662683397 reap_dead start 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea17e00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f8003980 0x7fe9f8003d60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fea08001860 tx=0x7fea0801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d7159e583fd376 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080ab600 con 0x7fe9f8003980 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea080a7050 con 0x7fe9f8003980 2024-01-30T08:10:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea16a00640 1 -- 172.21.15.50:0/662683397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080ab9e0 con 0x7fe9f8003980 2024-01-30T08:10:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea1ea00640 1 -- 172.21.15.50:0/662683397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f8003980 msgr2=0x7fe9f8003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea1ea00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f8003980 0x7fe9f8003d60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fea08001860 tx=0x7fea0801c4b0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea1ea00640 1 -- 172.21.15.50:0/662683397 shutdown_connections 2024-01-30T08:10:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea1ea00640 1 --2- 172.21.15.50:0/662683397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9f8003980 0x7fe9f8003d60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea1ea00640 1 -- 172.21.15.50:0/662683397 >> 172.21.15.50:0/662683397 conn(0x7fea180a9590 msgr2=0x7fea180c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea1ea00640 1 -- 172.21.15.50:0/662683397 shutdown_connections 2024-01-30T08:10:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.892+0000 7fea1ea00640 1 -- 172.21.15.50:0/662683397 wait complete. 2024-01-30T08:10:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 Processor -- start 2024-01-30T08:10:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 -- start start 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f8003980 0x7fea1806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea1814c920 0x7fea1814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea1814cd80 0x7fea1814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181e2090 con 0x7fea1814c920 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1814f570 con 0x7fea1814cd80 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1814e960 con 0x7fe9f8003980 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea1814c920 0x7fea1814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea1814c920 0x7fea1814ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33212/0 (socket says 172.21.15.50:33212) 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 -- 172.21.15.50:0/2944048512 learned_addr learned my addr 172.21.15.50:0/2944048512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ca00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea1814cd80 0x7fea1814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17e00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f8003980 0x7fea1806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 -- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f8003980 msgr2=0x7fea1806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f8003980 0x7fea1806ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 -- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea1814cd80 msgr2=0x7fea1814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea1814cd80 0x7fea1814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 -- 172.21.15.50:0/2944048512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1814ec40 con 0x7fea1814c920 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea17400640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea1814c920 0x7fea1814ae50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fea00011980 tx=0x7fea00011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea0fe00640 1 -- 172.21.15.50:0/2944048512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00004240 con 0x7fea1814c920 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea0fe00640 1 -- 172.21.15.50:0/2944048512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000043a0 con 0x7fea1814c920 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea0fe00640 1 -- 172.21.15.50:0/2944048512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000fb20 con 0x7fea1814c920 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1814ef20 con 0x7fea1814c920 2024-01-30T08:10:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.896+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1806efc0 con 0x7fea1814c920 2024-01-30T08:10:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.900+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea180c0ed0 con 0x7fea1814c920 2024-01-30T08:10:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.900+0000 7fea0fe00640 1 -- 172.21.15.50:0/2944048512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fea0000fc80 con 0x7fea1814c920 2024-01-30T08:10:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.900+0000 7fea0fe00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe9f0066500 0x7fe9f00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.900+0000 7fea0fe00640 1 -- 172.21.15.50:0/2944048512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fea00084a50 con 0x7fea1814c920 2024-01-30T08:10:25.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.900+0000 7fea17e00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe9f0066500 0x7fe9f00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:25.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.900+0000 7fea17e00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe9f0066500 0x7fe9f00689c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea080ad000 tx=0x7fea080a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:25.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:25.904+0000 7fea0fe00640 1 -- 172.21.15.50:0/2944048512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fea00051840 con 0x7fea1814c920 2024-01-30T08:10:26.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.064+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea18074a20 con 0x7fea1814c920 2024-01-30T08:10:26.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.064+0000 7fea0fe00640 1 -- 172.21.15.50:0/2944048512 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20491 (secure 0 0 0) 0x7fea00019090 con 0x7fea1814c920 2024-01-30T08:10:26.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:26.069 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:12.907159+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:26.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe9f0066500 msgr2=0x7fe9f00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe9f0066500 0x7fe9f00689c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea080ad000 tx=0x7fea080a6000 comp rx=0 tx=0).stop 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea1814c920 msgr2=0x7fea1814ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea1814c920 0x7fea1814ae50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fea00011980 tx=0x7fea00011e40 comp rx=0 tx=0).stop 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 shutdown_connections 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea1814cd80 0x7fea1814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fe9f0066500 0x7fe9f00689c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea1814c920 0x7fea1814ae50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 --2- 172.21.15.50:0/2944048512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe9f8003980 0x7fea1806ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 >> 172.21.15.50:0/2944048512 conn(0x7fea180a9590 msgr2=0x7fea180a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 shutdown_connections 2024-01-30T08:10:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.068+0000 7fea1ea00640 1 -- 172.21.15.50:0/2944048512 wait complete. 2024-01-30T08:10:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:09:51.121360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:09:52.315187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-30T08:10:09.022581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-30T08:10:10.287235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:10:26.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:10:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.232+0000 7f3c3d000640 1 Processor -- start 2024-01-30T08:10:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.232+0000 7f3c3d000640 1 -- start start 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c3d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c380c04b0 0x7f3c38153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c3d000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c380c54e0 con 0x7f3c3814fbf0 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c3d000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c38152bf0 con 0x7f3c380a4da0 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c3d000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c38072d90 con 0x7f3c380c04b0 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c36800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c380c04b0 0x7f3c38153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c35e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c3814fbf0 0x7f3c380c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49252/0 (socket says 172.21.15.50:49252) 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c35e00640 1 -- 172.21.15.50:0/1634575377 learned_addr learned my addr 172.21.15.50:0/1634575377 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c36800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c380c04b0 0x7f3c38153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33228/0 (socket says 172.21.15.50:33228) 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c36800640 1 -- 172.21.15.50:0/1634575377 >> v1:172.21.15.125:6789/0 conn(0x7f3c380a4da0 legacy=0x7f3c3806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c36800640 1 -- 172.21.15.50:0/1634575377 >> v1:172.21.15.50:6789/0 conn(0x7f3c3814fbf0 legacy=0x7f3c380c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.236+0000 7f3c36800640 1 -- 172.21.15.50:0/1634575377 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c381525e0 con 0x7f3c380c04b0 2024-01-30T08:10:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c36800640 1 --2- 172.21.15.50:0/1634575377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380c04b0 0x7f3c38153080 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009d90 tx=0x7f3c3001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d5d1e6983a0871 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c34a00640 1 -- 172.21.15.50:0/1634575377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300a57a0 con 0x7f3c380c04b0 2024-01-30T08:10:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c34a00640 1 -- 172.21.15.50:0/1634575377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c300a5900 con 0x7f3c380c04b0 2024-01-30T08:10:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c34a00640 1 -- 172.21.15.50:0/1634575377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300a5c90 con 0x7f3c380c04b0 2024-01-30T08:10:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 -- 172.21.15.50:0/1634575377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380c04b0 msgr2=0x7f3c38153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 --2- 172.21.15.50:0/1634575377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380c04b0 0x7f3c38153080 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009d90 tx=0x7f3c3001c7f0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 -- 172.21.15.50:0/1634575377 shutdown_connections 2024-01-30T08:10:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 --2- 172.21.15.50:0/1634575377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380c04b0 0x7f3c38153080 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 -- 172.21.15.50:0/1634575377 >> 172.21.15.50:0/1634575377 conn(0x7f3c380c5b30 msgr2=0x7f3c380c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 -- 172.21.15.50:0/1634575377 shutdown_connections 2024-01-30T08:10:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 -- 172.21.15.50:0/1634575377 wait complete. 2024-01-30T08:10:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 Processor -- start 2024-01-30T08:10:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.240+0000 7f3c3d000640 1 -- start start 2024-01-30T08:10:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380a4da0 0x7f3c381eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c380c04b0 0x7f3c38155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c3814fbf0 0x7f3c3815d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381eab30 con 0x7f3c380a4da0 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381539b0 con 0x7f3c380c04b0 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38153c90 con 0x7f3c3814fbf0 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380a4da0 0x7f3c381eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380a4da0 0x7f3c381eea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33230/0 (socket says 172.21.15.50:33230) 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 -- 172.21.15.50:0/2613217766 learned_addr learned my addr 172.21.15.50:0/2613217766 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35400640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c380c04b0 0x7f3c38155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c36800640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c3814fbf0 0x7f3c3815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 -- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c3814fbf0 msgr2=0x7f3c3815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c3814fbf0 0x7f3c3815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 -- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c380c04b0 msgr2=0x7f3c38155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c380c04b0 0x7f3c38155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 -- 172.21.15.50:0/2613217766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30009a70 con 0x7f3c380a4da0 2024-01-30T08:10:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c35e00640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380a4da0 0x7f3c381eea60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c370 tx=0x7f3c2800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c2e000640 1 -- 172.21.15.50:0/2613217766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28005cf0 con 0x7f3c380a4da0 2024-01-30T08:10:26.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c381eadf0 con 0x7f3c380a4da0 2024-01-30T08:10:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c381567c0 con 0x7f3c380a4da0 2024-01-30T08:10:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c2e000640 1 -- 172.21.15.50:0/2613217766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28005e50 con 0x7f3c380a4da0 2024-01-30T08:10:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c2e000640 1 -- 172.21.15.50:0/2613217766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280072d0 con 0x7f3c380a4da0 2024-01-30T08:10:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.244+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c080052a0 con 0x7f3c380a4da0 2024-01-30T08:10:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.248+0000 7f3c2e000640 1 -- 172.21.15.50:0/2613217766 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3c28007430 con 0x7f3c380a4da0 2024-01-30T08:10:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.248+0000 7f3c2e000640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3c10066530 0x7f3c100689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.248+0000 7f3c2e000640 1 -- 172.21.15.50:0/2613217766 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3c280837b0 con 0x7f3c380a4da0 2024-01-30T08:10:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.248+0000 7f3c35400640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3c10066530 0x7f3c100689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.248+0000 7f3c35400640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3c10066530 0x7f3c100689f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3c380c4b10 tx=0x7f3c20007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.252+0000 7f3c2e000640 1 -- 172.21.15.50:0/2613217766 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3c280505d0 con 0x7f3c380a4da0 2024-01-30T08:10:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.408+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c08005ad0 con 0x7f3c380a4da0 2024-01-30T08:10:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c2e000640 1 -- 172.21.15.50:0/2613217766 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c28053bf0 con 0x7f3c380a4da0 2024-01-30T08:10:26.414 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:10:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3c10066530 msgr2=0x7f3c100689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3c10066530 0x7f3c100689f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3c380c4b10 tx=0x7f3c20007e40 comp rx=0 tx=0).stop 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380a4da0 msgr2=0x7f3c381eea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380a4da0 0x7f3c381eea60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c370 tx=0x7f3c2800c830 comp rx=0 tx=0).stop 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 shutdown_connections 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c380c04b0 0x7f3c38155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3c10066530 0x7f3c100689f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c3814fbf0 0x7f3c3815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 --2- 172.21.15.50:0/2613217766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c380a4da0 0x7f3c381eea60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 >> 172.21.15.50:0/2613217766 conn(0x7f3c380c5b30 msgr2=0x7f3c380c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 shutdown_connections 2024-01-30T08:10:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.412+0000 7f3c3d000640 1 -- 172.21.15.50:0/2613217766 wait complete. 2024-01-30T08:10:26.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:10:26.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.576+0000 7f6406c00640 1 Processor -- start 2024-01-30T08:10:26.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.576+0000 7f6406c00640 1 -- start start 2024-01-30T08:10:26.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f6406c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f6406c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64000a4da0 0x7f64000c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f6406c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000c54e0 con 0x7f64000c16c0 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f6406c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6400152bf0 con 0x7f64000a4da0 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f6406c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6400072d90 con 0x7f640014fbf0 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f6404c00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64000c16c0 0x7f640006ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49256/0 (socket says 172.21.15.50:49256) 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f6404c00640 1 -- 172.21.15.50:0/3525649270 learned_addr learned my addr 172.21.15.50:0/3525649270 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63ffe00640 1 --2- 172.21.15.50:0/3525649270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63ff400640 1 --2- 172.21.15.50:0/3525649270 >> v2:172.21.15.125:3300/0 conn(0x7f64000a4da0 0x7f64000c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63fea00640 1 -- 172.21.15.50:0/3525649270 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348659370 0 0) 0x7f64000c54e0 con 0x7f64000c16c0 2024-01-30T08:10:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63fea00640 1 -- 172.21.15.50:0/3525649270 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63e0003530 con 0x7f64000c16c0 2024-01-30T08:10:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63ffe00640 1 -- 172.21.15.50:0/3525649270 >> v2:172.21.15.125:3300/0 conn(0x7f64000a4da0 msgr2=0x7f64000c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63ffe00640 1 --2- 172.21.15.50:0/3525649270 >> v2:172.21.15.125:3300/0 conn(0x7f64000a4da0 0x7f64000c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63ffe00640 1 -- 172.21.15.50:0/3525649270 >> v1:172.21.15.50:6789/0 conn(0x7f64000c16c0 legacy=0x7f640006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63ffe00640 1 -- 172.21.15.50:0/3525649270 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64001525e0 con 0x7f640014fbf0 2024-01-30T08:10:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.580+0000 7f63ffe00640 1 --2- 172.21.15.50:0/3525649270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400153080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f63f00097c0 tx=0x7f63f001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ef59f62a393728 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f63fea00640 1 -- 172.21.15.50:0/3525649270 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00ab600 con 0x7f640014fbf0 2024-01-30T08:10:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f63fea00640 1 -- 172.21.15.50:0/3525649270 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f00a7050 con 0x7f640014fbf0 2024-01-30T08:10:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f63fea00640 1 -- 172.21.15.50:0/3525649270 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00ab980 con 0x7f640014fbf0 2024-01-30T08:10:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- 172.21.15.50:0/3525649270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 msgr2=0x7f6400153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 --2- 172.21.15.50:0/3525649270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400153080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f63f00097c0 tx=0x7f63f001c3f0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- 172.21.15.50:0/3525649270 shutdown_connections 2024-01-30T08:10:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 --2- 172.21.15.50:0/3525649270 >> v2:172.21.15.125:3300/0 conn(0x7f64000a4da0 0x7f64000c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 --2- 172.21.15.50:0/3525649270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400153080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- 172.21.15.50:0/3525649270 >> 172.21.15.50:0/3525649270 conn(0x7f64000c5b30 msgr2=0x7f64000c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- 172.21.15.50:0/3525649270 shutdown_connections 2024-01-30T08:10:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- 172.21.15.50:0/3525649270 wait complete. 2024-01-30T08:10:26.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 Processor -- start 2024-01-30T08:10:26.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- start start 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64000a4da0 0x7f64001ecc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000a9dc0 0x7f64000ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000a9930 con 0x7f64000a9dc0 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64001545a0 con 0x7f64000a4da0 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.584+0000 7f6406c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6400156f10 con 0x7f640014fbf0 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000a9dc0 0x7f64000ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000a9dc0 0x7f64000ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33244/0 (socket says 172.21.15.50:33244) 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 -- 172.21.15.50:0/2873800691 learned_addr learned my addr 172.21.15.50:0/2873800691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f63ffe00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64000a4da0 0x7f64001ecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f63ff400640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 -- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 msgr2=0x7f6400154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 -- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64000a4da0 msgr2=0x7f64001ecc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64000a4da0 0x7f64001ecc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 -- 172.21.15.50:0/2873800691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f0009420 con 0x7f64000a9dc0 2024-01-30T08:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6404c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000a9dc0 0x7f64000ab150 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f63f800cbb0 tx=0x7f63f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f63f7e00640 1 -- 172.21.15.50:0/2873800691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800ad40 con 0x7f64000a9dc0 2024-01-30T08:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f63f7e00640 1 -- 172.21.15.50:0/2873800691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8012400 con 0x7f64000a9dc0 2024-01-30T08:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f63f7e00640 1 -- 172.21.15.50:0/2873800691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800aea0 con 0x7f64000a9dc0 2024-01-30T08:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000a8d20 con 0x7f64000a9dc0 2024-01-30T08:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64000a92e0 con 0x7f64000a9dc0 2024-01-30T08:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6400067cc0 con 0x7f64000a9dc0 2024-01-30T08:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.588+0000 7f63f7e00640 1 -- 172.21.15.50:0/2873800691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f63f8007070 con 0x7f64000a9dc0 2024-01-30T08:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.592+0000 7f63f7e00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f63d8066530 0x7f63d80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.592+0000 7f63f7e00640 1 -- 172.21.15.50:0/2873800691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f63f8084150 con 0x7f64000a9dc0 2024-01-30T08:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.592+0000 7f63ffe00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f63d8066530 0x7f63d80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.592+0000 7f63ffe00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f63d8066530 0x7f63d80689f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63f00ad000 tx=0x7f63f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.596+0000 7f63f7e00640 1 -- 172.21.15.50:0/2873800691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f63f8051000 con 0x7f64000a9dc0 2024-01-30T08:10:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.752+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6400074a20 con 0x7f64000a9dc0 2024-01-30T08:10:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.752+0000 7f63f7e00640 1 -- 172.21.15.50:0/2873800691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63f8054620 con 0x7f64000a9dc0 2024-01-30T08:10:26.755 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.752+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f63d8066530 msgr2=0x7f63d80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.752+0000 7f6406c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f63d8066530 0x7f63d80689f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63f00ad000 tx=0x7f63f0008040 comp rx=0 tx=0).stop 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000a9dc0 msgr2=0x7f64000ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000a9dc0 0x7f64000ab150 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f63f800cbb0 tx=0x7f63f800a430 comp rx=0 tx=0).stop 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 shutdown_connections 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f63d8066530 0x7f63d80689f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000a9dc0 0x7f64000ab150 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f640014fbf0 0x7f6400154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 --2- 172.21.15.50:0/2873800691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64000a4da0 0x7f64001ecc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 >> 172.21.15.50:0/2873800691 conn(0x7f64000c5b30 msgr2=0x7f640006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 shutdown_connections 2024-01-30T08:10:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.756+0000 7f6406c00640 1 -- 172.21.15.50:0/2873800691 wait complete. 2024-01-30T08:10:26.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:10:26.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.920+0000 7ff2ba000640 1 Processor -- start 2024-01-30T08:10:26.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.920+0000 7ff2ba000640 1 -- start start 2024-01-30T08:10:26.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.920+0000 7ff2ba000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 0x7ff2b40a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.920+0000 7ff2ba000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2b406bfe0 0x7ff2b40c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2ba000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b406c4c0 con 0x7ff2b40a51e0 2024-01-30T08:10:26.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2ba000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b40c0550 con 0x7ff2b406bfe0 2024-01-30T08:10:26.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2ba000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c07c0 con 0x7ff2b4072b60 2024-01-30T08:10:26.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b3e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff2b40a51e0 0x7ff2b40c17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49268/0 (socket says 172.21.15.50:49268) 2024-01-30T08:10:26.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b3e00640 1 -- 172.21.15.50:0/2926438162 learned_addr learned my addr 172.21.15.50:0/2926438162 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:26.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b3400640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 0x7ff2b40a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2a00640 1 --2- 172.21.15.50:0/2926438162 >> v2:172.21.15.125:3300/0 conn(0x7ff2b406bfe0 0x7ff2b40c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011801210 0 0) 0x7ff2b406c4c0 con 0x7ff2b40a51e0 2024-01-30T08:10:26.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff294005740 con 0x7ff2b40a51e0 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2884978526 0 0) 0x7ff294005740 con 0x7ff2b40a51e0 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 msgr2=0x7ff2b40a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 0x7ff2b40a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 >> v2:172.21.15.125:3300/0 conn(0x7ff2b406bfe0 msgr2=0x7ff2b40c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 --2- 172.21.15.50:0/2926438162 >> v2:172.21.15.125:3300/0 conn(0x7ff2b406bfe0 0x7ff2b40c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40c0aa0 con 0x7ff2b40a51e0 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7ff2ac001a00 con 0x7ff2b40a51e0 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b3400640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 0x7ff2b40a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 >> v1:172.21.15.50:6789/0 conn(0x7ff2b40a51e0 legacy=0x7ff2b40c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 0x7ff294005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2940060d0 0x7ff2940069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff294006f20 0x7ff2940073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c0550 con 0x7ff2940060d0 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c07c0 con 0x7ff294006f20 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29400dba0 con 0x7ff2b4072b60 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2a00640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2940060d0 0x7ff2940069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b3400640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 0x7ff294005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b3e00640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff294006f20 0x7ff2940073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2a00640 1 -- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 msgr2=0x7ff294005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2a00640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2b4072b60 0x7ff294005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2a00640 1 -- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff294006f20 msgr2=0x7ff2940073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2a00640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff294006f20 0x7ff2940073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.924+0000 7ff2b2a00640 1 -- 172.21.15.50:0/2926438162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009420 con 0x7ff2940060d0 2024-01-30T08:10:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2b2a00640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2940060d0 0x7ff2940069e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009ae0 tx=0x7ff29c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6613dd1babe4ad66 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0a5550 con 0x7ff2940060d0 2024-01-30T08:10:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c0a56b0 con 0x7ff2940060d0 2024-01-30T08:10:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2b2000640 1 -- 172.21.15.50:0/2926438162 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0a5a60 con 0x7ff2940060d0 2024-01-30T08:10:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 -- 172.21.15.50:0/2926438162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2940060d0 msgr2=0x7ff2940069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 --2- 172.21.15.50:0/2926438162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2940060d0 0x7ff2940069e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009ae0 tx=0x7ff29c01ca60 comp rx=0 tx=0).stop 2024-01-30T08:10:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2b3e00640 1 -- 172.21.15.50:0/2926438162 reap_dead start 2024-01-30T08:10:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 -- 172.21.15.50:0/2926438162 shutdown_connections 2024-01-30T08:10:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 -- 172.21.15.50:0/2926438162 >> 172.21.15.50:0/2926438162 conn(0x7ff2b40c5b30 msgr2=0x7ff2b40c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 -- 172.21.15.50:0/2926438162 shutdown_connections 2024-01-30T08:10:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 -- 172.21.15.50:0/2926438162 wait complete. 2024-01-30T08:10:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 Processor -- start 2024-01-30T08:10:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.928+0000 7ff2ba000640 1 -- start start 2024-01-30T08:10:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2940060d0 0x7ff2b4150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b41ec7e0 0x7ff2b4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2b4154eb0 0x7ff2b414da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4155330 con 0x7ff2b4154eb0 2024-01-30T08:10:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41e95c0 con 0x7ff2b41ec7e0 2024-01-30T08:10:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41e98a0 con 0x7ff2940060d0 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2b4154eb0 0x7ff2b414da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2b4154eb0 0x7ff2b414da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33258/0 (socket says 172.21.15.50:33258) 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 -- 172.21.15.50:0/2503636349 learned_addr learned my addr 172.21.15.50:0/2503636349 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b2a00640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b41ec7e0 0x7ff2b4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3400640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2940060d0 0x7ff2b4150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 -- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2940060d0 msgr2=0x7ff2b4150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2940060d0 0x7ff2b4150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 -- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b41ec7e0 msgr2=0x7ff2b4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b41ec7e0 0x7ff2b4154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 -- 172.21.15.50:0/2503636349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b41e9b80 con 0x7ff2b4154eb0 2024-01-30T08:10:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2b3e00640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2b4154eb0 0x7ff2b414da20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac002240 tx=0x7ff2ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ab400640 1 -- 172.21.15.50:0/2503636349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac007ae0 con 0x7ff2b4154eb0 2024-01-30T08:10:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ab400640 1 -- 172.21.15.50:0/2503636349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac00ee20 con 0x7ff2b4154eb0 2024-01-30T08:10:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ab400640 1 -- 172.21.15.50:0/2503636349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac013660 con 0x7ff2b4154eb0 2024-01-30T08:10:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b41e9e60 con 0x7ff2b4154eb0 2024-01-30T08:10:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b414cb20 con 0x7ff2b4154eb0 2024-01-30T08:10:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b4074a20 con 0x7ff2b4154eb0 2024-01-30T08:10:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.932+0000 7ff2ab400640 1 -- 172.21.15.50:0/2503636349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff2ac0137c0 con 0x7ff2b4154eb0 2024-01-30T08:10:26.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.936+0000 7ff2ab400640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff28c066500 0x7ff28c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:26.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.936+0000 7ff2ab400640 1 -- 172.21.15.50:0/2503636349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff2ac084730 con 0x7ff2b4154eb0 2024-01-30T08:10:26.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.936+0000 7ff2b3400640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff28c066500 0x7ff28c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.936+0000 7ff2b3400640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff28c066500 0x7ff28c0689c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009c80 tx=0x7ff2a4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:26.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:26.940+0000 7ff2ab400640 1 -- 172.21.15.50:0/2503636349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff2ac0515e0 con 0x7ff2b4154eb0 2024-01-30T08:10:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2b40a59c0 con 0x7ff2b4154eb0 2024-01-30T08:10:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ab400640 1 -- 172.21.15.50:0/2503636349 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2ac054c00 con 0x7ff2b4154eb0 2024-01-30T08:10:27.103 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff28c066500 msgr2=0x7ff28c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff28c066500 0x7ff28c0689c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009c80 tx=0x7ff2a4009190 comp rx=0 tx=0).stop 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2b4154eb0 msgr2=0x7ff2b414da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2b4154eb0 0x7ff2b414da20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac002240 tx=0x7ff2ac00e530 comp rx=0 tx=0).stop 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 shutdown_connections 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2b41ec7e0 0x7ff2b4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ff28c066500 0x7ff28c0689c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2b4154eb0 0x7ff2b414da20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 --2- 172.21.15.50:0/2503636349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff2940060d0 0x7ff2b4150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 >> 172.21.15.50:0/2503636349 conn(0x7ff2b40c5b30 msgr2=0x7ff2b40a5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 shutdown_connections 2024-01-30T08:10:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.100+0000 7ff2ba000640 1 -- 172.21.15.50:0/2503636349 wait complete. 2024-01-30T08:10:27.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-30T08:10:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c8800640 1 Processor -- start 2024-01-30T08:10:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c8800640 1 -- start start 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c8800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f61c014fbf0 0x7f61c0153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c8800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61c00a4da0 0x7f61c00c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c8800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00c54e0 con 0x7f61c00c16c0 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c8800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c0152bf0 con 0x7f61c00a4da0 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c8800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c0072d90 con 0x7f61c014fbf0 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c5400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61c00a4da0 0x7f61c00c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c5400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61c00a4da0 0x7f61c00c1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33260/0 (socket says 172.21.15.50:33260) 2024-01-30T08:10:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c5400640 1 -- 172.21.15.50:0/1861556464 learned_addr learned my addr 172.21.15.50:0/1861556464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.272+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1861556464 >> v2:172.21.15.125:3300/0 conn(0x7f61c014fbf0 0x7f61c0153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c5400640 1 -- 172.21.15.50:0/1861556464 >> v2:172.21.15.125:3300/0 conn(0x7f61c014fbf0 msgr2=0x7f61c0153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c5400640 1 --2- 172.21.15.50:0/1861556464 >> v2:172.21.15.125:3300/0 conn(0x7f61c014fbf0 0x7f61c0153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c5400640 1 -- 172.21.15.50:0/1861556464 >> v1:172.21.15.125:6789/0 conn(0x7f61c00c16c0 legacy=0x7f61c006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c5400640 1 -- 172.21.15.50:0/1861556464 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c01525e0 con 0x7f61c00a4da0 2024-01-30T08:10:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c5400640 1 --2- 172.21.15.50:0/1861556464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c00a4da0 0x7f61c00c1180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61c006b610 tx=0x7f61a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e270839f87e46503 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c4a00640 1 -- 172.21.15.50:0/1861556464 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80ab600 con 0x7f61c00a4da0 2024-01-30T08:10:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c4a00640 1 -- 172.21.15.50:0/1861556464 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a80a7050 con 0x7f61c00a4da0 2024-01-30T08:10:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c4a00640 1 -- 172.21.15.50:0/1861556464 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80ab980 con 0x7f61c00a4da0 2024-01-30T08:10:27.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.276+0000 7f61c8800640 1 -- 172.21.15.50:0/1861556464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c00a4da0 msgr2=0x7f61c00c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 --2- 172.21.15.50:0/1861556464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c00a4da0 0x7f61c00c1180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61c006b610 tx=0x7f61a801c430 comp rx=0 tx=0).stop 2024-01-30T08:10:27.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- 172.21.15.50:0/1861556464 shutdown_connections 2024-01-30T08:10:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 --2- 172.21.15.50:0/1861556464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c00a4da0 0x7f61c00c1180 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 --2- 172.21.15.50:0/1861556464 >> v2:172.21.15.125:3300/0 conn(0x7f61c014fbf0 0x7f61c0153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- 172.21.15.50:0/1861556464 >> 172.21.15.50:0/1861556464 conn(0x7f61c00c5b30 msgr2=0x7f61c00c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- 172.21.15.50:0/1861556464 shutdown_connections 2024-01-30T08:10:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- 172.21.15.50:0/1861556464 wait complete. 2024-01-30T08:10:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 Processor -- start 2024-01-30T08:10:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- start start 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61c00a4da0 0x7f61c01541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c014fbf0 0x7f61c0148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61c0148e60 0x7f61c015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0154710 con 0x7f61c014fbf0 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c01ee560 con 0x7f61c0148e60 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c8800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0152410 con 0x7f61c00a4da0 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c014fbf0 0x7f61c0148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c014fbf0 0x7f61c0148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33276/0 (socket says 172.21.15.50:33276) 2024-01-30T08:10:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 -- 172.21.15.50:0/1754797170 learned_addr learned my addr 172.21.15.50:0/1754797170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61c00a4da0 0x7f61c01541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c6800640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61c0148e60 0x7f61c015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 -- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61c00a4da0 msgr2=0x7f61c01541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61c00a4da0 0x7f61c01541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 -- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61c0148e60 msgr2=0x7f61c015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61c0148e60 0x7f61c015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.280+0000 7f61c5400640 1 -- 172.21.15.50:0/1754797170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a80094d0 con 0x7f61c014fbf0 2024-01-30T08:10:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61c5400640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c014fbf0 0x7f61c0148920 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ae040 tx=0x7f61a80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61be000640 1 -- 172.21.15.50:0/1754797170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80b4440 con 0x7f61c014fbf0 2024-01-30T08:10:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61be000640 1 -- 172.21.15.50:0/1754797170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a80b45a0 con 0x7f61c014fbf0 2024-01-30T08:10:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61be000640 1 -- 172.21.15.50:0/1754797170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80b4950 con 0x7f61c014fbf0 2024-01-30T08:10:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c0149810 con 0x7f61c014fbf0 2024-01-30T08:10:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c0156050 con 0x7f61c014fbf0 2024-01-30T08:10:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c0067cc0 con 0x7f61c014fbf0 2024-01-30T08:10:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61be000640 1 -- 172.21.15.50:0/1754797170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f61a80b2070 con 0x7f61c014fbf0 2024-01-30T08:10:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61be000640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6198066500 0x7f61980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61be000640 1 -- 172.21.15.50:0/1754797170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f61a811e0e0 con 0x7f61c014fbf0 2024-01-30T08:10:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.284+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6198066500 0x7f61980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.288+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6198066500 0x7f61980689c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61b00079c0 tx=0x7f61b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.288+0000 7f61be000640 1 -- 172.21.15.50:0/1754797170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f61a80eaf80 con 0x7f61c014fbf0 2024-01-30T08:10:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61c0074a20 con 0x7f61c014fbf0 2024-01-30T08:10:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61be000640 1 -- 172.21.15.50:0/1754797170 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7f61a80ee5a0 con 0x7f61c014fbf0 2024-01-30T08:10:27.451 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6198066500 msgr2=0x7f61980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6198066500 0x7f61980689c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61b00079c0 tx=0x7f61b0008040 comp rx=0 tx=0).stop 2024-01-30T08:10:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c014fbf0 msgr2=0x7f61c0148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c014fbf0 0x7f61c0148920 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ae040 tx=0x7f61a80191d0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 shutdown_connections 2024-01-30T08:10:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61c0148e60 0x7f61c015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6198066500 0x7f61980689c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c014fbf0 0x7f61c0148920 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 --2- 172.21.15.50:0/1754797170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61c00a4da0 0x7f61c01541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.448+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 >> 172.21.15.50:0/1754797170 conn(0x7f61c00c5b30 msgr2=0x7f61c0072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.452+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 shutdown_connections 2024-01-30T08:10:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.452+0000 7f61c8800640 1 -- 172.21.15.50:0/1754797170 wait complete. 2024-01-30T08:10:27.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-30T08:10:27.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a34a00640 1 Processor -- start 2024-01-30T08:10:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a34a00640 1 -- start start 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a34a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a2c071e10 0x7f6a2c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a34a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a2c154290 0x7f6a2c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a34a00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c0c22b0 con 0x7f6a2c06c960 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a34a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c5890 con 0x7f6a2c154290 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a34a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c52d0 con 0x7f6a2c071e10 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a2c154290 0x7f6a2c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a2c154290 0x7f6a2c1546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33292/0 (socket says 172.21.15.50:33292) 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32a00640 1 -- 172.21.15.50:0/2821019678 learned_addr learned my addr 172.21.15.50:0/2821019678 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32000640 1 --2- 172.21.15.50:0/2821019678 >> v2:172.21.15.125:3300/0 conn(0x7f6a2c071e10 0x7f6a2c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32a00640 1 -- 172.21.15.50:0/2821019678 >> v2:172.21.15.125:3300/0 conn(0x7f6a2c071e10 msgr2=0x7f6a2c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32a00640 1 --2- 172.21.15.50:0/2821019678 >> v2:172.21.15.125:3300/0 conn(0x7f6a2c071e10 0x7f6a2c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32a00640 1 -- 172.21.15.50:0/2821019678 >> v1:172.21.15.125:6789/0 conn(0x7f6a2c06c960 legacy=0x7f6a2c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.616+0000 7f6a32a00640 1 -- 172.21.15.50:0/2821019678 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c0c55b0 con 0x7f6a2c154290 2024-01-30T08:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a32a00640 1 --2- 172.21.15.50:0/2821019678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1546e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c073fd0 tx=0x7f6a2401eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862a9cb61684c3c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a30c00640 1 -- 172.21.15.50:0/2821019678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240a7900 con 0x7f6a2c154290 2024-01-30T08:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a30c00640 1 -- 172.21.15.50:0/2821019678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a240ab070 con 0x7f6a2c154290 2024-01-30T08:10:27.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a30c00640 1 -- 172.21.15.50:0/2821019678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240a7c80 con 0x7f6a2c154290 2024-01-30T08:10:27.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 -- 172.21.15.50:0/2821019678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 msgr2=0x7f6a2c1546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2821019678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1546e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c073fd0 tx=0x7f6a2401eab0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 -- 172.21.15.50:0/2821019678 shutdown_connections 2024-01-30T08:10:27.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2821019678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1546e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2821019678 >> v2:172.21.15.125:3300/0 conn(0x7f6a2c071e10 0x7f6a2c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 -- 172.21.15.50:0/2821019678 >> 172.21.15.50:0/2821019678 conn(0x7f6a2c0c5b30 msgr2=0x7f6a2c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:27.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 -- 172.21.15.50:0/2821019678 shutdown_connections 2024-01-30T08:10:27.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 -- 172.21.15.50:0/2821019678 wait complete. 2024-01-30T08:10:27.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.620+0000 7f6a34a00640 1 Processor -- start 2024-01-30T08:10:27.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 -- start start 2024-01-30T08:10:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a2c06c960 0x7f6a2c0a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a2c071e10 0x7f6a2c147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0a9d60 con 0x7f6a2c154290 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0ab1a0 con 0x7f6a2c071e10 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0ab440 con 0x7f6a2c06c960 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33304/0 (socket says 172.21.15.50:33304) 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 -- 172.21.15.50:0/2582366803 learned_addr learned my addr 172.21.15.50:0/2582366803 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a31600640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a2c071e10 0x7f6a2c147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32000640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a2c06c960 0x7f6a2c0a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 -- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a2c06c960 msgr2=0x7f6a2c0a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a2c06c960 0x7f6a2c0a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 -- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a2c071e10 msgr2=0x7f6a2c147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a2c071e10 0x7f6a2c147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 -- 172.21.15.50:0/2582366803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2400bd40 con 0x7f6a2c154290 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a32a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1484a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6a2401b6c0 tx=0x7f6a2401b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a2a000640 1 -- 172.21.15.50:0/2582366803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240bc850 con 0x7f6a2c154290 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a2a000640 1 -- 172.21.15.50:0/2582366803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a240bc9b0 con 0x7f6a2c154290 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c1489e0 con 0x7f6a2c154290 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a2a000640 1 -- 172.21.15.50:0/2582366803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240bcd20 con 0x7f6a2c154290 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c14d150 con 0x7f6a2c154290 2024-01-30T08:10:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.624+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c14d340 con 0x7f6a2c154290 2024-01-30T08:10:27.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.628+0000 7f6a2a000640 1 -- 172.21.15.50:0/2582366803 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6a240ba410 con 0x7f6a2c154290 2024-01-30T08:10:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.628+0000 7f6a2a000640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6a04066500 0x7f6a040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.628+0000 7f6a2a000640 1 -- 172.21.15.50:0/2582366803 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6a24120fe0 con 0x7f6a2c154290 2024-01-30T08:10:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.628+0000 7f6a32000640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6a04066500 0x7f6a040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.628+0000 7f6a32000640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6a04066500 0x7f6a040689c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c146590 tx=0x7f6a1c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.632+0000 7f6a2a000640 1 -- 172.21.15.50:0/2582366803 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6a240ede10 con 0x7f6a2c154290 2024-01-30T08:10:27.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.788+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6a2c074a20 con 0x7f6a2c154290 2024-01-30T08:10:27.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a2a000640 1 -- 172.21.15.50:0/2582366803 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6a2400b720 con 0x7f6a2c154290 2024-01-30T08:10:27.793 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:27.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6a04066500 msgr2=0x7f6a040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6a04066500 0x7f6a040689c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c146590 tx=0x7f6a1c009190 comp rx=0 tx=0).stop 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 msgr2=0x7f6a2c1484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1484a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6a2401b6c0 tx=0x7f6a2401b850 comp rx=0 tx=0).stop 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 shutdown_connections 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a2c071e10 0x7f6a2c147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6a04066500 0x7f6a040689c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a2c154290 0x7f6a2c1484a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 --2- 172.21.15.50:0/2582366803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a2c06c960 0x7f6a2c0a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 >> 172.21.15.50:0/2582366803 conn(0x7f6a2c0c5b30 msgr2=0x7f6a2c0c03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 shutdown_connections 2024-01-30T08:10:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.792+0000 7f6a34a00640 1 -- 172.21.15.50:0/2582366803 wait complete. 2024-01-30T08:10:27.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-30T08:10:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.956+0000 7fb602400640 1 Processor -- start 2024-01-30T08:10:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.956+0000 7fb602400640 1 -- start start 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb602400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc0c1b70 0x7fb5fc1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb602400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5fc06c050 0x7fb5fc06c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb602400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc0c2850 con 0x7fb5fc151c10 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb602400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc0c3570 con 0x7fb5fc06c050 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb602400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0c3dd0 con 0x7fb5fc0c1b70 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5fbe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5fc06c050 0x7fb5fc06c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5fbe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5fc06c050 0x7fb5fc06c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33308/0 (socket says 172.21.15.50:33308) 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5fbe00640 1 -- 172.21.15.50:0/1955946934 learned_addr learned my addr 172.21.15.50:0/1955946934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5faa00640 1 --2- 172.21.15.50:0/1955946934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc0c1b70 0x7fb5fc1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5fbe00640 1 -- 172.21.15.50:0/1955946934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc0c1b70 msgr2=0x7fb5fc1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5fbe00640 1 --2- 172.21.15.50:0/1955946934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc0c1b70 0x7fb5fc1586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5fbe00640 1 -- 172.21.15.50:0/1955946934 >> v1:172.21.15.125:6789/0 conn(0x7fb5fc151c10 legacy=0x7fb5fc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.960+0000 7fb5fbe00640 1 -- 172.21.15.50:0/1955946934 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0a7190 con 0x7fb5fc06c050 2024-01-30T08:10:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb5fbe00640 1 --2- 172.21.15.50:0/1955946934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc06c4c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009e50 tx=0x7fb5f401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facf931c384bef25 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb5fa000640 1 -- 172.21.15.50:0/1955946934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a5840 con 0x7fb5fc06c050 2024-01-30T08:10:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb5fa000640 1 -- 172.21.15.50:0/1955946934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f40a59a0 con 0x7fb5fc06c050 2024-01-30T08:10:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb5fa000640 1 -- 172.21.15.50:0/1955946934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a5d30 con 0x7fb5fc06c050 2024-01-30T08:10:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 -- 172.21.15.50:0/1955946934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 msgr2=0x7fb5fc06c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 --2- 172.21.15.50:0/1955946934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc06c4c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009e50 tx=0x7fb5f401c980 comp rx=0 tx=0).stop 2024-01-30T08:10:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 -- 172.21.15.50:0/1955946934 shutdown_connections 2024-01-30T08:10:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 --2- 172.21.15.50:0/1955946934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc06c4c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 --2- 172.21.15.50:0/1955946934 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc0c1b70 0x7fb5fc1586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 -- 172.21.15.50:0/1955946934 >> 172.21.15.50:0/1955946934 conn(0x7fb5fc06a740 msgr2=0x7fb5fc06ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 -- 172.21.15.50:0/1955946934 shutdown_connections 2024-01-30T08:10:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 -- 172.21.15.50:0/1955946934 wait complete. 2024-01-30T08:10:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 Processor -- start 2024-01-30T08:10:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.964+0000 7fb602400640 1 -- start start 2024-01-30T08:10:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5fc0c1b70 0x7fb5fc1f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc151c10 0x7fb5fc150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0a92a0 con 0x7fb5fc06c050 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0c6c00 con 0x7fb5fc0c1b70 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc150bc0 con 0x7fb5fc151c10 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33324/0 (socket says 172.21.15.50:33324) 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 -- 172.21.15.50:0/4283459848 learned_addr learned my addr 172.21.15.50:0/4283459848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fbe00640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc151c10 0x7fb5fc150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5faa00640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5fc0c1b70 0x7fb5fc1f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 -- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc151c10 msgr2=0x7fb5fc150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc151c10 0x7fb5fc150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 -- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5fc0c1b70 msgr2=0x7fb5fc1f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5fc0c1b70 0x7fb5fc1f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 -- 172.21.15.50:0/4283459848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009b30 con 0x7fb5fc06c050 2024-01-30T08:10:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5fb400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc157790 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c420 tx=0x7fb5ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5f3400640 1 -- 172.21.15.50:0/4283459848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0052d0 con 0x7fb5fc06c050 2024-01-30T08:10:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5f3400640 1 -- 172.21.15.50:0/4283459848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec005430 con 0x7fb5fc06c050 2024-01-30T08:10:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc1497a0 con 0x7fb5fc06c050 2024-01-30T08:10:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb5f3400640 1 -- 172.21.15.50:0/4283459848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec007260 con 0x7fb5fc06c050 2024-01-30T08:10:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc14f6b0 con 0x7fb5fc06c050 2024-01-30T08:10:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.968+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc14f510 con 0x7fb5fc06c050 2024-01-30T08:10:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.972+0000 7fb5f3400640 1 -- 172.21.15.50:0/4283459848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb5ec0073c0 con 0x7fb5fc06c050 2024-01-30T08:10:27.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.972+0000 7fb5f3400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5d4066500 0x7fb5d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:27.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.972+0000 7fb5f3400640 1 -- 172.21.15.50:0/4283459848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb5ec0836b0 con 0x7fb5fc06c050 2024-01-30T08:10:27.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.972+0000 7fb5faa00640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5d4066500 0x7fb5d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.972+0000 7fb5faa00640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5d4066500 0x7fb5d40689c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc15e2f0 tx=0x7fb5e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:27.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:27.976+0000 7fb5f3400640 1 -- 172.21.15.50:0/4283459848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb5fc14f510 con 0x7fb5fc06c050 2024-01-30T08:10:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb5fc14f510 con 0x7fb5fc06c050 2024-01-30T08:10:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb5f3400640 1 -- 172.21.15.50:0/4283459848 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb5fc14f510 con 0x7fb5fc06c050 2024-01-30T08:10:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-01-30T08:10:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5d4066500 msgr2=0x7fb5d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5d4066500 0x7fb5d40689c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc15e2f0 tx=0x7fb5e4008040 comp rx=0 tx=0).stop 2024-01-30T08:10:28.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 msgr2=0x7fb5fc157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc157790 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c420 tx=0x7fb5ec00c8e0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 shutdown_connections 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5fc0c1b70 0x7fb5fc1f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5d4066500 0x7fb5d40689c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb5fc151c10 0x7fb5fc150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 --2- 172.21.15.50:0/4283459848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5fc06c050 0x7fb5fc157790 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 >> 172.21.15.50:0/4283459848 conn(0x7fb5fc06a740 msgr2=0x7fb5fc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 shutdown_connections 2024-01-30T08:10:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.148+0000 7fb602400640 1 -- 172.21.15.50:0/4283459848 wait complete. 2024-01-30T08:10:28.174 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-30T08:10:28.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:28.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:28.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:10:28.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:28.202 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-30T08:10:28.258 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:28.258 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:28.309 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357744k,nr_inodes=4089436,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-30T08:10:28.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-30T08:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa308600640 1 Processor -- start 2024-01-30T08:10:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa308600640 1 -- start start 2024-01-30T08:10:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa308600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa30006de40 0x7fa3000a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa308600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3001584a0 0x7fa30015f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa308600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000c7b40 con 0x7fa30006e220 2024-01-30T08:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa308600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000a7770 con 0x7fa30006de40 2024-01-30T08:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa308600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa300155310 con 0x7fa3001584a0 2024-01-30T08:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa305c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa30006de40 0x7fa3000a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa305c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa30006de40 0x7fa3000a7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33330/0 (socket says 172.21.15.50:33330) 2024-01-30T08:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa305c00640 1 -- 172.21.15.50:0/2614416093 learned_addr learned my addr 172.21.15.50:0/2614416093 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa306600640 1 --2- 172.21.15.50:0/2614416093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3001584a0 0x7fa30015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa305c00640 1 -- 172.21.15.50:0/2614416093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3001584a0 msgr2=0x7fa30015f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa305c00640 1 --2- 172.21.15.50:0/2614416093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3001584a0 0x7fa30015f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa305c00640 1 -- 172.21.15.50:0/2614416093 >> v1:172.21.15.50:6789/0 conn(0x7fa30006e220 legacy=0x7fa300157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.492+0000 7fa305c00640 1 -- 172.21.15.50:0/2614416093 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300155730 con 0x7fa30006de40 2024-01-30T08:10:28.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa305c00640 1 --2- 172.21.15.50:0/2614416093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30006de40 0x7fa3000a7120 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009870 tx=0x7fa2f001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb612184be79bfd server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa2ffe00640 1 -- 172.21.15.50:0/2614416093 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00ab600 con 0x7fa30006de40 2024-01-30T08:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa2ffe00640 1 -- 172.21.15.50:0/2614416093 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f00a7050 con 0x7fa30006de40 2024-01-30T08:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa2ffe00640 1 -- 172.21.15.50:0/2614416093 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00ab980 con 0x7fa30006de40 2024-01-30T08:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 -- 172.21.15.50:0/2614416093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30006de40 msgr2=0x7fa3000a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 --2- 172.21.15.50:0/2614416093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30006de40 0x7fa3000a7120 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009870 tx=0x7fa2f001c540 comp rx=0 tx=0).stop 2024-01-30T08:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 -- 172.21.15.50:0/2614416093 shutdown_connections 2024-01-30T08:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 --2- 172.21.15.50:0/2614416093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3001584a0 0x7fa30015f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 --2- 172.21.15.50:0/2614416093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30006de40 0x7fa3000a7120 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 -- 172.21.15.50:0/2614416093 >> 172.21.15.50:0/2614416093 conn(0x7fa3000c4830 msgr2=0x7fa3000c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 -- 172.21.15.50:0/2614416093 shutdown_connections 2024-01-30T08:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.496+0000 7fa308600640 1 -- 172.21.15.50:0/2614416093 wait complete. 2024-01-30T08:10:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 Processor -- start 2024-01-30T08:10:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 -- start start 2024-01-30T08:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa30006de40 0x7fa30014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa30006e220 0x7fa3000a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3001584a0 0x7fa300156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300145160 con 0x7fa3001584a0 2024-01-30T08:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001f11d0 con 0x7fa30006de40 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001ed1a0 con 0x7fa30006e220 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3001584a0 0x7fa300156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3001584a0 0x7fa300156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33334/0 (socket says 172.21.15.50:33334) 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 -- 172.21.15.50:0/3703701589 learned_addr learned my addr 172.21.15.50:0/3703701589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa305c00640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa30006de40 0x7fa30014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa305200640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa30006e220 0x7fa3000a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 -- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa30006e220 msgr2=0x7fa3000a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa30006e220 0x7fa3000a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 -- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa30006de40 msgr2=0x7fa30014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa30006de40 0x7fa30014a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 -- 172.21.15.50:0/3703701589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00094d0 con 0x7fa3001584a0 2024-01-30T08:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa306600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3001584a0 0x7fa300156b30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800efc0 tx=0x7fa2f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:28.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa2fd600640 1 -- 172.21.15.50:0/3703701589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8009ba0 con 0x7fa3001584a0 2024-01-30T08:10:28.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa2fd600640 1 -- 172.21.15.50:0/3703701589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f800f040 con 0x7fa3001584a0 2024-01-30T08:10:28.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa2fd600640 1 -- 172.21.15.50:0/3703701589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80146c0 con 0x7fa3001584a0 2024-01-30T08:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3001ed480 con 0x7fa3001584a0 2024-01-30T08:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.500+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3001ece10 con 0x7fa3001584a0 2024-01-30T08:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.504+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300074a20 con 0x7fa3001584a0 2024-01-30T08:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.504+0000 7fa2fd600640 1 -- 172.21.15.50:0/3703701589 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa2f8014820 con 0x7fa3001584a0 2024-01-30T08:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.504+0000 7fa2fd600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2d8066500 0x7fa2d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:28.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.504+0000 7fa2fd600640 1 -- 172.21.15.50:0/3703701589 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa2f8084e10 con 0x7fa3001584a0 2024-01-30T08:10:28.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.504+0000 7fa305c00640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2d8066500 0x7fa2d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:28.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.504+0000 7fa305c00640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2d8066500 0x7fa2d80689c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3000aaaf0 tx=0x7fa2f00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.508+0000 7fa2fd600640 1 -- 172.21.15.50:0/3703701589 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa2f8088030 con 0x7fa3001584a0 2024-01-30T08:10:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa30006ee10 con 0x7fa3001584a0 2024-01-30T08:10:28.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa2fd600640 1 -- 172.21.15.50:0/3703701589 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa2f8018020 con 0x7fa3001584a0 2024-01-30T08:10:28.715 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-30T08:10:28.715 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2d8066500 msgr2=0x7fa2d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2d8066500 0x7fa2d80689c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3000aaaf0 tx=0x7fa2f00a6000 comp rx=0 tx=0).stop 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3001584a0 msgr2=0x7fa300156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3001584a0 0x7fa300156b30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800efc0 tx=0x7fa2f800c490 comp rx=0 tx=0).stop 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 shutdown_connections 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa2d8066500 0x7fa2d80689c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3001584a0 0x7fa300156b30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa30006e220 0x7fa3000a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 --2- 172.21.15.50:0/3703701589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa30006de40 0x7fa30014a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 >> 172.21.15.50:0/3703701589 conn(0x7fa3000c4830 msgr2=0x7fa30014d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 shutdown_connections 2024-01-30T08:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:28.712+0000 7fa308600640 1 -- 172.21.15.50:0/3703701589 wait complete. 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-30T08:10:28.737 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.zqriYmqfwN 2024-01-30T08:10:28.737 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-01-30T08:10:28.746 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.5qt0qX7DVU 2024-01-30T08:10:28.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /tmp/tmp.zqriYmqfwN /tmp/tmp.5qt0qX7DVU 2024-01-30T08:10:28.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.5qt0qX7DVU 2024-01-30T08:10:28.934 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.5qt0qX7DVU is 185B 2024-01-30T08:10:28.951 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.5qt0qX7DVU 2024-01-30T08:10:28.959 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDxrrhlN0JGHhAAggUf1rsu9S865GshHeEHzA== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2024-01-30T08:10:28.959 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:10:28.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:28.960 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42381sec preferred_lft 42381sec 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:71:66:23:2b brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-30T08:10:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-01-30T08:10:29.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:29.013 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-30T08:10:29.071 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-01-30T08:10:29.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:29.073 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-01-30T08:10:29.126 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-01-30T08:10:29.126 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-30T08:10:29.126 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-30T08:10:29.126 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-30T08:10:29.127 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-30T08:10:29.127 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-30T08:10:29.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:29.127 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-01-30T08:10:29.127 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-01-30T08:10:29.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-30T08:10:29.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-30T08:10:29.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-30T08:10:29.127 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-01-30T08:10:29.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:29.220 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-01-30T08:10:29.229 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-30T08:10:29.230 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:10:29.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:29.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-01-30T08:10:29.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:29.293 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:29.345 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-30T08:10:29.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-30T08:10:29.345 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-30T08:10:29.396 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:29.397 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/tmp/tmp.zqriYmqfwN of=/dev/stdout 2024-01-30T08:10:29.445 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-30T08:10:29.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:29.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDxrrhlN0JGHhAAggUf1rsu9S865GshHeEHzA==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-01-30T08:10:29.539 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,secret=AQDxrrhlN0JGHhAAggUf1rsu9S865GshHeEHzA==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-01-30T08:10:29.540 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-01-30T08:10:29.540 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:10:29.540 INFO:teuthology.orchestra.run.smithi050.stdout:keyring.get_secret failed 2024-01-30T08:10:29.556 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,secret=AQDxrrhlN0JGHhAAggUf1rsu9S865GshHeEHzA==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-01-30T08:10:29.556 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-01-30T08:10:29.556 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:10:29.556 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:29.556 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:29.556 INFO:teuthology.orchestra.run.smithi050.stdout:keyring.get_secret failed 2024-01-30T08:10:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:mount error: no mds (Metadata Server) is up. The cluster might be laggy, or you may not be authorized 2024-01-30T08:10:29.562 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,secret=AQDxrrhlN0JGHhAAggUf1rsu9S865GshHeEHzA==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-01-30T08:10:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-01-30T08:10:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-01-30T08:10:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.125:3300,172.21.15.125:3301" 2024-01-30T08:10:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-30T08:10:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790" 2024-01-30T08:10:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.125:6789,172.21.15.125:6790:/ 2024-01-30T08:10:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=d5419c7a-21ba-491f-86e9-4d6001549d1c" will pass to kernel 2024-01-30T08:10:29.566 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-30T08:10:29.566 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-01-30T08:10:29.567 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-30T08:10:29.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-30T08:10:29.620 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-30T08:10:29.682 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-30T08:10:29.682 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:29.682 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:29.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357744k,nr_inodes=4089436,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-30T08:10:29.692 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:29.692 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:29.701 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:29.701 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:29.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9178600640 1 Processor -- start 2024-01-30T08:10:29.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9178600640 1 -- start start 2024-01-30T08:10:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9178600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f917006de40 0x7f917006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:29.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9178600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f91700c4310 0x7f9170155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9178600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9170152f00 con 0x7f9170153390 2024-01-30T08:10:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9178600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91701525f0 con 0x7f917006de40 2024-01-30T08:10:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9178600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91700a7680 con 0x7f91700c4310 2024-01-30T08:10:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9175c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f917006de40 0x7f917006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9175200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9170153390 0x7f91700a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45388/0 (socket says 172.21.15.50:45388) 2024-01-30T08:10:29.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9175200640 1 -- 172.21.15.50:0/3841981539 learned_addr learned my addr 172.21.15.50:0/3841981539 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9176600640 1 --2- 172.21.15.50:0/3841981539 >> v2:172.21.15.125:3300/0 conn(0x7f91700c4310 0x7f9170155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9175c00640 1 -- 172.21.15.50:0/3841981539 >> v2:172.21.15.125:3300/0 conn(0x7f91700c4310 msgr2=0x7f9170155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9175c00640 1 --2- 172.21.15.50:0/3841981539 >> v2:172.21.15.125:3300/0 conn(0x7f91700c4310 0x7f9170155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9175c00640 1 -- 172.21.15.50:0/3841981539 >> v1:172.21.15.50:6789/0 conn(0x7f9170153390 legacy=0x7f91700a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9175c00640 1 -- 172.21.15.50:0/3841981539 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91701528b0 con 0x7f917006de40 2024-01-30T08:10:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f916fe00640 1 -- 172.21.15.50:0/3841981539 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386117061 0 0) 0x7f9170152f00 con 0x7f9170153390 2024-01-30T08:10:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.896+0000 7f9176600640 1 --2- 172.21.15.50:0/3841981539 >> v2:172.21.15.125:3300/0 conn(0x7f91700c4310 0x7f9170155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9175c00640 1 --2- 172.21.15.50:0/3841981539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f917006de40 0x7f917006e220 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f91700c7d50 tx=0x7f916001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8becd9ee25fe23de server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f916fe00640 1 -- 172.21.15.50:0/3841981539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600ab600 con 0x7f917006de40 2024-01-30T08:10:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f916fe00640 1 -- 172.21.15.50:0/3841981539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91600a7050 con 0x7f917006de40 2024-01-30T08:10:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f916fe00640 1 -- 172.21.15.50:0/3841981539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600ab980 con 0x7f917006de40 2024-01-30T08:10:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 -- 172.21.15.50:0/3841981539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f917006de40 msgr2=0x7f917006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 --2- 172.21.15.50:0/3841981539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f917006de40 0x7f917006e220 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f91700c7d50 tx=0x7f916001c310 comp rx=0 tx=0).stop 2024-01-30T08:10:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 -- 172.21.15.50:0/3841981539 shutdown_connections 2024-01-30T08:10:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 --2- 172.21.15.50:0/3841981539 >> v2:172.21.15.125:3300/0 conn(0x7f91700c4310 0x7f9170155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 --2- 172.21.15.50:0/3841981539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f917006de40 0x7f917006e220 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 -- 172.21.15.50:0/3841981539 >> 172.21.15.50:0/3841981539 conn(0x7f91700c4830 msgr2=0x7f91700c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 -- 172.21.15.50:0/3841981539 shutdown_connections 2024-01-30T08:10:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.900+0000 7f9178600640 1 -- 172.21.15.50:0/3841981539 wait complete. 2024-01-30T08:10:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 Processor -- start 2024-01-30T08:10:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 -- start start 2024-01-30T08:10:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f917006de40 0x7f91700c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91700c4310 0x7f917014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9170153390 0x7f917014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91701ef010 con 0x7f91700c4310 2024-01-30T08:10:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91700bfe70 con 0x7f9170153390 2024-01-30T08:10:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91700bf8f0 con 0x7f917006de40 2024-01-30T08:10:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91700c4310 0x7f917014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91700c4310 0x7f917014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44152/0 (socket says 172.21.15.50:44152) 2024-01-30T08:10:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 -- 172.21.15.50:0/2860031772 learned_addr learned my addr 172.21.15.50:0/2860031772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9176600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9170153390 0x7f917014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175c00640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f917006de40 0x7f91700c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 -- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f917006de40 msgr2=0x7f91700c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f917006de40 0x7f91700c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 -- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9170153390 msgr2=0x7f917014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9170153390 0x7f917014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 -- 172.21.15.50:0/2860031772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160009420 con 0x7f91700c4310 2024-01-30T08:10:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9175200640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91700c4310 0x7f917014ed60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f915800c450 tx=0x7f915800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f916d600640 1 -- 172.21.15.50:0/2860031772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580074e0 con 0x7f91700c4310 2024-01-30T08:10:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f916d600640 1 -- 172.21.15.50:0/2860031772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9158007640 con 0x7f91700c4310 2024-01-30T08:10:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91701ef280 con 0x7f91700c4310 2024-01-30T08:10:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f916d600640 1 -- 172.21.15.50:0/2860031772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580049f0 con 0x7f91700c4310 2024-01-30T08:10:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.904+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91700c16c0 con 0x7f91700c4310 2024-01-30T08:10:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.908+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91701ef4c0 con 0x7f91700c4310 2024-01-30T08:10:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.908+0000 7f916d600640 1 -- 172.21.15.50:0/2860031772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9158004b50 con 0x7f91700c4310 2024-01-30T08:10:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.908+0000 7f916d600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9148066530 0x7f91480689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.908+0000 7f916d600640 1 -- 172.21.15.50:0/2860031772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f91580837f0 con 0x7f91700c4310 2024-01-30T08:10:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.908+0000 7f9175c00640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9148066530 0x7f91480689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.908+0000 7f9175c00640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9148066530 0x7f91480689f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91600ad000 tx=0x7f9160008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:29.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:29.912+0000 7f916d600640 1 -- 172.21.15.50:0/2860031772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9158050690 con 0x7f91700c4310 2024-01-30T08:10:30.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.076+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9170074a20 con 0x7f91700c4310 2024-01-30T08:10:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.076+0000 7f916d600640 1 -- 172.21.15.50:0/2860031772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20491 (secure 0 0 0) 0x7f9158018090 con 0x7f91700c4310 2024-01-30T08:10:30.079 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:30.079 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:12.907159+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.076+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9148066530 msgr2=0x7f91480689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.076+0000 7f9178600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9148066530 0x7f91480689f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91600ad000 tx=0x7f9160008040 comp rx=0 tx=0).stop 2024-01-30T08:10:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.076+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91700c4310 msgr2=0x7f917014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.076+0000 7f9178600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91700c4310 0x7f917014ed60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f915800c450 tx=0x7f915800c910 comp rx=0 tx=0).stop 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 shutdown_connections 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9170153390 0x7f917014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9148066530 0x7f91480689f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91700c4310 0x7f917014ed60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 --2- 172.21.15.50:0/2860031772 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f917006de40 0x7f91700c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 >> 172.21.15.50:0/2860031772 conn(0x7f91700c4830 msgr2=0x7f91700c3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 shutdown_connections 2024-01-30T08:10:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.080+0000 7f9178600640 1 -- 172.21.15.50:0/2860031772 wait complete. 2024-01-30T08:10:30.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:09:51.121360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:09:52.315187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-30T08:10:09.022581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-30T08:10:10.287235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:10:30.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:10:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4209400640 1 Processor -- start 2024-01-30T08:10:30.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4209400640 1 -- start start 2024-01-30T08:10:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4209400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4204071700 0x7f4204072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4209400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42040c4bb0 0x7f42040a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4209400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42040c0240 con 0x7f4204071320 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4209400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42040c2910 con 0x7f4204071700 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4209400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420406ab20 con 0x7f42040c4bb0 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4201e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4204071700 0x7f4204072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4201e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4204071700 0x7f4204072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44160/0 (socket says 172.21.15.50:44160) 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4201e00640 1 -- 172.21.15.50:0/2335383741 learned_addr learned my addr 172.21.15.50:0/2335383741 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4202800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4204071320 0x7f42040c06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45404/0 (socket says 172.21.15.50:45404) 2024-01-30T08:10:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4203200640 1 --2- 172.21.15.50:0/2335383741 >> v2:172.21.15.125:3300/0 conn(0x7f42040c4bb0 0x7f42040a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4201e00640 1 -- 172.21.15.50:0/2335383741 >> v2:172.21.15.125:3300/0 conn(0x7f42040c4bb0 msgr2=0x7f42040a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4201e00640 1 --2- 172.21.15.50:0/2335383741 >> v2:172.21.15.125:3300/0 conn(0x7f42040c4bb0 0x7f42040a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4201e00640 1 -- 172.21.15.50:0/2335383741 >> v1:172.21.15.50:6789/0 conn(0x7f4204071320 legacy=0x7f42040c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.244+0000 7f4201e00640 1 -- 172.21.15.50:0/2335383741 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420406ae00 con 0x7f4204071700 2024-01-30T08:10:30.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4201e00640 1 --2- 172.21.15.50:0/2335383741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071700 0x7f4204072a70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42040c6b80 tx=0x7f41ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6844872e34fd507e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4201400640 1 -- 172.21.15.50:0/2335383741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0aa650 con 0x7f4204071700 2024-01-30T08:10:30.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4201400640 1 -- 172.21.15.50:0/2335383741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec0aa7b0 con 0x7f4204071700 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4201400640 1 -- 172.21.15.50:0/2335383741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0aab40 con 0x7f4204071700 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 -- 172.21.15.50:0/2335383741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071700 msgr2=0x7f4204072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 --2- 172.21.15.50:0/2335383741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071700 0x7f4204072a70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42040c6b80 tx=0x7f41ec01c4d0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 -- 172.21.15.50:0/2335383741 shutdown_connections 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 --2- 172.21.15.50:0/2335383741 >> v2:172.21.15.125:3300/0 conn(0x7f42040c4bb0 0x7f42040a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 --2- 172.21.15.50:0/2335383741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071700 0x7f4204072a70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 -- 172.21.15.50:0/2335383741 >> 172.21.15.50:0/2335383741 conn(0x7f42040c6c60 msgr2=0x7f42040c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 -- 172.21.15.50:0/2335383741 shutdown_connections 2024-01-30T08:10:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.248+0000 7f4209400640 1 -- 172.21.15.50:0/2335383741 wait complete. 2024-01-30T08:10:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 Processor -- start 2024-01-30T08:10:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 -- start start 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071320 0x7f42041f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4204071700 0x7f42040ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040c4bb0 0x7f420406cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420406e8a0 con 0x7f4204071320 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42041ed650 con 0x7f42040c4bb0 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420406eaf0 con 0x7f4204071700 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071320 0x7f42041f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071320 0x7f42041f11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44174/0 (socket says 172.21.15.50:44174) 2024-01-30T08:10:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 -- 172.21.15.50:0/3770312323 learned_addr learned my addr 172.21.15.50:0/3770312323 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4203200640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040c4bb0 0x7f420406cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4201e00640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4204071700 0x7f42040ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 -- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4204071700 msgr2=0x7f42040ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4204071700 0x7f42040ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 -- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040c4bb0 msgr2=0x7f420406cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040c4bb0 0x7f420406cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 -- 172.21.15.50:0/3770312323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec0094d0 con 0x7f4204071320 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4203200640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040c4bb0 0x7f420406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4201e00640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4204071700 0x7f42040ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4202800640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071320 0x7f42041f11d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c450 tx=0x7f41f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f41faa00640 1 -- 172.21.15.50:0/3770312323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4007480 con 0x7f4204071320 2024-01-30T08:10:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f41faa00640 1 -- 172.21.15.50:0/3770312323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f40075e0 con 0x7f4204071320 2024-01-30T08:10:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420406edd0 con 0x7f4204071320 2024-01-30T08:10:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f41faa00640 1 -- 172.21.15.50:0/3770312323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4004a30 con 0x7f4204071320 2024-01-30T08:10:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.252+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42040ab960 con 0x7f4204071320 2024-01-30T08:10:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.256+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4204074a20 con 0x7f4204071320 2024-01-30T08:10:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.256+0000 7f41faa00640 1 -- 172.21.15.50:0/3770312323 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f41f4004b90 con 0x7f4204071320 2024-01-30T08:10:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.256+0000 7f41faa00640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f41dc066500 0x7f41dc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.256+0000 7f41faa00640 1 -- 172.21.15.50:0/3770312323 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f41f40836f0 con 0x7f4204071320 2024-01-30T08:10:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.256+0000 7f4201e00640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f41dc066500 0x7f41dc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.260+0000 7f4201e00640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f41dc066500 0x7f41dc0689c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0ae000 tx=0x7f41ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.260+0000 7f41faa00640 1 -- 172.21.15.50:0/3770312323 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f41f4050580 con 0x7f4204071320 2024-01-30T08:10:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.420+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f420406b520 con 0x7f4204071320 2024-01-30T08:10:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.420+0000 7f41faa00640 1 -- 172.21.15.50:0/3770312323 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41f4053ba0 con 0x7f4204071320 2024-01-30T08:10:30.425 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:10:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f41dc066500 msgr2=0x7f41dc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f41dc066500 0x7f41dc0689c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0ae000 tx=0x7f41ec008040 comp rx=0 tx=0).stop 2024-01-30T08:10:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071320 msgr2=0x7f42041f11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071320 0x7f42041f11d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c450 tx=0x7f41f400c910 comp rx=0 tx=0).stop 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 shutdown_connections 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040c4bb0 0x7f420406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f41dc066500 0x7f41dc0689c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4204071700 0x7f42040ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 --2- 172.21.15.50:0/3770312323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4204071320 0x7f42041f11d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 >> 172.21.15.50:0/3770312323 conn(0x7f42040c6c60 msgr2=0x7f4204158500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 shutdown_connections 2024-01-30T08:10:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.424+0000 7f4209400640 1 -- 172.21.15.50:0/3770312323 wait complete. 2024-01-30T08:10:30.448 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:10:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.588+0000 7f67ee200640 1 Processor -- start 2024-01-30T08:10:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.588+0000 7f67ee200640 1 -- start start 2024-01-30T08:10:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67ee200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67e8155500 0x7f67e80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67ee200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67e806f6d0 0x7f67e80c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67ee200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e8158b70 con 0x7f67e806f240 2024-01-30T08:10:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67ee200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e806fae0 con 0x7f67e806f6d0 2024-01-30T08:10:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67ee200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e8157f60 con 0x7f67e8155500 2024-01-30T08:10:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67e806f6d0 0x7f67e80c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67e806f6d0 0x7f67e80c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44186/0 (socket says 172.21.15.50:44186) 2024-01-30T08:10:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 -- 172.21.15.50:0/2109555936 learned_addr learned my addr 172.21.15.50:0/2109555936 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7400640 1 --2- 172.21.15.50:0/2109555936 >> v2:172.21.15.125:3300/0 conn(0x7f67e8155500 0x7f67e80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 -- 172.21.15.50:0/2109555936 >> v2:172.21.15.125:3300/0 conn(0x7f67e8155500 msgr2=0x7f67e80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 --2- 172.21.15.50:0/2109555936 >> v2:172.21.15.125:3300/0 conn(0x7f67e8155500 0x7f67e80c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 -- 172.21.15.50:0/2109555936 >> v1:172.21.15.125:6789/0 conn(0x7f67e806f240 legacy=0x7f67e80c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 -- 172.21.15.50:0/2109555936 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e8158240 con 0x7f67e806f6d0 2024-01-30T08:10:30.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.592+0000 7f67e7e00640 1 --2- 172.21.15.50:0/2109555936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e80c1910 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f67e80aaaf0 tx=0x7f67e001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ebf8dbcc90e7e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67e6000640 1 -- 172.21.15.50:0/2109555936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00a5740 con 0x7f67e806f6d0 2024-01-30T08:10:30.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67e6000640 1 -- 172.21.15.50:0/2109555936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e00a58a0 con 0x7f67e806f6d0 2024-01-30T08:10:30.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67e6000640 1 -- 172.21.15.50:0/2109555936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00a5c30 con 0x7f67e806f6d0 2024-01-30T08:10:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- 172.21.15.50:0/2109555936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 msgr2=0x7f67e80c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 --2- 172.21.15.50:0/2109555936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e80c1910 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f67e80aaaf0 tx=0x7f67e001c880 comp rx=0 tx=0).stop 2024-01-30T08:10:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- 172.21.15.50:0/2109555936 shutdown_connections 2024-01-30T08:10:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 --2- 172.21.15.50:0/2109555936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e80c1910 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 --2- 172.21.15.50:0/2109555936 >> v2:172.21.15.125:3300/0 conn(0x7f67e8155500 0x7f67e80c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- 172.21.15.50:0/2109555936 >> 172.21.15.50:0/2109555936 conn(0x7f67e80727c0 msgr2=0x7f67e806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- 172.21.15.50:0/2109555936 shutdown_connections 2024-01-30T08:10:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- 172.21.15.50:0/2109555936 wait complete. 2024-01-30T08:10:30.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 Processor -- start 2024-01-30T08:10:30.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- start start 2024-01-30T08:10:30.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e806f240 0x7f67e814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e8155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e8155500 0x7f67e8156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e814ec50 con 0x7f67e806f6d0 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80c3230 con 0x7f67e806f240 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.596+0000 7f67ee200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80aa120 con 0x7f67e8155500 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e8155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e8155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44188/0 (socket says 172.21.15.50:44188) 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 -- 172.21.15.50:0/2383370466 learned_addr learned my addr 172.21.15.50:0/2383370466 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e7400640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e806f240 0x7f67e814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e7e00640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e8155500 0x7f67e8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 -- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e8155500 msgr2=0x7f67e8156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e8155500 0x7f67e8156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 -- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e806f240 msgr2=0x7f67e814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e806f240 0x7f67e814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 -- 172.21.15.50:0/2383370466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0009b30 con 0x7f67e806f6d0 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67e6a00640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e8155d10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c3a0 tx=0x7f67d000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67df400640 1 -- 172.21.15.50:0/2383370466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00052d0 con 0x7f67e806f6d0 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67df400640 1 -- 172.21.15.50:0/2383370466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0005430 con 0x7f67e806f6d0 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67df400640 1 -- 172.21.15.50:0/2383370466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0007260 con 0x7f67e806f6d0 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e80c3480 con 0x7f67e806f6d0 2024-01-30T08:10:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e80c3a40 con 0x7f67e806f6d0 2024-01-30T08:10:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e8074a20 con 0x7f67e806f6d0 2024-01-30T08:10:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.600+0000 7f67df400640 1 -- 172.21.15.50:0/2383370466 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f67d00073c0 con 0x7f67e806f6d0 2024-01-30T08:10:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.604+0000 7f67df400640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c0066500 0x7f67c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.604+0000 7f67df400640 1 -- 172.21.15.50:0/2383370466 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f67d0083610 con 0x7f67e806f6d0 2024-01-30T08:10:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.604+0000 7f67e7400640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c0066500 0x7f67c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.604+0000 7f67e7400640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c0066500 0x7f67c00689c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f67e80aa820 tx=0x7f67d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.604+0000 7f67df400640 1 -- 172.21.15.50:0/2383370466 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f67d00504b0 con 0x7f67e806f6d0 2024-01-30T08:10:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.764+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67e80c83c0 con 0x7f67e806f6d0 2024-01-30T08:10:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.764+0000 7f67df400640 1 -- 172.21.15.50:0/2383370466 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67d0053ad0 con 0x7f67e806f6d0 2024-01-30T08:10:30.769 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c0066500 msgr2=0x7f67c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c0066500 0x7f67c00689c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f67e80aa820 tx=0x7f67d8008040 comp rx=0 tx=0).stop 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 msgr2=0x7f67e8155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e8155d10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c3a0 tx=0x7f67d000c860 comp rx=0 tx=0).stop 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 shutdown_connections 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f67c0066500 0x7f67c00689c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e8155500 0x7f67e8156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e806f6d0 0x7f67e8155d10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 --2- 172.21.15.50:0/2383370466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e806f240 0x7f67e814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 >> 172.21.15.50:0/2383370466 conn(0x7f67e80727c0 msgr2=0x7f67e80c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 shutdown_connections 2024-01-30T08:10:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.768+0000 7f67ee200640 1 -- 172.21.15.50:0/2383370466 wait complete. 2024-01-30T08:10:30.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:10:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f7196400640 1 Processor -- start 2024-01-30T08:10:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f7196400640 1 -- start start 2024-01-30T08:10:30.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f7196400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71900a4da0 0x7f7190153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f7196400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 0x7f719006ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f7196400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71900c54e0 con 0x7f719014fbf0 2024-01-30T08:10:30.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f7196400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7190152bf0 con 0x7f71900a4da0 2024-01-30T08:10:30.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f7196400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7190072d90 con 0x7f71900c04b0 2024-01-30T08:10:30.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718f400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f719014fbf0 0x7f71900c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45408/0 (socket says 172.21.15.50:45408) 2024-01-30T08:10:30.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718f400640 1 -- 172.21.15.50:0/1780121391 learned_addr learned my addr 172.21.15.50:0/1780121391 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:30.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718fe00640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 0x7f719006ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718ea00640 1 --2- 172.21.15.50:0/1780121391 >> v2:172.21.15.125:3300/0 conn(0x7f71900a4da0 0x7f7190153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882880599 0 0) 0x7f71900c54e0 con 0x7f719014fbf0 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7170003530 con 0x7f719014fbf0 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3492229812 0 0) 0x7f7170003530 con 0x7f719014fbf0 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 msgr2=0x7f719006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 0x7f719006ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 >> v2:172.21.15.125:3300/0 conn(0x7f71900a4da0 msgr2=0x7f7190153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 --2- 172.21.15.50:0/1780121391 >> v2:172.21.15.125:3300/0 conn(0x7f71900a4da0 0x7f7190153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71901525e0 con 0x7f719014fbf0 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f7180001680 con 0x7f719014fbf0 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 >> v1:172.21.15.50:6789/0 conn(0x7f719014fbf0 legacy=0x7f71900c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7170003980 0x7f7170003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 0x7f71700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7170004d10 0x7f7170005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190152bf0 con 0x7f7170004d10 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190072d90 con 0x7f7170003980 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717000b990 con 0x7f71900c04b0 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718fe00640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7170004d10 0x7f7170005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718ea00640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 0x7f71700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718f400640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7170003980 0x7f7170003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718fe00640 1 -- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 msgr2=0x7f71700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718fe00640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71900c04b0 0x7f71700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718fe00640 1 -- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7170003980 msgr2=0x7f7170003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718fe00640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7170003980 0x7f7170003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.936+0000 7f718fe00640 1 -- 172.21.15.50:0/1780121391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170003530 con 0x7f7170004d10 2024-01-30T08:10:30.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f718fe00640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7170004d10 0x7f7170005190 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7188009fc0 tx=0x7f718801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2f1c72e12fd00d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880a5c70 con 0x7f7170004d10 2024-01-30T08:10:30.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718800f040 con 0x7f7170004d10 2024-01-30T08:10:30.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f718e000640 1 -- 172.21.15.50:0/1780121391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880ad440 con 0x7f7170004d10 2024-01-30T08:10:30.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f7196400640 1 -- 172.21.15.50:0/1780121391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7170004d10 msgr2=0x7f7170005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f7196400640 1 --2- 172.21.15.50:0/1780121391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7170004d10 0x7f7170005190 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7188009fc0 tx=0x7f718801cc60 comp rx=0 tx=0).stop 2024-01-30T08:10:30.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f718fe00640 1 -- 172.21.15.50:0/1780121391 reap_dead start 2024-01-30T08:10:30.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f7196400640 1 -- 172.21.15.50:0/1780121391 shutdown_connections 2024-01-30T08:10:30.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.940+0000 7f7196400640 1 -- 172.21.15.50:0/1780121391 >> 172.21.15.50:0/1780121391 conn(0x7f71900c5b30 msgr2=0x7f71900c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:30.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 -- 172.21.15.50:0/1780121391 shutdown_connections 2024-01-30T08:10:30.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 -- 172.21.15.50:0/1780121391 wait complete. 2024-01-30T08:10:30.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 Processor -- start 2024-01-30T08:10:30.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 -- start start 2024-01-30T08:10:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7170004d10 0x7f71901e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7190155c70 0x7f71900a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71900a9e90 0x7f71901eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71900bafe0 con 0x7f7190155c70 2024-01-30T08:10:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71901557e0 con 0x7f71900a9e90 2024-01-30T08:10:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71901563a0 con 0x7f7170004d10 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7190155c70 0x7f71900a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7190155c70 0x7f71900a8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44210/0 (socket says 172.21.15.50:44210) 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 -- 172.21.15.50:0/1892292111 learned_addr learned my addr 172.21.15.50:0/1892292111 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718fe00640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71900a9e90 0x7f71901eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718f400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7170004d10 0x7f71901e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 -- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7170004d10 msgr2=0x7f71901e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7170004d10 0x7f71901e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 -- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71900a9e90 msgr2=0x7f71901eb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71900a9e90 0x7f71901eb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 -- 172.21.15.50:0/1892292111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190154bd0 con 0x7f7190155c70 2024-01-30T08:10:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f718ea00640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7190155c70 0x7f71900a8f10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7178011ad0 tx=0x7f7178011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7187400640 1 -- 172.21.15.50:0/1892292111 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717800faf0 con 0x7f7190155c70 2024-01-30T08:10:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7187400640 1 -- 172.21.15.50:0/1892292111 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717800fc50 con 0x7f7190155c70 2024-01-30T08:10:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7187400640 1 -- 172.21.15.50:0/1892292111 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178014440 con 0x7f7190155c70 2024-01-30T08:10:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.944+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7190154eb0 con 0x7f7190155c70 2024-01-30T08:10:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.948+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7190155470 con 0x7f7190155c70 2024-01-30T08:10:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.948+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7190155990 con 0x7f7190155c70 2024-01-30T08:10:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.948+0000 7f7187400640 1 -- 172.21.15.50:0/1892292111 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f71780145a0 con 0x7f7190155c70 2024-01-30T08:10:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.948+0000 7f7187400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7168066530 0x7f71680689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.948+0000 7f7187400640 1 -- 172.21.15.50:0/1892292111 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f7178084ad0 con 0x7f7190155c70 2024-01-30T08:10:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.948+0000 7f718f400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7168066530 0x7f71680689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.948+0000 7f718f400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7168066530 0x7f71680689f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7180001060 tx=0x7f7180007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:30.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:30.952+0000 7f7187400640 1 -- 172.21.15.50:0/1892292111 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7190155990 con 0x7f7190155c70 2024-01-30T08:10:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7190155990 con 0x7f7190155c70 2024-01-30T08:10:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7187400640 1 -- 172.21.15.50:0/1892292111 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7190155990 con 0x7f7190155c70 2024-01-30T08:10:31.118 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7168066530 msgr2=0x7f71680689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7168066530 0x7f71680689f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7180001060 tx=0x7f7180007900 comp rx=0 tx=0).stop 2024-01-30T08:10:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7190155c70 msgr2=0x7f71900a8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7190155c70 0x7f71900a8f10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7178011ad0 tx=0x7f7178011ed0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 shutdown_connections 2024-01-30T08:10:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71900a9e90 0x7f71901eb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7168066530 0x7f71680689f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7190155c70 0x7f71900a8f10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 --2- 172.21.15.50:0/1892292111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7170004d10 0x7f71901e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 >> 172.21.15.50:0/1892292111 conn(0x7f71900c5b30 msgr2=0x7f71900c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 shutdown_connections 2024-01-30T08:10:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.116+0000 7f7196400640 1 -- 172.21.15.50:0/1892292111 wait complete. 2024-01-30T08:10:31.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-30T08:10:31.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.280+0000 7f7333a00640 1 Processor -- start 2024-01-30T08:10:31.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.280+0000 7f7333a00640 1 -- start start 2024-01-30T08:10:31.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7333a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f732c072b60 0x7f732c0a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7333a00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f732c06bfe0 0x7f732c0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7333a00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c06c4c0 con 0x7f732c0a51e0 2024-01-30T08:10:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7333a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c0c0550 con 0x7f732c072b60 2024-01-30T08:10:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7333a00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c0c07c0 con 0x7f732c06bfe0 2024-01-30T08:10:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7331000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f732c072b60 0x7f732c0a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7331000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f732c072b60 0x7f732c0a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44220/0 (socket says 172.21.15.50:44220) 2024-01-30T08:10:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7331000640 1 -- 172.21.15.50:0/955165600 learned_addr learned my addr 172.21.15.50:0/955165600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:31.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7331000640 1 -- 172.21.15.50:0/955165600 >> v2:172.21.15.125:3300/0 conn(0x7f732c06bfe0 msgr2=0x7f732c0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:31.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f732be00640 1 --2- 172.21.15.50:0/955165600 >> v2:172.21.15.125:3300/0 conn(0x7f732c06bfe0 0x7f732c0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7331000640 1 --2- 172.21.15.50:0/955165600 >> v2:172.21.15.125:3300/0 conn(0x7f732c06bfe0 0x7f732c0c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7331000640 1 -- 172.21.15.50:0/955165600 >> v1:172.21.15.125:6789/0 conn(0x7f732c0a51e0 legacy=0x7f732c0c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f7331000640 1 -- 172.21.15.50:0/955165600 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0c0aa0 con 0x7f732c072b60 2024-01-30T08:10:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.284+0000 7f732be00640 1 --2- 172.21.15.50:0/955165600 >> v2:172.21.15.125:3300/0 conn(0x7f732c06bfe0 0x7f732c0c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7331000640 1 --2- 172.21.15.50:0/955165600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c0a4ca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f732c06b640 tx=0x7f731c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b09c6b2b1832142 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f732b400640 1 -- 172.21.15.50:0/955165600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0ad640 con 0x7f732c072b60 2024-01-30T08:10:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f732b400640 1 -- 172.21.15.50:0/955165600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c0ad7a0 con 0x7f732c072b60 2024-01-30T08:10:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f732b400640 1 -- 172.21.15.50:0/955165600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0adb30 con 0x7f732c072b60 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 -- 172.21.15.50:0/955165600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 msgr2=0x7f732c0a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 --2- 172.21.15.50:0/955165600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c0a4ca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f732c06b640 tx=0x7f731c01c370 comp rx=0 tx=0).stop 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 -- 172.21.15.50:0/955165600 shutdown_connections 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 --2- 172.21.15.50:0/955165600 >> v2:172.21.15.125:3300/0 conn(0x7f732c06bfe0 0x7f732c0c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 --2- 172.21.15.50:0/955165600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c0a4ca0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 -- 172.21.15.50:0/955165600 >> 172.21.15.50:0/955165600 conn(0x7f732c0c5b30 msgr2=0x7f732c0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 -- 172.21.15.50:0/955165600 shutdown_connections 2024-01-30T08:10:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 -- 172.21.15.50:0/955165600 wait complete. 2024-01-30T08:10:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 Processor -- start 2024-01-30T08:10:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.288+0000 7f7333a00640 1 -- start start 2024-01-30T08:10:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f732c06bfe0 0x7f732c1f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f732c0a51e0 0x7f732c143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c15a0f0 con 0x7f732c072b60 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c15e240 con 0x7f732c0a51e0 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c15a390 con 0x7f732c06bfe0 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f732be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f732c06bfe0 0x7f732c1f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f732be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c14afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44224/0 (socket says 172.21.15.50:44224) 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f732be00640 1 -- 172.21.15.50:0/1126131272 learned_addr learned my addr 172.21.15.50:0/1126131272 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331a00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f732c0a51e0 0x7f732c143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331000640 1 -- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f732c0a51e0 msgr2=0x7f732c143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331000640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f732c0a51e0 0x7f732c143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331000640 1 -- 172.21.15.50:0/1126131272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 msgr2=0x7f732c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331000640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331000640 1 -- 172.21.15.50:0/1126131272 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0094d0 con 0x7f732c06bfe0 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f732be00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7331000640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f732c06bfe0 0x7f732c1f05f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f731c0ac000 tx=0x7f731c019110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7328c00640 1 -- 172.21.15.50:0/1126131272 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0bc070 con 0x7f732c06bfe0 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7328c00640 1 -- 172.21.15.50:0/1126131272 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c0a6040 con 0x7f732c06bfe0 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7328c00640 1 -- 172.21.15.50:0/1126131272 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0b6850 con 0x7f732c06bfe0 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c15a670 con 0x7f732c06bfe0 2024-01-30T08:10:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c1473e0 con 0x7f732c06bfe0 2024-01-30T08:10:31.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.292+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c074a20 con 0x7f732c06bfe0 2024-01-30T08:10:31.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.296+0000 7f7328c00640 1 -- 172.21.15.50:0/1126131272 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f731c0b4070 con 0x7f732c06bfe0 2024-01-30T08:10:31.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.296+0000 7f7328c00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7304066500 0x7f73040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.296+0000 7f7328c00640 1 -- 172.21.15.50:0/1126131272 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f731c11e120 con 0x7f732c06bfe0 2024-01-30T08:10:31.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.296+0000 7f732be00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7304066500 0x7f73040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.296+0000 7f732be00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7304066500 0x7f73040689c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f732c0c4e80 tx=0x7f7314008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.300+0000 7f7328c00640 1 -- 172.21.15.50:0/1126131272 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f731c0eaf70 con 0x7f732c06bfe0 2024-01-30T08:10:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.464+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f732c074a20 con 0x7f732c06bfe0 2024-01-30T08:10:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7328c00640 1 -- 172.21.15.50:0/1126131272 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f731c0ee590 con 0x7f732c06bfe0 2024-01-30T08:10:31.470 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7304066500 msgr2=0x7f73040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7304066500 0x7f73040689c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f732c0c4e80 tx=0x7f7314008040 comp rx=0 tx=0).stop 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f732c06bfe0 msgr2=0x7f732c1f05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f732c06bfe0 0x7f732c1f05f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f731c0ac000 tx=0x7f731c019110 comp rx=0 tx=0).stop 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 shutdown_connections 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f732c0a51e0 0x7f732c143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7304066500 0x7f73040689c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c072b60 0x7f732c14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 --2- 172.21.15.50:0/1126131272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f732c06bfe0 0x7f732c1f05f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 >> 172.21.15.50:0/1126131272 conn(0x7f732c0c5b30 msgr2=0x7f732c0c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 shutdown_connections 2024-01-30T08:10:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.468+0000 7f7333a00640 1 -- 172.21.15.50:0/1126131272 wait complete. 2024-01-30T08:10:31.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-30T08:10:31.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f5755a00640 1 Processor -- start 2024-01-30T08:10:31.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f5755a00640 1 -- start start 2024-01-30T08:10:31.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f5755a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f575006bfe0 0x7f57500c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f5755a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57500c3c50 0x7f57500c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f5755a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575006c4c0 con 0x7f5750072b60 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f5755a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500c0550 con 0x7f575006bfe0 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f5755a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57500c07c0 con 0x7f57500c3c50 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574e000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f575006bfe0 0x7f57500c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574ea00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5750072b60 0x7f57500a4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45416/0 (socket says 172.21.15.50:45416) 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574ea00640 1 -- 172.21.15.50:0/3826879336 learned_addr learned my addr 172.21.15.50:0/3826879336 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574f400640 1 --2- 172.21.15.50:0/3826879336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57500c3c50 0x7f57500c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574d600640 1 -- 172.21.15.50:0/3826879336 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942867675 0 0) 0x7f575006c4c0 con 0x7f5750072b60 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574d600640 1 -- 172.21.15.50:0/3826879336 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5730005740 con 0x7f5750072b60 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574e000640 1 -- 172.21.15.50:0/3826879336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57500c3c50 msgr2=0x7f57500c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574e000640 1 --2- 172.21.15.50:0/3826879336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57500c3c50 0x7f57500c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574e000640 1 -- 172.21.15.50:0/3826879336 >> v1:172.21.15.50:6789/0 conn(0x7f5750072b60 legacy=0x7f57500a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574e000640 1 -- 172.21.15.50:0/3826879336 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500c0aa0 con 0x7f575006bfe0 2024-01-30T08:10:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.636+0000 7f574f400640 1 --2- 172.21.15.50:0/3826879336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57500c3c50 0x7f57500c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f574e000640 1 --2- 172.21.15.50:0/3826879336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57500c12a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f57380097c0 tx=0x7f573801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bbc97c226565f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f574d600640 1 -- 172.21.15.50:0/3826879336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380ad660 con 0x7f575006bfe0 2024-01-30T08:10:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f574d600640 1 -- 172.21.15.50:0/3826879336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57380ad7c0 con 0x7f575006bfe0 2024-01-30T08:10:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f574d600640 1 -- 172.21.15.50:0/3826879336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380adb50 con 0x7f575006bfe0 2024-01-30T08:10:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 -- 172.21.15.50:0/3826879336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 msgr2=0x7f57500c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 --2- 172.21.15.50:0/3826879336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57500c12a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f57380097c0 tx=0x7f573801c3c0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 -- 172.21.15.50:0/3826879336 shutdown_connections 2024-01-30T08:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 --2- 172.21.15.50:0/3826879336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57500c3c50 0x7f57500c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 --2- 172.21.15.50:0/3826879336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57500c12a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 -- 172.21.15.50:0/3826879336 >> 172.21.15.50:0/3826879336 conn(0x7f57500c5b30 msgr2=0x7f57500c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 -- 172.21.15.50:0/3826879336 shutdown_connections 2024-01-30T08:10:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.640+0000 7f5755a00640 1 -- 172.21.15.50:0/3826879336 wait complete. 2024-01-30T08:10:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 Processor -- start 2024-01-30T08:10:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 -- start start 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57501440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5750072b60 0x7f575014aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57500c3c50 0x7f575014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57501500a0 con 0x7f575006bfe0 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5750150660 con 0x7f57500c3c50 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575014f300 con 0x7f5750072b60 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57501440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57501440f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44234/0 (socket says 172.21.15.50:44234) 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 -- 172.21.15.50:0/2938050287 learned_addr learned my addr 172.21.15.50:0/2938050287 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574f400640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57500c3c50 0x7f575014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574e000640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5750072b60 0x7f575014aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 -- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5750072b60 msgr2=0x7f575014aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5750072b60 0x7f575014aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 -- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57500c3c50 msgr2=0x7f575014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57500c3c50 0x7f575014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 -- 172.21.15.50:0/2938050287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738009420 con 0x7f575006bfe0 2024-01-30T08:10:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f574ea00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57501440f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f574000c460 tx=0x7f574000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5746a00640 1 -- 172.21.15.50:0/2938050287 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5740005cf0 con 0x7f575006bfe0 2024-01-30T08:10:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5746a00640 1 -- 172.21.15.50:0/2938050287 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5740005e70 con 0x7f575006bfe0 2024-01-30T08:10:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5746a00640 1 -- 172.21.15.50:0/2938050287 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5740007270 con 0x7f575006bfe0 2024-01-30T08:10:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575014f5e0 con 0x7f575006bfe0 2024-01-30T08:10:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5750144630 con 0x7f575006bfe0 2024-01-30T08:10:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.644+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5750074a20 con 0x7f575006bfe0 2024-01-30T08:10:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.648+0000 7f5746a00640 1 -- 172.21.15.50:0/2938050287 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f57400073d0 con 0x7f575006bfe0 2024-01-30T08:10:31.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.648+0000 7f5746a00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5728066500 0x7f57280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.648+0000 7f5746a00640 1 -- 172.21.15.50:0/2938050287 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f5740083910 con 0x7f575006bfe0 2024-01-30T08:10:31.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.648+0000 7f574e000640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5728066500 0x7f57280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.648+0000 7f574e000640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5728066500 0x7f57280689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f57380af000 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:31.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.652+0000 7f5746a00640 1 -- 172.21.15.50:0/2938050287 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f57400506b0 con 0x7f575006bfe0 2024-01-30T08:10:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.808+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f57500c5580 con 0x7f575006bfe0 2024-01-30T08:10:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.808+0000 7f5746a00640 1 -- 172.21.15.50:0/2938050287 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f57400170a0 con 0x7f575006bfe0 2024-01-30T08:10:31.813 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5728066500 msgr2=0x7f57280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5728066500 0x7f57280689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f57380af000 tx=0x7f5738008040 comp rx=0 tx=0).stop 2024-01-30T08:10:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 msgr2=0x7f57501440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57501440f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f574000c460 tx=0x7f574000c920 comp rx=0 tx=0).stop 2024-01-30T08:10:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 shutdown_connections 2024-01-30T08:10:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57500c3c50 0x7f575014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5728066500 0x7f57280689c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5750072b60 0x7f575014aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 --2- 172.21.15.50:0/2938050287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575006bfe0 0x7f57501440f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 >> 172.21.15.50:0/2938050287 conn(0x7f57500c5b30 msgr2=0x7f57500c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 shutdown_connections 2024-01-30T08:10:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.812+0000 7f5755a00640 1 -- 172.21.15.50:0/2938050287 wait complete. 2024-01-30T08:10:31.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-30T08:10:31.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.980+0000 7f7cc0200640 1 Processor -- start 2024-01-30T08:10:31.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cc0200640 1 -- start start 2024-01-30T08:10:31.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cc0200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb80c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cc0200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cb806dc50 0x7f7cb8152660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cc0200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80c0980 con 0x7f7cb80a4dc0 2024-01-30T08:10:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cc0200640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb81564e0 con 0x7f7cb806dc50 2024-01-30T08:10:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cc0200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8156780 con 0x7f7cb814fbb0 2024-01-30T08:10:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbe200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cb806dc50 0x7f7cb8152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbe200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cb806dc50 0x7f7cb8152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44240/0 (socket says 172.21.15.50:44240) 2024-01-30T08:10:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbe200640 1 -- 172.21.15.50:0/1364080107 learned_addr learned my addr 172.21.15.50:0/1364080107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbd800640 1 --2- 172.21.15.50:0/1364080107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb80c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbe200640 1 -- 172.21.15.50:0/1364080107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 msgr2=0x7f7cb80c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbe200640 1 --2- 172.21.15.50:0/1364080107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb80c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbe200640 1 -- 172.21.15.50:0/1364080107 >> v1:172.21.15.125:6789/0 conn(0x7f7cb80a4dc0 legacy=0x7f7cb806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.984+0000 7f7cbe200640 1 -- 172.21.15.50:0/1364080107 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80c0610 con 0x7f7cb806dc50 2024-01-30T08:10:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cbe200640 1 --2- 172.21.15.50:0/1364080107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb8152660 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009e50 tx=0x7f7cb001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197fe492d0efa74d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cb7e00640 1 -- 172.21.15.50:0/1364080107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb81533b0 con 0x7f7cb806dc50 2024-01-30T08:10:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cb7e00640 1 -- 172.21.15.50:0/1364080107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb00a57f0 con 0x7f7cb806dc50 2024-01-30T08:10:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cb7e00640 1 -- 172.21.15.50:0/1364080107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00a5b80 con 0x7f7cb806dc50 2024-01-30T08:10:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 -- 172.21.15.50:0/1364080107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 msgr2=0x7f7cb8152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1364080107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb8152660 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009e50 tx=0x7f7cb001ca10 comp rx=0 tx=0).stop 2024-01-30T08:10:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 -- 172.21.15.50:0/1364080107 shutdown_connections 2024-01-30T08:10:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1364080107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb8152660 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1364080107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb80c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 -- 172.21.15.50:0/1364080107 >> 172.21.15.50:0/1364080107 conn(0x7f7cb80c5f10 msgr2=0x7f7cb80c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 -- 172.21.15.50:0/1364080107 shutdown_connections 2024-01-30T08:10:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 -- 172.21.15.50:0/1364080107 wait complete. 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.988+0000 7f7cc0200640 1 Processor -- start 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 -- start start 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb80a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb80a4dc0 0x7f7cb81458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb8145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81ed1e0 con 0x7f7cb806dc50 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81ee040 con 0x7f7cb80a4dc0 2024-01-30T08:10:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80aa260 con 0x7f7cb814fbb0 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb80a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb80a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44252/0 (socket says 172.21.15.50:44252) 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 -- 172.21.15.50:0/1036707260 learned_addr learned my addr 172.21.15.50:0/1036707260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbe200640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb8145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbce00640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb80a4dc0 0x7f7cb81458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 -- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 msgr2=0x7f7cb8145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb8145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 -- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb80a4dc0 msgr2=0x7f7cb81458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb80a4dc0 0x7f7cb81458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 -- 172.21.15.50:0/1036707260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0009b30 con 0x7f7cb806dc50 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cbd800640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb80a8ab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800d650 tx=0x7f7ca800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cb5600640 1 -- 172.21.15.50:0/1036707260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800b660 con 0x7f7cb806dc50 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cb5600640 1 -- 172.21.15.50:0/1036707260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800b7c0 con 0x7f7cb806dc50 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cb5600640 1 -- 172.21.15.50:0/1036707260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800bb50 con 0x7f7cb806dc50 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb81ed430 con 0x7f7cb806dc50 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb81ed9f0 con 0x7f7cb806dc50 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.992+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb81ee180 con 0x7f7cb806dc50 2024-01-30T08:10:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.996+0000 7f7cb5600640 1 -- 172.21.15.50:0/1036707260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7ca800bcb0 con 0x7f7cb806dc50 2024-01-30T08:10:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.996+0000 7f7cb5600640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7c90066500 0x7f7c900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.996+0000 7f7cb5600640 1 -- 172.21.15.50:0/1036707260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f7ca80846b0 con 0x7f7cb806dc50 2024-01-30T08:10:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.996+0000 7f7cbce00640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7c90066500 0x7f7c900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:31.996+0000 7f7cbce00640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7c90066500 0x7f7c900689c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806adc0 tx=0x7f7ca0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.000+0000 7f7cb5600640 1 -- 172.21.15.50:0/1036707260 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7ca8051500 con 0x7f7cb806dc50 2024-01-30T08:10:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.172+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7cb806da30 con 0x7f7cb806dc50 2024-01-30T08:10:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.172+0000 7f7cb5600640 1 -- 172.21.15.50:0/1036707260 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7ca8007380 con 0x7f7cb806dc50 2024-01-30T08:10:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7c90066500 msgr2=0x7f7c900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7c90066500 0x7f7c900689c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806adc0 tx=0x7f7ca0009040 comp rx=0 tx=0).stop 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 msgr2=0x7f7cb80a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb80a8ab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800d650 tx=0x7f7ca800db10 comp rx=0 tx=0).stop 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 shutdown_connections 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb80a4dc0 0x7f7cb81458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7c90066500 0x7f7c900689c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb814fbb0 0x7f7cb8145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 --2- 172.21.15.50:0/1036707260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb806dc50 0x7f7cb80a8ab0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 >> 172.21.15.50:0/1036707260 conn(0x7f7cb80c5f10 msgr2=0x7f7cb815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 shutdown_connections 2024-01-30T08:10:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.176+0000 7f7cc0200640 1 -- 172.21.15.50:0/1036707260 wait complete. 2024-01-30T08:10:32.198 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-30T08:10:32.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:32.199 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-30T08:10:32.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:10:32.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:32.227 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-30T08:10:32.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f288b400640 1 Processor -- start 2024-01-30T08:10:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f288b400640 1 -- start start 2024-01-30T08:10:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f288b400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840729a0 0x7f288415c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f288b400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840c3e40 con 0x7f28840c4e00 2024-01-30T08:10:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f288b400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840a8c20 con 0x7f28840a4e50 2024-01-30T08:10:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f288b400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c42d0 con 0x7f28840729a0 2024-01-30T08:10:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2888a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28840c4e00 0x7f28840a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45432/0 (socket says 172.21.15.50:45432) 2024-01-30T08:10:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2888a00640 1 -- 172.21.15.50:0/4016661323 learned_addr learned my addr 172.21.15.50:0/4016661323 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2889400640 1 --2- 172.21.15.50:0/4016661323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840729a0 0x7f288415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863798529 0 0) 0x7f28840c3e40 con 0x7f28840c4e00 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2864003450 con 0x7f28840c4e00 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378432007 0 0) 0x7f28840a8c20 con 0x7f28840a4e50 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28840c3e40 con 0x7f28840a4e50 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1973206092 0 0) 0x7f2864003450 con 0x7f28840c4e00 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2889400640 1 -- 172.21.15.50:0/4016661323 >> v1:172.21.15.125:6789/0 conn(0x7f28840a4e50 legacy=0x7f2884158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2889400640 1 -- 172.21.15.50:0/4016661323 >> v1:172.21.15.50:6789/0 conn(0x7f28840c4e00 legacy=0x7f28840a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.424+0000 7f2889400640 1 -- 172.21.15.50:0/4016661323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840c3b10 con 0x7f28840729a0 2024-01-30T08:10:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f2889400640 1 --2- 172.21.15.50:0/4016661323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840729a0 0x7f288415c130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f287c009dc0 tx=0x7f287c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ab1b47886bd005 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874001680 con 0x7f28840729a0 2024-01-30T08:10:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0a6510 con 0x7f28840729a0 2024-01-30T08:10:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f2883400640 1 -- 172.21.15.50:0/4016661323 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0a6880 con 0x7f28840729a0 2024-01-30T08:10:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f288b400640 1 -- 172.21.15.50:0/4016661323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840729a0 msgr2=0x7f288415c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f288b400640 1 --2- 172.21.15.50:0/4016661323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840729a0 0x7f288415c130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f287c009dc0 tx=0x7f287c01c890 comp rx=0 tx=0).stop 2024-01-30T08:10:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f288b400640 1 -- 172.21.15.50:0/4016661323 shutdown_connections 2024-01-30T08:10:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f288b400640 1 --2- 172.21.15.50:0/4016661323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840729a0 0x7f288415c130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f288b400640 1 -- 172.21.15.50:0/4016661323 >> 172.21.15.50:0/4016661323 conn(0x7f28840c5b50 msgr2=0x7f28840c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f288b400640 1 -- 172.21.15.50:0/4016661323 shutdown_connections 2024-01-30T08:10:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.428+0000 7f288b400640 1 -- 172.21.15.50:0/4016661323 wait complete. 2024-01-30T08:10:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 Processor -- start 2024-01-30T08:10:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 -- start start 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28840729a0 0x7f288414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840a4e50 0x7f2884157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28840c4e00 0x7f28841521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884153530 con 0x7f28840729a0 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28841f0b90 con 0x7f28840c4e00 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28841efdd0 con 0x7f28840a4e50 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28840729a0 0x7f288414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28840729a0 0x7f288414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44268/0 (socket says 172.21.15.50:44268) 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 -- 172.21.15.50:0/2247297745 learned_addr learned my addr 172.21.15.50:0/2247297745 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2883e00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840a4e50 0x7f2884157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2889400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28840c4e00 0x7f28841521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 -- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840a4e50 msgr2=0x7f2884157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840a4e50 0x7f2884157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 -- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28840c4e00 msgr2=0x7f28841521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28840c4e00 0x7f28841521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 -- 172.21.15.50:0/2247297745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c009a70 con 0x7f28840729a0 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2883e00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840a4e50 0x7f2884157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2889400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28840c4e00 0x7f28841521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2888a00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28840729a0 0x7f288414fd50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f287400c700 tx=0x7f287400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2880c00640 1 -- 172.21.15.50:0/2247297745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874005ae0 con 0x7f28840729a0 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2880c00640 1 -- 172.21.15.50:0/2247297745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874005c40 con 0x7f28840729a0 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f2880c00640 1 -- 172.21.15.50:0/2247297745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874007270 con 0x7f28840729a0 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28841f00b0 con 0x7f28840729a0 2024-01-30T08:10:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.432+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28841f0670 con 0x7f28840729a0 2024-01-30T08:10:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.436+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28841f0890 con 0x7f28840729a0 2024-01-30T08:10:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.436+0000 7f2880c00640 1 -- 172.21.15.50:0/2247297745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f28740073d0 con 0x7f28840729a0 2024-01-30T08:10:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.436+0000 7f2880c00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f285c066500 0x7f285c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.436+0000 7f2880c00640 1 -- 172.21.15.50:0/2247297745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f2874083990 con 0x7f28840729a0 2024-01-30T08:10:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.436+0000 7f2883e00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f285c066500 0x7f285c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.436+0000 7f2883e00640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f285c066500 0x7f285c0689c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f28840c0e10 tx=0x7f286c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.440+0000 7f2880c00640 1 -- 172.21.15.50:0/2247297745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2874050760 con 0x7f28840729a0 2024-01-30T08:10:32.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.628+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2884074a20 con 0x7f28840729a0 2024-01-30T08:10:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f2880c00640 1 -- 172.21.15.50:0/2247297745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f2874053d80 con 0x7f28840729a0 2024-01-30T08:10:32.634 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:32.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:09:53.316367+0000","modified":"2024-01-30T08:09:56.334652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1837689837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1837689837},{"type":"v1","addr":"172.21.15.50:6835","nonce":1837689837}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-01-30T08:10:32.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f285c066500 msgr2=0x7f285c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f285c066500 0x7f285c0689c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f28840c0e10 tx=0x7f286c009040 comp rx=0 tx=0).stop 2024-01-30T08:10:32.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28840729a0 msgr2=0x7f288414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28840729a0 0x7f288414fd50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f287400c700 tx=0x7f287400cbc0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 shutdown_connections 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28840c4e00 0x7f28841521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f285c066500 0x7f285c0689c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28840a4e50 0x7f2884157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 --2- 172.21.15.50:0/2247297745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28840729a0 0x7f288414fd50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 >> 172.21.15.50:0/2247297745 conn(0x7f28840c5b50 msgr2=0x7f28840c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 shutdown_connections 2024-01-30T08:10:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.632+0000 7f288b400640 1 -- 172.21.15.50:0/2247297745 wait complete. 2024-01-30T08:10:32.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426f600640 1 Processor -- start 2024-01-30T08:10:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426f600640 1 -- start start 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426f600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42680c4bb0 0x7f4268158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426f600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42680c64a0 0x7f4268158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426f600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4268157c60 con 0x7f4268151d80 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426f600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4268152160 con 0x7f42680c64a0 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426f600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42680c35f0 con 0x7f42680c4bb0 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426d600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42680c64a0 0x7f4268158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426d600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42680c64a0 0x7f4268158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44274/0 (socket says 172.21.15.50:44274) 2024-01-30T08:10:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426d600640 1 -- 172.21.15.50:0/3928838742 learned_addr learned my addr 172.21.15.50:0/3928838742 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f4267e00640 1 --2- 172.21.15.50:0/3928838742 >> v2:172.21.15.125:3300/0 conn(0x7f42680c4bb0 0x7f4268158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426d600640 1 -- 172.21.15.50:0/3928838742 >> v2:172.21.15.125:3300/0 conn(0x7f42680c4bb0 msgr2=0x7f4268158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426d600640 1 --2- 172.21.15.50:0/3928838742 >> v2:172.21.15.125:3300/0 conn(0x7f42680c4bb0 0x7f4268158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426d600640 1 -- 172.21.15.50:0/3928838742 >> v1:172.21.15.125:6789/0 conn(0x7f4268151d80 legacy=0x7f42680c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.796+0000 7f426d600640 1 -- 172.21.15.50:0/3928838742 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42680c6a30 con 0x7f42680c64a0 2024-01-30T08:10:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426d600640 1 --2- 172.21.15.50:0/3928838742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680c64a0 0x7f4268158680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f42680c47a0 tx=0x7f426001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae9c174e5922eac server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f4267400640 1 -- 172.21.15.50:0/3928838742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600a5860 con 0x7f42680c64a0 2024-01-30T08:10:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f4267400640 1 -- 172.21.15.50:0/3928838742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600a59c0 con 0x7f42680c64a0 2024-01-30T08:10:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f4267400640 1 -- 172.21.15.50:0/3928838742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600a5d50 con 0x7f42680c64a0 2024-01-30T08:10:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 -- 172.21.15.50:0/3928838742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680c64a0 msgr2=0x7f4268158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 --2- 172.21.15.50:0/3928838742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680c64a0 0x7f4268158680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f42680c47a0 tx=0x7f426001c9a0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 -- 172.21.15.50:0/3928838742 shutdown_connections 2024-01-30T08:10:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 --2- 172.21.15.50:0/3928838742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42680c64a0 0x7f4268158680 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 --2- 172.21.15.50:0/3928838742 >> v2:172.21.15.125:3300/0 conn(0x7f42680c4bb0 0x7f4268158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 -- 172.21.15.50:0/3928838742 >> 172.21.15.50:0/3928838742 conn(0x7f42680a9590 msgr2=0x7f42680c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 -- 172.21.15.50:0/3928838742 shutdown_connections 2024-01-30T08:10:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.800+0000 7f426f600640 1 -- 172.21.15.50:0/3928838742 wait complete. 2024-01-30T08:10:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 Processor -- start 2024-01-30T08:10:32.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 -- start start 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42680c4bb0 0x7f42681edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42680c64a0 0x7f426814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4268151d80 0x7f42680ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426815de50 con 0x7f4268151d80 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680ab030 con 0x7f42680c4bb0 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42681ed510 con 0x7f42680c64a0 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4268151d80 0x7f42680ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f4267e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42680c64a0 0x7f426814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4268151d80 0x7f42680ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44288/0 (socket says 172.21.15.50:44288) 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 -- 172.21.15.50:0/879689928 learned_addr learned my addr 172.21.15.50:0/879689928 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:32.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426cc00640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42680c4bb0 0x7f42681edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 -- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42680c64a0 msgr2=0x7f426814eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42680c64a0 0x7f426814eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 -- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42680c4bb0 msgr2=0x7f42681edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42680c4bb0 0x7f42681edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 -- 172.21.15.50:0/879689928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260009b30 con 0x7f4268151d80 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426d600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4268151d80 0x7f42680ab4c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f42600195b0 tx=0x7f4260019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f4264c00640 1 -- 172.21.15.50:0/879689928 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600b8670 con 0x7f4268151d80 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f4264c00640 1 -- 172.21.15.50:0/879689928 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600b87d0 con 0x7f4268151d80 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f4264c00640 1 -- 172.21.15.50:0/879689928 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600b8b60 con 0x7f4268151d80 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42681ed7f0 con 0x7f4268151d80 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.804+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426814f030 con 0x7f4268151d80 2024-01-30T08:10:32.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.808+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42680aab00 con 0x7f4268151d80 2024-01-30T08:10:32.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.808+0000 7f4264c00640 1 -- 172.21.15.50:0/879689928 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f42600b8cc0 con 0x7f4268151d80 2024-01-30T08:10:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.808+0000 7f4264c00640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4240066500 0x7f42400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.808+0000 7f4264c00640 1 -- 172.21.15.50:0/879689928 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f426011fae0 con 0x7f4268151d80 2024-01-30T08:10:32.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.808+0000 7f426cc00640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4240066500 0x7f42400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.808+0000 7f426cc00640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4240066500 0x7f42400689c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4258001810 tx=0x7f4258009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.812+0000 7f4264c00640 1 -- 172.21.15.50:0/879689928 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f42600eca50 con 0x7f4268151d80 2024-01-30T08:10:32.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.976+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42680ab1a0 con 0x7f4268151d80 2024-01-30T08:10:32.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.976+0000 7f4264c00640 1 -- 172.21.15.50:0/879689928 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+20633 (secure 0 0 0) 0x7f42600f0070 con 0x7f4268151d80 2024-01-30T08:10:32.980 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:32.980 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":45,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:31.877153+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:32.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4240066500 msgr2=0x7f42400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4240066500 0x7f42400689c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4258001810 tx=0x7f4258009040 comp rx=0 tx=0).stop 2024-01-30T08:10:32.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4268151d80 msgr2=0x7f42680ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:32.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4268151d80 0x7f42680ab4c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f42600195b0 tx=0x7f4260019740 comp rx=0 tx=0).stop 2024-01-30T08:10:32.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 shutdown_connections 2024-01-30T08:10:32.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f4240066500 0x7f42400689c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4268151d80 0x7f42680ab4c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42680c64a0 0x7f426814eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 --2- 172.21.15.50:0/879689928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42680c4bb0 0x7f42681edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 >> 172.21.15.50:0/879689928 conn(0x7f42680a9590 msgr2=0x7f4268071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 shutdown_connections 2024-01-30T08:10:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:32.980+0000 7f426f600640 1 -- 172.21.15.50:0/879689928 wait complete. 2024-01-30T08:10:33.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-30T08:09:51.121360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-30T08:09:52.315187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-30T08:10:09.022581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-30T08:10:10.287235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:10:33.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:10:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.144+0000 7f82c4600640 1 Processor -- start 2024-01-30T08:10:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.144+0000 7f82c4600640 1 -- start start 2024-01-30T08:10:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.144+0000 7f82c4600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f82bc0c3c50 0x7f82bc0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.144+0000 7f82c4600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc06c4c0 con 0x7f82bc06bfe0 2024-01-30T08:10:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.144+0000 7f82c4600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0c0550 con 0x7f82bc072b60 2024-01-30T08:10:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.144+0000 7f82c4600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc0c07c0 con 0x7f82bc0c3c50 2024-01-30T08:10:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f82bc06bfe0 0x7f82bc0c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45434/0 (socket says 172.21.15.50:45434) 2024-01-30T08:10:33.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1200640 1 -- 172.21.15.50:0/3313827778 learned_addr learned my addr 172.21.15.50:0/3313827778 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:33.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c2600640 1 --2- 172.21.15.50:0/3313827778 >> v2:172.21.15.125:3300/0 conn(0x7f82bc0c3c50 0x7f82bc0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152407840 0 0) 0x7f82bc06c4c0 con 0x7f82bc06bfe0 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f829c003530 con 0x7f82bc06bfe0 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1433540651 0 0) 0x7f829c003530 con 0x7f82bc06bfe0 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 >> v2:172.21.15.125:3300/0 conn(0x7f82bc0c3c50 msgr2=0x7f82bc0c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 --2- 172.21.15.50:0/3313827778 >> v2:172.21.15.125:3300/0 conn(0x7f82bc0c3c50 0x7f82bc0c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 >> v1:172.21.15.125:6789/0 conn(0x7f82bc072b60 legacy=0x7f82bc0a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0c0aa0 con 0x7f82bc06bfe0 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f82a4001680 con 0x7f82bc06bfe0 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 >> v1:172.21.15.50:6789/0 conn(0x7f82bc06bfe0 legacy=0x7f82bc0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c003980 0x7f829c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c0047d0 0x7f829c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829c005190 0x7f829c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0c07c0 con 0x7f829c003980 2024-01-30T08:10:33.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c00c130 con 0x7f829c005190 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c00c2f0 con 0x7f829c0047d0 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1c00640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c003980 0x7f829c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1200640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c0047d0 0x7f829c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c2600640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829c005190 0x7f829c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1c00640 1 -- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c0047d0 msgr2=0x7f829c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1c00640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c0047d0 0x7f829c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1c00640 1 -- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829c005190 msgr2=0x7f829c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1c00640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829c005190 0x7f829c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c1c00640 1 -- 172.21.15.50:0/3313827778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c003530 con 0x7f829c003980 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c2600640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f829c005190 0x7f829c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:33.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.148+0000 7f82c2600640 1 -- 172.21.15.50:0/3313827778 reap_dead start 2024-01-30T08:10:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c1c00640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c003980 0x7f829c003da0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f82ac001780 tx=0x7f82ac01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5f7e233b29c25 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0050d0 con 0x7f829c003980 2024-01-30T08:10:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac0a7050 con 0x7f829c003980 2024-01-30T08:10:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82bbe00640 1 -- 172.21.15.50:0/3313827778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac005490 con 0x7f829c003980 2024-01-30T08:10:33.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 -- 172.21.15.50:0/3313827778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c003980 msgr2=0x7f829c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c003980 0x7f829c003da0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f82ac001780 tx=0x7f82ac01c3b0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 -- 172.21.15.50:0/3313827778 shutdown_connections 2024-01-30T08:10:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 --2- 172.21.15.50:0/3313827778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f829c003980 0x7f829c003da0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 -- 172.21.15.50:0/3313827778 >> 172.21.15.50:0/3313827778 conn(0x7f82bc0c5b30 msgr2=0x7f82bc0c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 -- 172.21.15.50:0/3313827778 shutdown_connections 2024-01-30T08:10:33.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 -- 172.21.15.50:0/3313827778 wait complete. 2024-01-30T08:10:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 Processor -- start 2024-01-30T08:10:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.152+0000 7f82c4600640 1 -- start start 2024-01-30T08:10:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c003980 0x7f82bc1f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82bc148f80 0x7f82bc1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc1f0af0 0x7f82bc1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc152bf0 con 0x7f82bc1f0af0 2024-01-30T08:10:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc14bdc0 con 0x7f82bc148f80 2024-01-30T08:10:33.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc1f1290 con 0x7f829c003980 2024-01-30T08:10:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc1f0af0 0x7f82bc1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc1f0af0 0x7f82bc1487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44300/0 (socket says 172.21.15.50:44300) 2024-01-30T08:10:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 -- 172.21.15.50:0/3875898510 learned_addr learned my addr 172.21.15.50:0/3875898510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c1c00640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c003980 0x7f82bc1f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c1200640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82bc148f80 0x7f82bc1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 -- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c003980 msgr2=0x7f82bc1f05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c003980 0x7f82bc1f05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 -- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82bc148f80 msgr2=0x7f82bc1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82bc148f80 0x7f82bc1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 -- 172.21.15.50:0/3875898510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc148d30 con 0x7f82bc1f0af0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c2600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc1f0af0 0x7f82bc1487f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0abd20 tx=0x7f82b4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82b9600640 1 -- 172.21.15.50:0/3875898510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b401b070 con 0x7f82bc1f0af0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82b9600640 1 -- 172.21.15.50:0/3875898510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400f040 con 0x7f82bc1f0af0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82b9600640 1 -- 172.21.15.50:0/3875898510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400e050 con 0x7f82bc1f0af0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc1f0fb0 con 0x7f82bc1f0af0 2024-01-30T08:10:33.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc150a00 con 0x7f82bc1f0af0 2024-01-30T08:10:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.156+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc152d30 con 0x7f82bc1f0af0 2024-01-30T08:10:33.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.160+0000 7f82b9600640 1 -- 172.21.15.50:0/3875898510 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f82b4015440 con 0x7f82bc1f0af0 2024-01-30T08:10:33.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.160+0000 7f82b9600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8294066500 0x7f82940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.160+0000 7f82b9600640 1 -- 172.21.15.50:0/3875898510 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f82b4084440 con 0x7f82bc1f0af0 2024-01-30T08:10:33.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.160+0000 7f82c1c00640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8294066500 0x7f82940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.160+0000 7f82c1c00640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8294066500 0x7f82940689c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f82ac001750 tx=0x7f82ac0011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.164+0000 7f82b9600640 1 -- 172.21.15.50:0/3875898510 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f82bc152d30 con 0x7f82bc1f0af0 2024-01-30T08:10:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.324+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82bc152d30 con 0x7f82bc1f0af0 2024-01-30T08:10:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.324+0000 7f82b9600640 1 -- 172.21.15.50:0/3875898510 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82bc152d30 con 0x7f82bc1f0af0 2024-01-30T08:10:33.329 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8294066500 msgr2=0x7f82940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8294066500 0x7f82940689c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f82ac001750 tx=0x7f82ac0011a0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc1f0af0 msgr2=0x7f82bc1487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc1f0af0 0x7f82bc1487f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0abd20 tx=0x7f82b4010590 comp rx=0 tx=0).stop 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 shutdown_connections 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82bc148f80 0x7f82bc1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f8294066500 0x7f82940689c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc1f0af0 0x7f82bc1487f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 --2- 172.21.15.50:0/3875898510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f829c003980 0x7f82bc1f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 >> 172.21.15.50:0/3875898510 conn(0x7f82bc0c5b30 msgr2=0x7f82bc06d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 shutdown_connections 2024-01-30T08:10:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.328+0000 7f82c4600640 1 -- 172.21.15.50:0/3875898510 wait complete. 2024-01-30T08:10:33.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-30T08:10:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2529400640 1 Processor -- start 2024-01-30T08:10:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2529400640 1 -- start start 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2529400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f252414fbf0 0x7f2524153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2529400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25240c04b0 0x7f252406ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2529400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25240c54e0 con 0x7f25240a4da0 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2529400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2524152bf0 con 0x7f252414fbf0 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2529400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2524072d90 con 0x7f25240c04b0 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2522800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f252414fbf0 0x7f2524153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2521e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f25240a4da0 0x7f25240c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45436/0 (socket says 172.21.15.50:45436) 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2521e00640 1 -- 172.21.15.50:0/1428620705 learned_addr learned my addr 172.21.15.50:0/1428620705 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2523200640 1 --2- 172.21.15.50:0/1428620705 >> v2:172.21.15.125:3300/0 conn(0x7f25240c04b0 0x7f252406ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2522800640 1 -- 172.21.15.50:0/1428620705 >> v2:172.21.15.125:3300/0 conn(0x7f25240c04b0 msgr2=0x7f252406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2522800640 1 --2- 172.21.15.50:0/1428620705 >> v2:172.21.15.125:3300/0 conn(0x7f25240c04b0 0x7f252406ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2522800640 1 -- 172.21.15.50:0/1428620705 >> v1:172.21.15.50:6789/0 conn(0x7f25240a4da0 legacy=0x7f25240c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2522800640 1 -- 172.21.15.50:0/1428620705 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25241525e0 con 0x7f252414fbf0 2024-01-30T08:10:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.492+0000 7f2521400640 1 -- 172.21.15.50:0/1428620705 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530973366 0 0) 0x7f25240c54e0 con 0x7f25240a4da0 2024-01-30T08:10:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2522800640 1 --2- 172.21.15.50:0/1428620705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f2524153080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f252406b800 tx=0x7f251401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc77a25252b40fc server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2521400640 1 -- 172.21.15.50:0/1428620705 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140ab600 con 0x7f252414fbf0 2024-01-30T08:10:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2521400640 1 -- 172.21.15.50:0/1428620705 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25140a7050 con 0x7f252414fbf0 2024-01-30T08:10:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2521400640 1 -- 172.21.15.50:0/1428620705 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140ab980 con 0x7f252414fbf0 2024-01-30T08:10:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 -- 172.21.15.50:0/1428620705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 msgr2=0x7f2524153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 --2- 172.21.15.50:0/1428620705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f2524153080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f252406b800 tx=0x7f251401c3d0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 -- 172.21.15.50:0/1428620705 shutdown_connections 2024-01-30T08:10:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 --2- 172.21.15.50:0/1428620705 >> v2:172.21.15.125:3300/0 conn(0x7f25240c04b0 0x7f252406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 --2- 172.21.15.50:0/1428620705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f2524153080 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 -- 172.21.15.50:0/1428620705 >> 172.21.15.50:0/1428620705 conn(0x7f25240c5b30 msgr2=0x7f25240c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 -- 172.21.15.50:0/1428620705 shutdown_connections 2024-01-30T08:10:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.496+0000 7f2529400640 1 -- 172.21.15.50:0/1428620705 wait complete. 2024-01-30T08:10:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 Processor -- start 2024-01-30T08:10:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 -- start start 2024-01-30T08:10:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25240a4da0 0x7f252406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25240c04b0 0x7f25240aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f25240ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25240aaaf0 con 0x7f252414fbf0 2024-01-30T08:10:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25241ed7d0 con 0x7f25240a4da0 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2524156560 con 0x7f25240c04b0 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f25240ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f25240ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44326/0 (socket says 172.21.15.50:44326) 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 -- 172.21.15.50:0/3403353295 learned_addr learned my addr 172.21.15.50:0/3403353295 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2522800640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25240a4da0 0x7f252406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2521e00640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25240c04b0 0x7f25240aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 -- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25240c04b0 msgr2=0x7f25240aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25240c04b0 0x7f25240aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 -- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25240a4da0 msgr2=0x7f252406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25240a4da0 0x7f252406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 -- 172.21.15.50:0/3403353295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514009420 con 0x7f252414fbf0 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2522800640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25240a4da0 0x7f252406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:33.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2523200640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f25240ab4a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f251c007e40 tx=0x7f251c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f251aa00640 1 -- 172.21.15.50:0/3403353295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c014620 con 0x7f252414fbf0 2024-01-30T08:10:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f251aa00640 1 -- 172.21.15.50:0/3403353295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c00ee90 con 0x7f252414fbf0 2024-01-30T08:10:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f251aa00640 1 -- 172.21.15.50:0/3403353295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c0149e0 con 0x7f252414fbf0 2024-01-30T08:10:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2524156840 con 0x7f252414fbf0 2024-01-30T08:10:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.500+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252406d7d0 con 0x7f252414fbf0 2024-01-30T08:10:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.504+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2524067340 con 0x7f252414fbf0 2024-01-30T08:10:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.504+0000 7f251aa00640 1 -- 172.21.15.50:0/3403353295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f251c014b40 con 0x7f252414fbf0 2024-01-30T08:10:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.504+0000 7f251aa00640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f24fc066500 0x7f24fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.504+0000 7f251aa00640 1 -- 172.21.15.50:0/3403353295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f251c084cb0 con 0x7f252414fbf0 2024-01-30T08:10:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.504+0000 7f2522800640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f24fc066500 0x7f24fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.504+0000 7f2522800640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f24fc066500 0x7f24fc0689c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f25140ad000 tx=0x7f25140a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.508+0000 7f251aa00640 1 -- 172.21.15.50:0/3403353295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2524067340 con 0x7f252414fbf0 2024-01-30T08:10:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.664+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2524067340 con 0x7f252414fbf0 2024-01-30T08:10:33.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.664+0000 7f251aa00640 1 -- 172.21.15.50:0/3403353295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2524067340 con 0x7f252414fbf0 2024-01-30T08:10:33.669 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f24fc066500 msgr2=0x7f24fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f24fc066500 0x7f24fc0689c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f25140ad000 tx=0x7f25140a6000 comp rx=0 tx=0).stop 2024-01-30T08:10:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 msgr2=0x7f25240ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f25240ab4a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f251c007e40 tx=0x7f251c00e4b0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 shutdown_connections 2024-01-30T08:10:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f24fc066500 0x7f24fc0689c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f252414fbf0 0x7f25240ab4a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25240c04b0 0x7f25240aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 --2- 172.21.15.50:0/3403353295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25240a4da0 0x7f252406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 >> 172.21.15.50:0/3403353295 conn(0x7f25240c5b30 msgr2=0x7f252414f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 shutdown_connections 2024-01-30T08:10:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.668+0000 7f2529400640 1 -- 172.21.15.50:0/3403353295 wait complete. 2024-01-30T08:10:33.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-30T08:10:33.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0ab6600640 1 Processor -- start 2024-01-30T08:10:33.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0ab6600640 1 -- start start 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0ab6600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ab00c6700 0x7f0ab00c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0ab6600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ab00718a0 0x7f0ab0071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0ab6600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab0071410 con 0x7f0ab006f060 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0ab6600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00c09f0 con 0x7f0ab00c6700 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0ab6600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab0072c80 con 0x7f0ab00718a0 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0aaf400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ab00c6700 0x7f0ab00c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0aaf400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ab00c6700 0x7f0ab00c1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44330/0 (socket says 172.21.15.50:44330) 2024-01-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.832+0000 7f0aaf400640 1 -- 172.21.15.50:0/3288343004 learned_addr learned my addr 172.21.15.50:0/3288343004 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aafe00640 1 --2- 172.21.15.50:0/3288343004 >> v2:172.21.15.125:3300/0 conn(0x7f0ab00718a0 0x7f0ab0071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aaf400640 1 -- 172.21.15.50:0/3288343004 >> v2:172.21.15.125:3300/0 conn(0x7f0ab00718a0 msgr2=0x7f0ab0071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aaf400640 1 --2- 172.21.15.50:0/3288343004 >> v2:172.21.15.125:3300/0 conn(0x7f0ab00718a0 0x7f0ab0071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aaf400640 1 -- 172.21.15.50:0/3288343004 >> v1:172.21.15.125:6789/0 conn(0x7f0ab006f060 legacy=0x7f0ab006a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aaf400640 1 -- 172.21.15.50:0/3288343004 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00c0c70 con 0x7f0ab00c6700 2024-01-30T08:10:33.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aafe00640 1 --2- 172.21.15.50:0/3288343004 >> v2:172.21.15.125:3300/0 conn(0x7f0ab00718a0 0x7f0ab0071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aaf400640 1 --2- 172.21.15.50:0/3288343004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab00c6700 0x7f0ab00c1dd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0158d90 tx=0x7f0aa001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70d7e2a517900be server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aae000640 1 -- 172.21.15.50:0/3288343004 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00ab600 con 0x7f0ab00c6700 2024-01-30T08:10:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aae000640 1 -- 172.21.15.50:0/3288343004 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa00a7050 con 0x7f0ab00c6700 2024-01-30T08:10:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.836+0000 7f0aae000640 1 -- 172.21.15.50:0/3288343004 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00ab980 con 0x7f0ab00c6700 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- 172.21.15.50:0/3288343004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab00c6700 msgr2=0x7f0ab00c1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 --2- 172.21.15.50:0/3288343004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab00c6700 0x7f0ab00c1dd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0158d90 tx=0x7f0aa001c370 comp rx=0 tx=0).stop 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- 172.21.15.50:0/3288343004 shutdown_connections 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 --2- 172.21.15.50:0/3288343004 >> v2:172.21.15.125:3300/0 conn(0x7f0ab00718a0 0x7f0ab0071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 --2- 172.21.15.50:0/3288343004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab00c6700 0x7f0ab00c1dd0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- 172.21.15.50:0/3288343004 >> 172.21.15.50:0/3288343004 conn(0x7f0ab00c6c60 msgr2=0x7f0ab00c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- 172.21.15.50:0/3288343004 shutdown_connections 2024-01-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- 172.21.15.50:0/3288343004 wait complete. 2024-01-30T08:10:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 Processor -- start 2024-01-30T08:10:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- start start 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab006f060 0x7f0ab00aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ab00718a0 0x7f0ab0153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ab00c6700 0x7f0ab014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01f1120 con 0x7f0ab006f060 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00c5720 con 0x7f0ab00718a0 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0ab6600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00aae20 con 0x7f0ab00c6700 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0aaf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab006f060 0x7f0ab00aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0aaf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab006f060 0x7f0ab00aa8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44340/0 (socket says 172.21.15.50:44340) 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0aaf400640 1 -- 172.21.15.50:0/894624405 learned_addr learned my addr 172.21.15.50:0/894624405 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0aaea00640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ab00718a0 0x7f0ab0153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.840+0000 7f0aafe00640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ab00c6700 0x7f0ab014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aaf400640 1 -- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ab00c6700 msgr2=0x7f0ab014ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aaf400640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ab00c6700 0x7f0ab014ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aaf400640 1 -- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ab00718a0 msgr2=0x7f0ab0153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aaf400640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ab00718a0 0x7f0ab0153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aaf400640 1 -- 172.21.15.50:0/894624405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00094d0 con 0x7f0ab006f060 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aaf400640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab006f060 0x7f0ab00aa8e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0018f80 tx=0x7f0aa0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aa7400640 1 -- 172.21.15.50:0/894624405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00b5600 con 0x7f0ab006f060 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aa7400640 1 -- 172.21.15.50:0/894624405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa00b5780 con 0x7f0ab006f060 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aa7400640 1 -- 172.21.15.50:0/894624405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00b5b30 con 0x7f0ab006f060 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab00ab0c0 con 0x7f0ab006f060 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab01f0ad0 con 0x7f0ab006f060 2024-01-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab0074a20 con 0x7f0ab006f060 2024-01-30T08:10:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aa7400640 1 -- 172.21.15.50:0/894624405 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0aa00b5c90 con 0x7f0ab006f060 2024-01-30T08:10:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.844+0000 7f0aa7400640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a88066500 0x7f0a880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.848+0000 7f0aa7400640 1 -- 172.21.15.50:0/894624405 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f0aa011e400 con 0x7f0ab006f060 2024-01-30T08:10:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.848+0000 7f0aaea00640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a88066500 0x7f0a880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.848+0000 7f0aaea00640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a88066500 0x7f0a880689c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ab01590a0 tx=0x7f0a98009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:33.852+0000 7f0aa7400640 1 -- 172.21.15.50:0/894624405 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0aa00eb2f0 con 0x7f0ab006f060 2024-01-30T08:10:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.012+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ab00ac170 con 0x7f0ab006f060 2024-01-30T08:10:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.012+0000 7f0aa7400640 1 -- 172.21.15.50:0/894624405 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0aa00ee910 con 0x7f0ab006f060 2024-01-30T08:10:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a88066500 msgr2=0x7f0a880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a88066500 0x7f0a880689c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ab01590a0 tx=0x7f0a98009060 comp rx=0 tx=0).stop 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab006f060 msgr2=0x7f0ab00aa8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab006f060 0x7f0ab00aa8e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0018f80 tx=0x7f0aa0019110 comp rx=0 tx=0).stop 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 shutdown_connections 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ab00718a0 0x7f0ab0153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f0a88066500 0x7f0a880689c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ab00c6700 0x7f0ab014ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 --2- 172.21.15.50:0/894624405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ab006f060 0x7f0ab00aa8e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 >> 172.21.15.50:0/894624405 conn(0x7f0ab00c6c60 msgr2=0x7f0ab015e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 shutdown_connections 2024-01-30T08:10:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.016+0000 7f0ab6600640 1 -- 172.21.15.50:0/894624405 wait complete. 2024-01-30T08:10:34.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-30T08:10:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f393dc00640 1 Processor -- start 2024-01-30T08:10:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f393dc00640 1 -- start start 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f393dc00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3938155500 0x7f39380c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f393dc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f393806f6d0 0x7f39380c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f393dc00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3938158b70 con 0x7f393806f240 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f393dc00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3938157f60 con 0x7f3938155500 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f393dc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3938158240 con 0x7f393806f6d0 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f3936a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3938155500 0x7f39380c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f3936a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3938155500 0x7f39380c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44344/0 (socket says 172.21.15.50:44344) 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f3936a00640 1 -- 172.21.15.50:0/4185155044 learned_addr learned my addr 172.21.15.50:0/4185155044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.180+0000 7f3937400640 1 --2- 172.21.15.50:0/4185155044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f393806f6d0 0x7f39380c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3936a00640 1 -- 172.21.15.50:0/4185155044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f393806f6d0 msgr2=0x7f39380c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3936a00640 1 --2- 172.21.15.50:0/4185155044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f393806f6d0 0x7f39380c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3936a00640 1 -- 172.21.15.50:0/4185155044 >> v1:172.21.15.125:6789/0 conn(0x7f393806f240 legacy=0x7f39380c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3936a00640 1 -- 172.21.15.50:0/4185155044 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938158520 con 0x7f3938155500 2024-01-30T08:10:34.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3935600640 1 -- 172.21.15.50:0/4185155044 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052504890 0 0) 0x7f3938158b70 con 0x7f393806f240 2024-01-30T08:10:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3936a00640 1 --2- 172.21.15.50:0/4185155044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3938155500 0x7f39380c85e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3928009870 tx=0x7f392801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7fe30fba293fdf server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3935600640 1 -- 172.21.15.50:0/4185155044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39280ab600 con 0x7f3938155500 2024-01-30T08:10:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3935600640 1 -- 172.21.15.50:0/4185155044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39280a7050 con 0x7f3938155500 2024-01-30T08:10:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.184+0000 7f3935600640 1 -- 172.21.15.50:0/4185155044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39280ab980 con 0x7f3938155500 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- 172.21.15.50:0/4185155044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3938155500 msgr2=0x7f39380c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 --2- 172.21.15.50:0/4185155044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3938155500 0x7f39380c85e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3928009870 tx=0x7f392801c420 comp rx=0 tx=0).stop 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- 172.21.15.50:0/4185155044 shutdown_connections 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 --2- 172.21.15.50:0/4185155044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f393806f6d0 0x7f39380c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 --2- 172.21.15.50:0/4185155044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3938155500 0x7f39380c85e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- 172.21.15.50:0/4185155044 >> 172.21.15.50:0/4185155044 conn(0x7f39380727c0 msgr2=0x7f393806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- 172.21.15.50:0/4185155044 shutdown_connections 2024-01-30T08:10:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- 172.21.15.50:0/4185155044 wait complete. 2024-01-30T08:10:34.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 Processor -- start 2024-01-30T08:10:34.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- start start 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393806f240 0x7f393815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393806f6d0 0x7f3938159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3938155500 0x7f3938159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393815c1b0 con 0x7f393806f240 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380aa0a0 con 0x7f393806f6d0 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f393dc00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39381ecbc0 con 0x7f3938155500 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f3936a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393806f240 0x7f393815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f3936a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393806f240 0x7f393815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44358/0 (socket says 172.21.15.50:44358) 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f3936a00640 1 -- 172.21.15.50:0/2509444614 learned_addr learned my addr 172.21.15.50:0/2509444614 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f3936000640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393806f6d0 0x7f3938159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.188+0000 7f3937400640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3938155500 0x7f3938159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f3936a00640 1 -- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3938155500 msgr2=0x7f3938159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f3936a00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3938155500 0x7f3938159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f3936a00640 1 -- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393806f6d0 msgr2=0x7f3938159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f3936a00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393806f6d0 0x7f3938159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f3936a00640 1 -- 172.21.15.50:0/2509444614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280094d0 con 0x7f393806f240 2024-01-30T08:10:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f3936a00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393806f240 0x7f393815e750 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f39280ae040 tx=0x7f392801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f392ea00640 1 -- 172.21.15.50:0/2509444614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39280b6420 con 0x7f393806f240 2024-01-30T08:10:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f392ea00640 1 -- 172.21.15.50:0/2509444614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39280b6580 con 0x7f393806f240 2024-01-30T08:10:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f392ea00640 1 -- 172.21.15.50:0/2509444614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39280b6910 con 0x7f393806f240 2024-01-30T08:10:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39381ecea0 con 0x7f393806f240 2024-01-30T08:10:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39381ec8a0 con 0x7f393806f240 2024-01-30T08:10:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938074a20 con 0x7f393806f240 2024-01-30T08:10:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f392ea00640 1 -- 172.21.15.50:0/2509444614 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f39280b2040 con 0x7f393806f240 2024-01-30T08:10:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f392ea00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3910066500 0x7f39100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f392ea00640 1 -- 172.21.15.50:0/2509444614 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f392811e6f0 con 0x7f393806f240 2024-01-30T08:10:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.192+0000 7f3936000640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3910066500 0x7f39100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.196+0000 7f3936000640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3910066500 0x7f39100689c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3938073c90 tx=0x7f3920009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.200+0000 7f392ea00640 1 -- 172.21.15.50:0/2509444614 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f39280eb530 con 0x7f393806f240 2024-01-30T08:10:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.356+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39380c83c0 con 0x7f393806f240 2024-01-30T08:10:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.356+0000 7f392ea00640 1 -- 172.21.15.50:0/2509444614 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v45) v1 ==== 105+0+11 (secure 0 0 0) 0x7f39280eeb50 con 0x7f393806f240 2024-01-30T08:10:34.361 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3910066500 msgr2=0x7f39100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3910066500 0x7f39100689c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3938073c90 tx=0x7f3920009040 comp rx=0 tx=0).stop 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393806f240 msgr2=0x7f393815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393806f240 0x7f393815e750 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f39280ae040 tx=0x7f392801ac60 comp rx=0 tx=0).stop 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 shutdown_connections 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f393806f6d0 0x7f3938159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3910066500 0x7f39100689c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3938155500 0x7f3938159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 --2- 172.21.15.50:0/2509444614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f393806f240 0x7f393815e750 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 >> 172.21.15.50:0/2509444614 conn(0x7f39380727c0 msgr2=0x7f39380acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 shutdown_connections 2024-01-30T08:10:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.360+0000 7f393dc00640 1 -- 172.21.15.50:0/2509444614 wait complete. 2024-01-30T08:10:34.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-30T08:10:34.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb99e00640 1 Processor -- start 2024-01-30T08:10:34.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb99e00640 1 -- start start 2024-01-30T08:10:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb99e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbb941568a0 0x7fbb940c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb99e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940c8a50 con 0x7fbb940c50d0 2024-01-30T08:10:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb99e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940c66d0 con 0x7fbb940c7ae0 2024-01-30T08:10:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb99e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940c7070 con 0x7fbb941568a0 2024-01-30T08:10:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb92a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb940c50d0 0x7fbb94156190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45450/0 (socket says 172.21.15.50:45450) 2024-01-30T08:10:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb92a00640 1 -- 172.21.15.50:0/376544724 learned_addr learned my addr 172.21.15.50:0/376544724 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb92000640 1 --2- 172.21.15.50:0/376544724 >> v2:172.21.15.125:3300/0 conn(0x7fbb941568a0 0x7fbb940c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb91600640 1 -- 172.21.15.50:0/376544724 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799662426 0 0) 0x7fbb940c8a50 con 0x7fbb940c50d0 2024-01-30T08:10:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb91600640 1 -- 172.21.15.50:0/376544724 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb74003530 con 0x7fbb940c50d0 2024-01-30T08:10:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb92000640 1 -- 172.21.15.50:0/376544724 >> v1:172.21.15.125:6789/0 conn(0x7fbb940c7ae0 legacy=0x7fbb940c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb92000640 1 -- 172.21.15.50:0/376544724 >> v1:172.21.15.50:6789/0 conn(0x7fbb940c50d0 legacy=0x7fbb94156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.524+0000 7fbb92000640 1 -- 172.21.15.50:0/376544724 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940c69b0 con 0x7fbb941568a0 2024-01-30T08:10:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb92000640 1 --2- 172.21.15.50:0/376544724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb941568a0 0x7fbb940c30b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0097c0 tx=0x7fbb7c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0494e14f82919ae server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb91600640 1 -- 172.21.15.50:0/376544724 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0ac640 con 0x7fbb941568a0 2024-01-30T08:10:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb91600640 1 -- 172.21.15.50:0/376544724 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c0ac7a0 con 0x7fbb941568a0 2024-01-30T08:10:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb91600640 1 -- 172.21.15.50:0/376544724 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0acb30 con 0x7fbb941568a0 2024-01-30T08:10:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb99e00640 1 -- 172.21.15.50:0/376544724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb941568a0 msgr2=0x7fbb940c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb99e00640 1 --2- 172.21.15.50:0/376544724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb941568a0 0x7fbb940c30b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0097c0 tx=0x7fbb7c01c3c0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb99e00640 1 -- 172.21.15.50:0/376544724 shutdown_connections 2024-01-30T08:10:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb99e00640 1 --2- 172.21.15.50:0/376544724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb941568a0 0x7fbb940c30b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb99e00640 1 -- 172.21.15.50:0/376544724 >> 172.21.15.50:0/376544724 conn(0x7fbb940727c0 msgr2=0x7fbb9406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb99e00640 1 -- 172.21.15.50:0/376544724 shutdown_connections 2024-01-30T08:10:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.528+0000 7fbb99e00640 1 -- 172.21.15.50:0/376544724 wait complete. 2024-01-30T08:10:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 Processor -- start 2024-01-30T08:10:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 -- start start 2024-01-30T08:10:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb940c50d0 0x7fbb9414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb940c7ae0 0x7fbb941ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb941568a0 0x7fbb94150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940c8d30 con 0x7fbb940c50d0 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941ece40 con 0x7fbb940c7ae0 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941ed0e0 con 0x7fbb941568a0 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb940c50d0 0x7fbb9414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb940c50d0 0x7fbb9414b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44364/0 (socket says 172.21.15.50:44364) 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 -- 172.21.15.50:0/2072811197 learned_addr learned my addr 172.21.15.50:0/2072811197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92000640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb940c7ae0 0x7fbb941ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb93400640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb941568a0 0x7fbb94150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 -- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb941568a0 msgr2=0x7fbb94150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb941568a0 0x7fbb94150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 -- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb940c7ae0 msgr2=0x7fbb941ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb940c7ae0 0x7fbb941ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 -- 172.21.15.50:0/2072811197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c009420 con 0x7fbb940c50d0 2024-01-30T08:10:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb92a00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb940c50d0 0x7fbb9414b3c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c4d0 tx=0x7fbb8400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb8b400640 1 -- 172.21.15.50:0/2072811197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84005cf0 con 0x7fbb940c50d0 2024-01-30T08:10:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb8b400640 1 -- 172.21.15.50:0/2072811197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84005e50 con 0x7fbb940c50d0 2024-01-30T08:10:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb8b400640 1 -- 172.21.15.50:0/2072811197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84007270 con 0x7fbb940c50d0 2024-01-30T08:10:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94152490 con 0x7fbb940c50d0 2024-01-30T08:10:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.532+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb940acd70 con 0x7fbb940c50d0 2024-01-30T08:10:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.536+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94074a20 con 0x7fbb940c50d0 2024-01-30T08:10:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.536+0000 7fbb8b400640 1 -- 172.21.15.50:0/2072811197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbb840073d0 con 0x7fbb940c50d0 2024-01-30T08:10:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.536+0000 7fbb8b400640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbb6c066500 0x7fbb6c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.536+0000 7fbb8b400640 1 -- 172.21.15.50:0/2072811197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7fbb84083880 con 0x7fbb940c50d0 2024-01-30T08:10:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.536+0000 7fbb92000640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbb6c066500 0x7fbb6c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.536+0000 7fbb92000640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbb6c066500 0x7fbb6c0689c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0ae000 tx=0x7fbb7c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.540+0000 7fbb8b400640 1 -- 172.21.15.50:0/2072811197 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbb84050640 con 0x7fbb940c50d0 2024-01-30T08:10:34.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fbb94152700 con 0x7fbb940c50d0 2024-01-30T08:10:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb8b400640 1 -- 172.21.15.50:0/2072811197 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v45) v1 ==== 101+0+11 (secure 0 0 0) 0x7fbb84053c60 con 0x7fbb940c50d0 2024-01-30T08:10:34.703 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:34.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbb6c066500 msgr2=0x7fbb6c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbb6c066500 0x7fbb6c0689c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0ae000 tx=0x7fbb7c0a7000 comp rx=0 tx=0).stop 2024-01-30T08:10:34.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb940c50d0 msgr2=0x7fbb9414b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb940c50d0 0x7fbb9414b3c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c4d0 tx=0x7fbb8400c990 comp rx=0 tx=0).stop 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 shutdown_connections 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb940c7ae0 0x7fbb941ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbb6c066500 0x7fbb6c0689c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbb941568a0 0x7fbb94150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 --2- 172.21.15.50:0/2072811197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb940c50d0 0x7fbb9414b3c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.700+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 >> 172.21.15.50:0/2072811197 conn(0x7fbb940727c0 msgr2=0x7fbb940c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.704+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 shutdown_connections 2024-01-30T08:10:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.704+0000 7fbb99e00640 1 -- 172.21.15.50:0/2072811197 wait complete. 2024-01-30T08:10:34.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f506a000640 1 Processor -- start 2024-01-30T08:10:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f506a000640 1 -- start start 2024-01-30T08:10:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f506a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50640c5650 0x7f506406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f506a000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50640c4760 0x7f506406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f506a000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50640a8cf0 con 0x7f50640c1840 2024-01-30T08:10:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f506a000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5064072a30 con 0x7f50640c5650 2024-01-30T08:10:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f506a000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50640a8f40 con 0x7f50640c4760 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5062a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50640c5650 0x7f506406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5062a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f50640c5650 0x7f506406cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44366/0 (socket says 172.21.15.50:44366) 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5062a00640 1 -- 172.21.15.50:0/1763489924 learned_addr learned my addr 172.21.15.50:0/1763489924 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5063e00640 1 --2- 172.21.15.50:0/1763489924 >> v2:172.21.15.125:3300/0 conn(0x7f50640c4760 0x7f506406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5062a00640 1 -- 172.21.15.50:0/1763489924 >> v2:172.21.15.125:3300/0 conn(0x7f50640c4760 msgr2=0x7f506406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5062a00640 1 --2- 172.21.15.50:0/1763489924 >> v2:172.21.15.125:3300/0 conn(0x7f50640c4760 0x7f506406d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5062a00640 1 -- 172.21.15.50:0/1763489924 >> v1:172.21.15.125:6789/0 conn(0x7f50640c1840 legacy=0x7f50640a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.864+0000 7f5062a00640 1 -- 172.21.15.50:0/1763489924 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064072cd0 con 0x7f50640c5650 2024-01-30T08:10:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f5062a00640 1 --2- 172.21.15.50:0/1763489924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c5650 0x7f506406cf00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f50640c53d0 tx=0x7f504c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977b5d336a5cb250 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f5062000640 1 -- 172.21.15.50:0/1763489924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0ab610 con 0x7f50640c5650 2024-01-30T08:10:34.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f5062000640 1 -- 172.21.15.50:0/1763489924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c0ab770 con 0x7f50640c5650 2024-01-30T08:10:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f5062000640 1 -- 172.21.15.50:0/1763489924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0abb00 con 0x7f50640c5650 2024-01-30T08:10:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 -- 172.21.15.50:0/1763489924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c5650 msgr2=0x7f506406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 --2- 172.21.15.50:0/1763489924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c5650 0x7f506406cf00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f50640c53d0 tx=0x7f504c01c470 comp rx=0 tx=0).stop 2024-01-30T08:10:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 -- 172.21.15.50:0/1763489924 shutdown_connections 2024-01-30T08:10:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 --2- 172.21.15.50:0/1763489924 >> v2:172.21.15.125:3300/0 conn(0x7f50640c4760 0x7f506406d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 --2- 172.21.15.50:0/1763489924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c5650 0x7f506406cf00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 -- 172.21.15.50:0/1763489924 >> 172.21.15.50:0/1763489924 conn(0x7f50640c5b50 msgr2=0x7f50640c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 -- 172.21.15.50:0/1763489924 shutdown_connections 2024-01-30T08:10:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.868+0000 7f506a000640 1 -- 172.21.15.50:0/1763489924 wait complete. 2024-01-30T08:10:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 Processor -- start 2024-01-30T08:10:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 -- start start 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50640c1840 0x7f5064148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c4760 0x7f50641ee940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50640c5650 0x7f50641eee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5064150bd0 con 0x7f50640c4760 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50641ec5e0 con 0x7f50640c5650 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50640c50a0 con 0x7f50640c1840 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c4760 0x7f50641ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c4760 0x7f50641ee940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44372/0 (socket says 172.21.15.50:44372) 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 -- 172.21.15.50:0/4176638141 learned_addr learned my addr 172.21.15.50:0/4176638141 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5063e00640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50640c5650 0x7f50641eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5063400640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50640c1840 0x7f5064148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 -- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50640c1840 msgr2=0x7f5064148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50640c1840 0x7f5064148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 -- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50640c5650 msgr2=0x7f50641eee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50640c5650 0x7f50641eee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 -- 172.21.15.50:0/4176638141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0094d0 con 0x7f50640c4760 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5063400640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50640c1840 0x7f5064148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f5062a00640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c4760 0x7f50641ee940 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f504c01c950 tx=0x7f504c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f505b400640 1 -- 172.21.15.50:0/4176638141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0ab610 con 0x7f50640c4760 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f505b400640 1 -- 172.21.15.50:0/4176638141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c0b4820 con 0x7f50640c4760 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f505b400640 1 -- 172.21.15.50:0/4176638141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0b4bd0 con 0x7f50640c4760 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50641ef460 con 0x7f50640c4760 2024-01-30T08:10:34.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.872+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5064151100 con 0x7f50640c4760 2024-01-30T08:10:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.876+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5064074a20 con 0x7f50640c4760 2024-01-30T08:10:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.876+0000 7f505b400640 1 -- 172.21.15.50:0/4176638141 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f504c0b4d30 con 0x7f50640c4760 2024-01-30T08:10:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.876+0000 7f505b400640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f503c066530 0x7f503c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:34.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.876+0000 7f505b400640 1 -- 172.21.15.50:0/4176638141 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f504c11ed40 con 0x7f50640c4760 2024-01-30T08:10:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.876+0000 7f5063400640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f503c066530 0x7f503c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:34.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.876+0000 7f5063400640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f503c066530 0x7f503c0689f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50640a7450 tx=0x7f5054009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:34.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:34.880+0000 7f505b400640 1 -- 172.21.15.50:0/4176638141 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f504c0ebcb0 con 0x7f50640c4760 2024-01-30T08:10:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.076+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50641ec720 con 0x7f50640c4760 2024-01-30T08:10:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.076+0000 7f505b400640 1 -- 172.21.15.50:0/4176638141 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f504c0ef2d0 con 0x7f50640c4760 2024-01-30T08:10:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:35.081 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:09:53.316367+0000","modified":"2024-01-30T08:09:56.334652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1837689837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1837689837},{"type":"v1","addr":"172.21.15.50:6835","nonce":1837689837}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f503c066530 msgr2=0x7f503c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f503c066530 0x7f503c0689f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50640a7450 tx=0x7f5054009040 comp rx=0 tx=0).stop 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c4760 msgr2=0x7f50641ee940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c4760 0x7f50641ee940 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f504c01c950 tx=0x7f504c01acb0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 shutdown_connections 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f50640c5650 0x7f50641eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f503c066530 0x7f503c0689f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50640c4760 0x7f50641ee940 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 --2- 172.21.15.50:0/4176638141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50640c1840 0x7f5064148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 >> 172.21.15.50:0/4176638141 conn(0x7f50640c5b50 msgr2=0x7f50640c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 shutdown_connections 2024-01-30T08:10:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.080+0000 7f506a000640 1 -- 172.21.15.50:0/4176638141 wait complete. 2024-01-30T08:10:35.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.240+0000 7fa15ca00640 1 Processor -- start 2024-01-30T08:10:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.240+0000 7fa15ca00640 1 -- start start 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15ca00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa1540c4bb0 0x7fa154158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15ca00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1540c64a0 0x7fa154158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15ca00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa154157c60 con 0x7fa154151d80 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15ca00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa154152160 con 0x7fa1540c64a0 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15ca00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1540c35f0 con 0x7fa1540c4bb0 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1540c64a0 0x7fa154158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1540c64a0 0x7fa154158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44374/0 (socket says 172.21.15.50:44374) 2024-01-30T08:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15aa00640 1 -- 172.21.15.50:0/3567161494 learned_addr learned my addr 172.21.15.50:0/3567161494 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15aa00640 1 -- 172.21.15.50:0/3567161494 >> v2:172.21.15.125:3300/0 conn(0x7fa1540c4bb0 msgr2=0x7fa154158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15aa00640 1 --2- 172.21.15.50:0/3567161494 >> v2:172.21.15.125:3300/0 conn(0x7fa1540c4bb0 0x7fa154158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15aa00640 1 -- 172.21.15.50:0/3567161494 >> v1:172.21.15.125:6789/0 conn(0x7fa154151d80 legacy=0x7fa1540c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.244+0000 7fa15aa00640 1 -- 172.21.15.50:0/3567161494 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540c6a30 con 0x7fa1540c64a0 2024-01-30T08:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15aa00640 1 --2- 172.21.15.50:0/3567161494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c64a0 0x7fa154158680 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa1540c47a0 tx=0x7fa14c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0998f5c20c34d86 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa158c00640 1 -- 172.21.15.50:0/3567161494 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0a5820 con 0x7fa1540c64a0 2024-01-30T08:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa158c00640 1 -- 172.21.15.50:0/3567161494 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c0a5980 con 0x7fa1540c64a0 2024-01-30T08:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa158c00640 1 -- 172.21.15.50:0/3567161494 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0a5d10 con 0x7fa1540c64a0 2024-01-30T08:10:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 -- 172.21.15.50:0/3567161494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c64a0 msgr2=0x7fa154158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3567161494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c64a0 0x7fa154158680 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa1540c47a0 tx=0x7fa14c01c960 comp rx=0 tx=0).stop 2024-01-30T08:10:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 -- 172.21.15.50:0/3567161494 shutdown_connections 2024-01-30T08:10:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3567161494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c64a0 0x7fa154158680 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3567161494 >> v2:172.21.15.125:3300/0 conn(0x7fa1540c4bb0 0x7fa154158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 -- 172.21.15.50:0/3567161494 >> 172.21.15.50:0/3567161494 conn(0x7fa1540a9590 msgr2=0x7fa1540c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 -- 172.21.15.50:0/3567161494 shutdown_connections 2024-01-30T08:10:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 -- 172.21.15.50:0/3567161494 wait complete. 2024-01-30T08:10:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 Processor -- start 2024-01-30T08:10:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.248+0000 7fa15ca00640 1 -- start start 2024-01-30T08:10:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c4bb0 0x7fa154071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1540c64a0 0x7fa1541ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa154151d80 0x7fa1541ee730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1541ecd80 con 0x7fa1540c4bb0 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540aaba0 con 0x7fa154151d80 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540aae80 con 0x7fa1540c64a0 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c4bb0 0x7fa154071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c4bb0 0x7fa154071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44388/0 (socket says 172.21.15.50:44388) 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 -- 172.21.15.50:0/3371415519 learned_addr learned my addr 172.21.15.50:0/3371415519 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15aa00640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa154151d80 0x7fa1541ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa159600640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1540c64a0 0x7fa1541ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 -- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1540c64a0 msgr2=0x7fa1541ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1540c64a0 0x7fa1541ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 -- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa154151d80 msgr2=0x7fa1541ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa154151d80 0x7fa1541ee730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 -- 172.21.15.50:0/3371415519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c009b30 con 0x7fa1540c4bb0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa159600640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1540c64a0 0x7fa1541ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15a000640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c4bb0 0x7fa154071370 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa14400b410 tx=0x7fa14400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa152000640 1 -- 172.21.15.50:0/3371415519 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144004020 con 0x7fa1540c4bb0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa152000640 1 -- 172.21.15.50:0/3371415519 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144004180 con 0x7fa1540c4bb0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa152000640 1 -- 172.21.15.50:0/3371415519 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144011630 con 0x7fa1540c4bb0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1540ab160 con 0x7fa1540c4bb0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1540718b0 con 0x7fa1540c4bb0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa154074a20 con 0x7fa1540c4bb0 2024-01-30T08:10:35.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.252+0000 7fa152000640 1 -- 172.21.15.50:0/3371415519 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa144011790 con 0x7fa1540c4bb0 2024-01-30T08:10:35.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.256+0000 7fa152000640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa12c066500 0x7fa12c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.256+0000 7fa152000640 1 -- 172.21.15.50:0/3371415519 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7fa144083fe0 con 0x7fa1540c4bb0 2024-01-30T08:10:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.256+0000 7fa159600640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa12c066500 0x7fa12c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.256+0000 7fa159600640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa12c066500 0x7fa12c0689c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa13c006fd0 tx=0x7fa13c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.260+0000 7fa152000640 1 -- 172.21.15.50:0/3371415519 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa144050de0 con 0x7fa1540c4bb0 2024-01-30T08:10:35.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1540724d0 con 0x7fa1540c4bb0 2024-01-30T08:10:35.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa152000640 1 -- 172.21.15.50:0/3371415519 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+20633 (secure 0 0 0) 0x7fa144054400 con 0x7fa1540c4bb0 2024-01-30T08:10:35.423 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:35.423 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":45,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:31.877153+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa12c066500 msgr2=0x7fa12c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa12c066500 0x7fa12c0689c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa13c006fd0 tx=0x7fa13c008040 comp rx=0 tx=0).stop 2024-01-30T08:10:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c4bb0 msgr2=0x7fa154071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c4bb0 0x7fa154071370 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa14400b410 tx=0x7fa14400b8d0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 shutdown_connections 2024-01-30T08:10:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa154151d80 0x7fa1541ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fa12c066500 0x7fa12c0689c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1540c64a0 0x7fa1541ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 --2- 172.21.15.50:0/3371415519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1540c4bb0 0x7fa154071370 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.420+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 >> 172.21.15.50:0/3371415519 conn(0x7fa1540a9590 msgr2=0x7fa1540a8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:35.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.424+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 shutdown_connections 2024-01-30T08:10:35.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.424+0000 7fa15ca00640 1 -- 172.21.15.50:0/3371415519 wait complete. 2024-01-30T08:10:35.446 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-30T08:10:35.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:35.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.584+0000 7ffb25e00640 1 Processor -- start 2024-01-30T08:10:35.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.584+0000 7ffb25e00640 1 -- start start 2024-01-30T08:10:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb25e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb200c4b60 0x7ffb2006ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb25e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb200a9590 0x7ffb200a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb25e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb200c40c0 con 0x7ffb2006a740 2024-01-30T08:10:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb25e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb200aa350 con 0x7ffb200c4b60 2024-01-30T08:10:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb25e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb200aa070 con 0x7ffb200a9590 2024-01-30T08:10:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1ea00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffb2006a740 0x7ffb200c0cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45462/0 (socket says 172.21.15.50:45462) 2024-01-30T08:10:35.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1ea00640 1 -- 172.21.15.50:0/1833591743 learned_addr learned my addr 172.21.15.50:0/1833591743 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1e000640 1 --2- 172.21.15.50:0/1833591743 >> v2:172.21.15.125:3300/0 conn(0x7ffb200c4b60 0x7ffb2006ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1f400640 1 --2- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb200a9590 0x7ffb200a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1d600640 1 -- 172.21.15.50:0/1833591743 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369949771 0 0) 0x7ffb200c40c0 con 0x7ffb2006a740 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1d600640 1 -- 172.21.15.50:0/1833591743 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb00003530 con 0x7ffb2006a740 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1e000640 1 -- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb200a9590 msgr2=0x7ffb200a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1e000640 1 --2- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb200a9590 0x7ffb200a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1e000640 1 -- 172.21.15.50:0/1833591743 >> v1:172.21.15.50:6789/0 conn(0x7ffb2006a740 legacy=0x7ffb200c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.588+0000 7ffb1e000640 1 -- 172.21.15.50:0/1833591743 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb200c4360 con 0x7ffb200c4b60 2024-01-30T08:10:35.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb1e000640 1 --2- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200c4b60 0x7ffb2006ab20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb080097c0 tx=0x7ffb0801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fd76940af227b2b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb1d600640 1 -- 172.21.15.50:0/1833591743 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb080ab600 con 0x7ffb200c4b60 2024-01-30T08:10:35.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb1d600640 1 -- 172.21.15.50:0/1833591743 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb080a7050 con 0x7ffb200c4b60 2024-01-30T08:10:35.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb1d600640 1 -- 172.21.15.50:0/1833591743 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb080ab960 con 0x7ffb200c4b60 2024-01-30T08:10:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 -- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200c4b60 msgr2=0x7ffb2006ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 --2- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200c4b60 0x7ffb2006ab20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb080097c0 tx=0x7ffb0801c360 comp rx=0 tx=0).stop 2024-01-30T08:10:35.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 -- 172.21.15.50:0/1833591743 shutdown_connections 2024-01-30T08:10:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 --2- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb200a9590 0x7ffb200a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 --2- 172.21.15.50:0/1833591743 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200c4b60 0x7ffb2006ab20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 -- 172.21.15.50:0/1833591743 >> 172.21.15.50:0/1833591743 conn(0x7ffb200c5b50 msgr2=0x7ffb200c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 -- 172.21.15.50:0/1833591743 shutdown_connections 2024-01-30T08:10:35.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 -- 172.21.15.50:0/1833591743 wait complete. 2024-01-30T08:10:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 Processor -- start 2024-01-30T08:10:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.592+0000 7ffb25e00640 1 -- start start 2024-01-30T08:10:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb2006a740 0x7ffb20155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200a9590 0x7ffb2015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb200c4b60 0x7ffb20152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb201f0c10 con 0x7ffb200c4b60 2024-01-30T08:10:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb201f0000 con 0x7ffb200a9590 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb201f02e0 con 0x7ffb2006a740 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb200c4b60 0x7ffb20152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb200c4b60 0x7ffb20152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44402/0 (socket says 172.21.15.50:44402) 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 -- 172.21.15.50:0/354749375 learned_addr learned my addr 172.21.15.50:0/354749375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1e000640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200a9590 0x7ffb2015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1ea00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb2006a740 0x7ffb20155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 -- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb2006a740 msgr2=0x7ffb20155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb2006a740 0x7ffb20155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 -- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200a9590 msgr2=0x7ffb2015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200a9590 0x7ffb2015b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 -- 172.21.15.50:0/354749375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009420 con 0x7ffb200c4b60 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1ea00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb2006a740 0x7ffb20155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb1f400640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb200c4b60 0x7ffb20152d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800efc0 tx=0x7ffb1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb17400640 1 -- 172.21.15.50:0/354749375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18009ba0 con 0x7ffb200c4b60 2024-01-30T08:10:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb17400640 1 -- 172.21.15.50:0/354749375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1800f040 con 0x7ffb200c4b60 2024-01-30T08:10:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb17400640 1 -- 172.21.15.50:0/354749375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180146c0 con 0x7ffb200c4b60 2024-01-30T08:10:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb201f05c0 con 0x7ffb200c4b60 2024-01-30T08:10:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb20155580 con 0x7ffb200c4b60 2024-01-30T08:10:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.596+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb200c57b0 con 0x7ffb200c4b60 2024-01-30T08:10:35.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.600+0000 7ffb17400640 1 -- 172.21.15.50:0/354749375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ffb18014820 con 0x7ffb200c4b60 2024-01-30T08:10:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.600+0000 7ffb17400640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffaf8066500 0x7ffaf80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.600+0000 7ffb17400640 1 -- 172.21.15.50:0/354749375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7ffb18084f30 con 0x7ffb200c4b60 2024-01-30T08:10:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.600+0000 7ffb1ea00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffaf8066500 0x7ffaf80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.600+0000 7ffb1ea00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffaf8066500 0x7ffaf80689c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffb10005890 tx=0x7ffb10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.604+0000 7ffb17400640 1 -- 172.21.15.50:0/354749375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ffb18051c40 con 0x7ffb200c4b60 2024-01-30T08:10:35.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb20074a20 con 0x7ffb200c4b60 2024-01-30T08:10:35.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb17400640 1 -- 172.21.15.50:0/354749375 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+6183 (secure 0 0 0) 0x7ffb18018020 con 0x7ffb200c4b60 2024-01-30T08:10:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:35.803 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:09:53.316367+0000","modified":"2024-01-30T08:09:56.334652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1837689837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1837689837},{"type":"v1","addr":"172.21.15.50:6835","nonce":1837689837}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:35.803 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffaf8066500 msgr2=0x7ffaf80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffaf8066500 0x7ffaf80689c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffb10005890 tx=0x7ffb10009040 comp rx=0 tx=0).stop 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb200c4b60 msgr2=0x7ffb20152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb200c4b60 0x7ffb20152d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800efc0 tx=0x7ffb1800c490 comp rx=0 tx=0).stop 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 shutdown_connections 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb200a9590 0x7ffb2015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffaf8066500 0x7ffaf80689c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb200c4b60 0x7ffb20152d80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 --2- 172.21.15.50:0/354749375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb2006a740 0x7ffb20155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 >> 172.21.15.50:0/354749375 conn(0x7ffb200c5b50 msgr2=0x7ffb200a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 shutdown_connections 2024-01-30T08:10:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.800+0000 7ffb25e00640 1 -- 172.21.15.50:0/354749375 wait complete. 2024-01-30T08:10:35.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.964+0000 7f7ae5c00640 1 Processor -- start 2024-01-30T08:10:35.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.964+0000 7f7ae5c00640 1 -- start start 2024-01-30T08:10:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ae5c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae006de40 0x7f7ae00a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ae5c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ae006e220 0x7f7ae0157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ae5c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00c7b40 con 0x7f7ae01582d0 2024-01-30T08:10:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ae5c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00a7770 con 0x7f7ae006e220 2024-01-30T08:10:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ae5c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0155310 con 0x7f7ae006de40 2024-01-30T08:10:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7adf400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ae01582d0 0x7f7ae006f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45476/0 (socket says 172.21.15.50:45476) 2024-01-30T08:10:35.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7adf400640 1 -- 172.21.15.50:0/127884554 learned_addr learned my addr 172.21.15.50:0/127884554 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ade000640 1 --2- 172.21.15.50:0/127884554 >> v2:172.21.15.125:3300/0 conn(0x7f7ae006e220 0x7f7ae0157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7adea00640 1 --2- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae006de40 0x7f7ae00a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7add600640 1 -- 172.21.15.50:0/127884554 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254631043 0 0) 0x7f7ad80014a0 con 0x7f7ae01582d0 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7add600640 1 -- 172.21.15.50:0/127884554 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ac0003530 con 0x7f7ae01582d0 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ade000640 1 -- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae006de40 msgr2=0x7f7ae00a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ade000640 1 --2- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae006de40 0x7f7ae00a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ade000640 1 -- 172.21.15.50:0/127884554 >> v1:172.21.15.50:6789/0 conn(0x7f7ae01582d0 legacy=0x7f7ae006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.968+0000 7f7ade000640 1 -- 172.21.15.50:0/127884554 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0155730 con 0x7f7ae006e220 2024-01-30T08:10:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ade000640 1 --2- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006e220 0x7f7ae0157d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80097c0 tx=0x7f7ac801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c25de902bd64fa15 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7add600640 1 -- 172.21.15.50:0/127884554 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80ab600 con 0x7f7ae006e220 2024-01-30T08:10:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7add600640 1 -- 172.21.15.50:0/127884554 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80a7050 con 0x7f7ae006e220 2024-01-30T08:10:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7add600640 1 -- 172.21.15.50:0/127884554 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80ab980 con 0x7f7ae006e220 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 -- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006e220 msgr2=0x7f7ae0157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006e220 0x7f7ae0157d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80097c0 tx=0x7f7ac801c480 comp rx=0 tx=0).stop 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 -- 172.21.15.50:0/127884554 shutdown_connections 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006e220 0x7f7ae0157d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/127884554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae006de40 0x7f7ae00a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 -- 172.21.15.50:0/127884554 >> 172.21.15.50:0/127884554 conn(0x7f7ae00c4830 msgr2=0x7f7ae00c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 -- 172.21.15.50:0/127884554 shutdown_connections 2024-01-30T08:10:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 -- 172.21.15.50:0/127884554 wait complete. 2024-01-30T08:10:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 Processor -- start 2024-01-30T08:10:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.972+0000 7f7ae5c00640 1 -- start start 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006de40 0x7f7ae0151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006e220 0x7f7ae00bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae01582d0 0x7f7ae0152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00abb40 con 0x7f7ae006e220 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00c0280 con 0x7f7ae006de40 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00abd90 con 0x7f7ae01582d0 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006e220 0x7f7ae00bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006e220 0x7f7ae00bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44410/0 (socket says 172.21.15.50:44410) 2024-01-30T08:10:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 -- 172.21.15.50:0/108369800 learned_addr learned my addr 172.21.15.50:0/108369800 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7adf400640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae01582d0 0x7f7ae0152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7adea00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006de40 0x7f7ae0151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 -- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae01582d0 msgr2=0x7f7ae0152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae01582d0 0x7f7ae0152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 -- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006de40 msgr2=0x7f7ae0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006de40 0x7f7ae0151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 -- 172.21.15.50:0/108369800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8009420 con 0x7f7ae006e220 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7adf400640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae01582d0 0x7f7ae0152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ade000640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006e220 0x7f7ae00bfd40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7ac801a0b0 tx=0x7f7ac8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ad6a00640 1 -- 172.21.15.50:0/108369800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80b4840 con 0x7f7ae006e220 2024-01-30T08:10:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ad6a00640 1 -- 172.21.15.50:0/108369800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80b49c0 con 0x7f7ae006e220 2024-01-30T08:10:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ad6a00640 1 -- 172.21.15.50:0/108369800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80b4d70 con 0x7f7ae006e220 2024-01-30T08:10:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae00ac070 con 0x7f7ae006e220 2024-01-30T08:10:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae00ac630 con 0x7f7ae006e220 2024-01-30T08:10:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0070ca0 con 0x7f7ae006e220 2024-01-30T08:10:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.976+0000 7f7ad6a00640 1 -- 172.21.15.50:0/108369800 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7ac80b2040 con 0x7f7ae006e220 2024-01-30T08:10:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.980+0000 7f7ad6a00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7ab8066500 0x7f7ab80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.980+0000 7f7ad6a00640 1 -- 172.21.15.50:0/108369800 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f7ac811e500 con 0x7f7ae006e220 2024-01-30T08:10:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.980+0000 7f7adea00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7ab8066500 0x7f7ab80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.980+0000 7f7adea00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7ab8066500 0x7f7ab80689c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009b60 tx=0x7f7ad0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:35.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:35.984+0000 7f7ad6a00640 1 -- 172.21.15.50:0/108369800 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7ac80eb2a0 con 0x7f7ae006e220 2024-01-30T08:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ae0155730 con 0x7f7ae006e220 2024-01-30T08:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ad6a00640 1 -- 172.21.15.50:0/108369800 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f7ae0155730 con 0x7f7ae006e220 2024-01-30T08:10:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:36.179 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:09:53.316367+0000","modified":"2024-01-30T08:09:56.334652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1837689837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1837689837},{"type":"v1","addr":"172.21.15.50:6835","nonce":1837689837}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-01-30T08:10:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7ab8066500 msgr2=0x7f7ab80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7ab8066500 0x7f7ab80689c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009b60 tx=0x7f7ad0009190 comp rx=0 tx=0).stop 2024-01-30T08:10:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006e220 msgr2=0x7f7ae00bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006e220 0x7f7ae00bfd40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7ac801a0b0 tx=0x7f7ac8019220 comp rx=0 tx=0).stop 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 shutdown_connections 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7ab8066500 0x7f7ab80689c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ae01582d0 0x7f7ae0152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006e220 0x7f7ae00bfd40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 --2- 172.21.15.50:0/108369800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae006de40 0x7f7ae0151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.176+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 >> 172.21.15.50:0/108369800 conn(0x7f7ae00c4830 msgr2=0x7f7ae01586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.180+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 shutdown_connections 2024-01-30T08:10:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.180+0000 7f7ae5c00640 1 -- 172.21.15.50:0/108369800 wait complete. 2024-01-30T08:10:36.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8329200640 1 Processor -- start 2024-01-30T08:10:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8329200640 1 -- start start 2024-01-30T08:10:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8329200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8329200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83240c1de0 0x7f832406a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8329200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83240c3ed0 con 0x7f83240c0ee0 2024-01-30T08:10:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8329200640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240a5520 con 0x7f83240c1de0 2024-01-30T08:10:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8329200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832406bca0 con 0x7f832414fbf0 2024-01-30T08:10:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8321e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8322800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83240c1de0 0x7f832406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8321400640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83240c0ee0 0x7f83240a4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:39212/0 (socket says 172.21.15.50:39212) 2024-01-30T08:10:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8321400640 1 -- 172.21.15.50:0/420772482 learned_addr learned my addr 172.21.15.50:0/420772482 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8321e00640 1 -- 172.21.15.50:0/420772482 >> v2:172.21.15.125:3300/0 conn(0x7f83240c1de0 msgr2=0x7f832406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8321e00640 1 --2- 172.21.15.50:0/420772482 >> v2:172.21.15.125:3300/0 conn(0x7f83240c1de0 0x7f832406a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8321e00640 1 -- 172.21.15.50:0/420772482 >> v1:172.21.15.125:6789/0 conn(0x7f83240c0ee0 legacy=0x7f83240a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8321e00640 1 -- 172.21.15.50:0/420772482 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832406bef0 con 0x7f832414fbf0 2024-01-30T08:10:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.340+0000 7f8322800640 1 --2- 172.21.15.50:0/420772482 >> v2:172.21.15.125:3300/0 conn(0x7f83240c1de0 0x7f832406a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8321e00640 1 --2- 172.21.15.50:0/420772482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241559c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83140097c0 tx=0x7f831401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df3f79c203b1987 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8320a00640 1 -- 172.21.15.50:0/420772482 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140ad680 con 0x7f832414fbf0 2024-01-30T08:10:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8320a00640 1 -- 172.21.15.50:0/420772482 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83140ad7e0 con 0x7f832414fbf0 2024-01-30T08:10:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8320a00640 1 -- 172.21.15.50:0/420772482 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140adb70 con 0x7f832414fbf0 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 -- 172.21.15.50:0/420772482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 msgr2=0x7f83241559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 --2- 172.21.15.50:0/420772482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241559c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83140097c0 tx=0x7f831401c360 comp rx=0 tx=0).stop 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 -- 172.21.15.50:0/420772482 shutdown_connections 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 --2- 172.21.15.50:0/420772482 >> v2:172.21.15.125:3300/0 conn(0x7f83240c1de0 0x7f832406a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 --2- 172.21.15.50:0/420772482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241559c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 -- 172.21.15.50:0/420772482 >> 172.21.15.50:0/420772482 conn(0x7f83240c5b50 msgr2=0x7f83240c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 -- 172.21.15.50:0/420772482 shutdown_connections 2024-01-30T08:10:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.344+0000 7f8329200640 1 -- 172.21.15.50:0/420772482 wait complete. 2024-01-30T08:10:36.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 Processor -- start 2024-01-30T08:10:36.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 -- start start 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83240c0ee0 0x7f832415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83240c1de0 0x7f8324155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832414e120 con 0x7f83240c0ee0 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832414e330 con 0x7f83240c1de0 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832414e610 con 0x7f832414fbf0 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83240c0ee0 0x7f832415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83240c0ee0 0x7f832415b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44422/0 (socket says 172.21.15.50:44422) 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 -- 172.21.15.50:0/593479872 learned_addr learned my addr 172.21.15.50:0/593479872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321400640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83240c1de0 0x7f8324155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8322800640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 -- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 msgr2=0x7f83241ed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241ed650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 -- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83240c1de0 msgr2=0x7f8324155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83240c1de0 0x7f8324155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 -- 172.21.15.50:0/593479872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c009a70 con 0x7f83240c0ee0 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8322800640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241ed650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8321e00640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83240c0ee0 0x7f832415b880 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8314019f90 tx=0x7f8314019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f831a000640 1 -- 172.21.15.50:0/593479872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140add60 con 0x7f83240c0ee0 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f831a000640 1 -- 172.21.15.50:0/593479872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83140b7470 con 0x7f83240c0ee0 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314009420 con 0x7f83240c0ee0 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f831a000640 1 -- 172.21.15.50:0/593479872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140b7820 con 0x7f83240c0ee0 2024-01-30T08:10:36.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.348+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83241ed130 con 0x7f83240c0ee0 2024-01-30T08:10:36.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.352+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8324074a20 con 0x7f83240c0ee0 2024-01-30T08:10:36.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.352+0000 7f831a000640 1 -- 172.21.15.50:0/593479872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f83140b4040 con 0x7f83240c0ee0 2024-01-30T08:10:36.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.352+0000 7f831a000640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f82fc066500 0x7f82fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.352+0000 7f831a000640 1 -- 172.21.15.50:0/593479872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f831411e7b0 con 0x7f83240c0ee0 2024-01-30T08:10:36.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.352+0000 7f8321400640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f82fc066500 0x7f82fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.352+0000 7f8321400640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f82fc066500 0x7f82fc0689c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f83241f1650 tx=0x7f830c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:36.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.356+0000 7f831a000640 1 -- 172.21.15.50:0/593479872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f83140eb550 con 0x7f83240c0ee0 2024-01-30T08:10:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.520+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8324156820 con 0x7f83240c0ee0 2024-01-30T08:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.520+0000 7f831a000640 1 -- 172.21.15.50:0/593479872 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+20633 (secure 0 0 0) 0x7f83140eeb70 con 0x7f83240c0ee0 2024-01-30T08:10:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:36.524 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":45,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:31.877153+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-30T08:09:51.121360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-30T08:09:52.315187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f82fc066500 msgr2=0x7f82fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f82fc066500 0x7f82fc0689c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f83241f1650 tx=0x7f830c009040 comp rx=0 tx=0).stop 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83240c0ee0 msgr2=0x7f832415b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83240c0ee0 0x7f832415b880 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8314019f90 tx=0x7f8314019100 comp rx=0 tx=0).stop 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 shutdown_connections 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83240c1de0 0x7f8324155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f82fc066500 0x7f82fc0689c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f832414fbf0 0x7f83241ed650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 --2- 172.21.15.50:0/593479872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83240c0ee0 0x7f832415b880 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 >> 172.21.15.50:0/593479872 conn(0x7f83240c5b50 msgr2=0x7f83240a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 shutdown_connections 2024-01-30T08:10:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.524+0000 7f8329200640 1 -- 172.21.15.50:0/593479872 wait complete. 2024-01-30T08:10:36.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-30T08:10:36.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.684+0000 7fdc51600640 1 Processor -- start 2024-01-30T08:10:36.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.684+0000 7fdc51600640 1 -- start start 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc51600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc4c14fbb0 0x7fdc4c0c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc51600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc4c0a4dc0 0x7fdc4c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc51600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c0c0980 con 0x7fdc4c06dc50 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc51600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c1564e0 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc51600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c156780 con 0x7fdc4c0a4dc0 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4aa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc4c14fbb0 0x7fdc4c0c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4b400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc4c06dc50 0x7fdc4c152660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45488/0 (socket says 172.21.15.50:45488) 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4b400640 1 -- 172.21.15.50:0/3230228485 learned_addr learned my addr 172.21.15.50:0/3230228485 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:36.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4a000640 1 --2- 172.21.15.50:0/3230228485 >> v2:172.21.15.125:3300/0 conn(0x7fdc4c0a4dc0 0x7fdc4c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4aa00640 1 -- 172.21.15.50:0/3230228485 >> v2:172.21.15.125:3300/0 conn(0x7fdc4c0a4dc0 msgr2=0x7fdc4c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4aa00640 1 --2- 172.21.15.50:0/3230228485 >> v2:172.21.15.125:3300/0 conn(0x7fdc4c0a4dc0 0x7fdc4c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4aa00640 1 -- 172.21.15.50:0/3230228485 >> v1:172.21.15.50:6789/0 conn(0x7fdc4c06dc50 legacy=0x7fdc4c152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4aa00640 1 -- 172.21.15.50:0/3230228485 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0c0610 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc49600640 1 -- 172.21.15.50:0/3230228485 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455576076 0 0) 0x7fdc4c0c0980 con 0x7fdc4c06dc50 2024-01-30T08:10:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.688+0000 7fdc4aa00640 1 --2- 172.21.15.50:0/3230228485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c0c1fd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0a8880 tx=0x7fdc3c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f0994ad600ca8f server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc49600640 1 -- 172.21.15.50:0/3230228485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0ab600 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc49600640 1 -- 172.21.15.50:0/3230228485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0a7050 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc49600640 1 -- 172.21.15.50:0/3230228485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0ab980 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- 172.21.15.50:0/3230228485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 msgr2=0x7fdc4c0c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 --2- 172.21.15.50:0/3230228485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c0c1fd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0a8880 tx=0x7fdc3c01c460 comp rx=0 tx=0).stop 2024-01-30T08:10:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- 172.21.15.50:0/3230228485 shutdown_connections 2024-01-30T08:10:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 --2- 172.21.15.50:0/3230228485 >> v2:172.21.15.125:3300/0 conn(0x7fdc4c0a4dc0 0x7fdc4c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 --2- 172.21.15.50:0/3230228485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c0c1fd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- 172.21.15.50:0/3230228485 >> 172.21.15.50:0/3230228485 conn(0x7fdc4c0c5f10 msgr2=0x7fdc4c0c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- 172.21.15.50:0/3230228485 shutdown_connections 2024-01-30T08:10:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- 172.21.15.50:0/3230228485 wait complete. 2024-01-30T08:10:36.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 Processor -- start 2024-01-30T08:10:36.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- start start 2024-01-30T08:10:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc4c06dc50 0x7fdc4c142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc4c0a4dc0 0x7fdc4c14c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c143d30 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c142c40 con 0x7fdc4c06dc50 2024-01-30T08:10:36.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.692+0000 7fdc51600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c1412d0 con 0x7fdc4c0a4dc0 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44442/0 (socket says 172.21.15.50:44442) 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 -- 172.21.15.50:0/3946901484 learned_addr learned my addr 172.21.15.50:0/3946901484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4aa00640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc4c06dc50 0x7fdc4c142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4a000640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc4c0a4dc0 0x7fdc4c14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 -- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc4c0a4dc0 msgr2=0x7fdc4c14c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc4c0a4dc0 0x7fdc4c14c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 -- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc4c06dc50 msgr2=0x7fdc4c142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc4c06dc50 0x7fdc4c142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 -- 172.21.15.50:0/3946901484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c009420 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc4b400640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c149e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c7d0 tx=0x7fdc4400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc42a00640 1 -- 172.21.15.50:0/3946901484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400a640 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc42a00640 1 -- 172.21.15.50:0/3946901484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400a7a0 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c143770 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc42a00640 1 -- 172.21.15.50:0/3946901484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400ab50 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c1421e0 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c142040 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.696+0000 7fdc42a00640 1 -- 172.21.15.50:0/3946901484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdc4400acb0 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.700+0000 7fdc42a00640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc24066500 0x7fdc240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.700+0000 7fdc42a00640 1 -- 172.21.15.50:0/3946901484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7fdc44083a30 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.700+0000 7fdc4aa00640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc24066500 0x7fdc240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:36.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.700+0000 7fdc4aa00640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc24066500 0x7fdc240689c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0ad000 tx=0x7fdc3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:36.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.704+0000 7fdc42a00640 1 -- 172.21.15.50:0/3946901484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdc4c142040 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.900+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdc4c142040 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.903 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-01-30T08:10:36.900+0000 7f42f8600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-30T08:10:36.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.904+0000 7fdc42a00640 1 -- 172.21.15.50:0/3946901484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdc4c142040 con 0x7fdc4c14fbb0 2024-01-30T08:10:36.906 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-30T08:10:36.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.904+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc24066500 msgr2=0x7fdc240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.904+0000 7fdc51600640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc24066500 0x7fdc240689c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0ad000 tx=0x7fdc3c008040 comp rx=0 tx=0).stop 2024-01-30T08:10:36.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.904+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 msgr2=0x7fdc4c149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:36.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.904+0000 7fdc51600640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c149e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c7d0 tx=0x7fdc4400cc90 comp rx=0 tx=0).stop 2024-01-30T08:10:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 shutdown_connections 2024-01-30T08:10:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdc24066500 0x7fdc240689c0 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0ad000 tx=0x7fdc3c008040 comp rx=0 tx=0).stop 2024-01-30T08:10:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc4c14fbb0 0x7fdc4c149e40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc4c0a4dc0 0x7fdc4c14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 --2- 172.21.15.50:0/3946901484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc4c06dc50 0x7fdc4c142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:36.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 >> 172.21.15.50:0/3946901484 conn(0x7fdc4c0c5f10 msgr2=0x7fdc4c1473f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 shutdown_connections 2024-01-30T08:10:36.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:36.908+0000 7fdc51600640 1 -- 172.21.15.50:0/3946901484 wait complete. 2024-01-30T08:10:36.916 INFO:tasks.ceph.mds.a.smithi050.stderr: -3088> 2024-01-30T08:09:57.881+0000 7fc62a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-30T08:10:36.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-30T08:10:36.965 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-01-30T08:10:37.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cfd400640 1 Processor -- start 2024-01-30T08:10:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cfd400640 1 -- start start 2024-01-30T08:10:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cfd400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6cf8155500 0x7f6cf80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cfd400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cf806f240 0x7f6cf806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cfd400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf8158b70 con 0x7f6cf80c1200 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cfd400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf8157f60 con 0x7f6cf806f240 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cfd400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf8158240 con 0x7f6cf8155500 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cf806f240 0x7f6cf806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cf806f240 0x7f6cf806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44480/0 (socket says 172.21.15.50:44480) 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf7200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6cf80c1200 0x7f6cf80c1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45504/0 (socket says 172.21.15.50:45504) 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5e00640 1 -- 172.21.15.50:0/1941366943 learned_addr learned my addr 172.21.15.50:0/1941366943 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf6800640 1 --2- 172.21.15.50:0/1941366943 >> v2:172.21.15.125:3300/0 conn(0x7f6cf8155500 0x7f6cf80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5e00640 1 -- 172.21.15.50:0/1941366943 >> v2:172.21.15.125:3300/0 conn(0x7f6cf8155500 msgr2=0x7f6cf80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5e00640 1 --2- 172.21.15.50:0/1941366943 >> v2:172.21.15.125:3300/0 conn(0x7f6cf8155500 0x7f6cf80c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5e00640 1 -- 172.21.15.50:0/1941366943 >> v1:172.21.15.50:6789/0 conn(0x7f6cf80c1200 legacy=0x7f6cf80c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5e00640 1 -- 172.21.15.50:0/1941366943 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8158520 con 0x7f6cf806f240 2024-01-30T08:10:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.076+0000 7f6cf5400640 1 -- 172.21.15.50:0/1941366943 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160735799 0 0) 0x7f6cf8158b70 con 0x7f6cf80c1200 2024-01-30T08:10:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cf5e00640 1 --2- 172.21.15.50:0/1941366943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf806f6d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80aaaf0 tx=0x7f6ce001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d57de86b24730d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cf5400640 1 -- 172.21.15.50:0/1941366943 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00ac630 con 0x7f6cf806f240 2024-01-30T08:10:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cf5400640 1 -- 172.21.15.50:0/1941366943 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce00ac790 con 0x7f6cf806f240 2024-01-30T08:10:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cf5400640 1 -- 172.21.15.50:0/1941366943 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00acb20 con 0x7f6cf806f240 2024-01-30T08:10:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 -- 172.21.15.50:0/1941366943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 msgr2=0x7f6cf806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 --2- 172.21.15.50:0/1941366943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf806f6d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80aaaf0 tx=0x7f6ce001c3b0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 -- 172.21.15.50:0/1941366943 shutdown_connections 2024-01-30T08:10:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 --2- 172.21.15.50:0/1941366943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf806f6d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 --2- 172.21.15.50:0/1941366943 >> v2:172.21.15.125:3300/0 conn(0x7f6cf8155500 0x7f6cf80c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 -- 172.21.15.50:0/1941366943 >> 172.21.15.50:0/1941366943 conn(0x7f6cf80727c0 msgr2=0x7f6cf806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 -- 172.21.15.50:0/1941366943 shutdown_connections 2024-01-30T08:10:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.080+0000 7f6cfd400640 1 -- 172.21.15.50:0/1941366943 wait complete. 2024-01-30T08:10:37.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 Processor -- start 2024-01-30T08:10:37.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 -- start start 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf80a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cf80c1200 0x7f6cf80a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cf8155500 0x7f6cf8159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf814bee0 con 0x7f6cf806f240 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf80a6520 con 0x7f6cf8155500 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf80a6c60 con 0x7f6cf80c1200 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf80a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf80a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44484/0 (socket says 172.21.15.50:44484) 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 -- 172.21.15.50:0/2783240884 learned_addr learned my addr 172.21.15.50:0/2783240884 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf5e00640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cf80c1200 0x7f6cf80a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf7200640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cf8155500 0x7f6cf8159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 -- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cf80c1200 msgr2=0x7f6cf80a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cf80c1200 0x7f6cf80a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 -- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cf8155500 msgr2=0x7f6cf8159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cf8155500 0x7f6cf8159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 -- 172.21.15.50:0/2783240884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce00094d0 con 0x7f6cf806f240 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cf6800640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf80a5aa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800d800 tx=0x7f6ce800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6ceea00640 1 -- 172.21.15.50:0/2783240884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce800b6c0 con 0x7f6cf806f240 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6ceea00640 1 -- 172.21.15.50:0/2783240884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce800b820 con 0x7f6cf806f240 2024-01-30T08:10:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6ceea00640 1 -- 172.21.15.50:0/2783240884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce800bb90 con 0x7f6cf806f240 2024-01-30T08:10:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf80a6f40 con 0x7f6cf806f240 2024-01-30T08:10:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.084+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf81edfa0 con 0x7f6cf806f240 2024-01-30T08:10:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.088+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf80a89a0 con 0x7f6cf806f240 2024-01-30T08:10:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.088+0000 7f6ceea00640 1 -- 172.21.15.50:0/2783240884 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6ce800bcf0 con 0x7f6cf806f240 2024-01-30T08:10:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.088+0000 7f6ceea00640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6cd0066500 0x7f6cd00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.088+0000 7f6ceea00640 1 -- 172.21.15.50:0/2783240884 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f6ce8084930 con 0x7f6cf806f240 2024-01-30T08:10:37.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.088+0000 7f6cf5e00640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6cd0066500 0x7f6cd00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:37.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.088+0000 7f6cf5e00640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6cd0066500 0x7f6cd00689c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00ae000 tx=0x7f6ce0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.092+0000 7f6ceea00640 1 -- 172.21.15.50:0/2783240884 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6cf80a89a0 con 0x7f6cf806f240 2024-01-30T08:10:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.284+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6cf80a89a0 con 0x7f6cf806f240 2024-01-30T08:10:37.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.908+0000 7f6ceea00640 1 -- 172.21.15.50:0/2783240884 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6cf80a89a0 con 0x7f6cf806f240 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.908+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6cd0066500 msgr2=0x7f6cd00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.908+0000 7f6cfd400640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6cd0066500 0x7f6cd00689c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00ae000 tx=0x7f6ce0008040 comp rx=0 tx=0).stop 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.908+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 msgr2=0x7f6cf80a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.908+0000 7f6cfd400640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf80a5aa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800d800 tx=0x7f6ce800dcc0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 shutdown_connections 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6cf8155500 0x7f6cf8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6cd0066500 0x7f6cd00689c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6cf80c1200 0x7f6cf80a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 --2- 172.21.15.50:0/2783240884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf806f240 0x7f6cf80a5aa0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 >> 172.21.15.50:0/2783240884 conn(0x7f6cf80727c0 msgr2=0x7f6cf80acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 shutdown_connections 2024-01-30T08:10:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:37.912+0000 7f6cfd400640 1 -- 172.21.15.50:0/2783240884 wait complete. 2024-01-30T08:10:37.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-30T08:10:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac4000640 1 Processor -- start 2024-01-30T08:10:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac4000640 1 -- start start 2024-01-30T08:10:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac4000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbabc0c3130 0x7fbabc1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac4000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc06c5f0 con 0x7fbabc06ca80 2024-01-30T08:10:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac4000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc158d80 con 0x7fbabc0c4960 2024-01-30T08:10:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac4000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc0c3a20 con 0x7fbabc0c3130 2024-01-30T08:10:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac2000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbabc0c3130 0x7fbabc1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac0c00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbabc06ca80 0x7fbabc1551d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45510/0 (socket says 172.21.15.50:45510) 2024-01-30T08:10:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac0c00640 1 -- 172.21.15.50:0/2926668548 learned_addr learned my addr 172.21.15.50:0/2926668548 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac2000640 1 -- 172.21.15.50:0/2926668548 >> v1:172.21.15.125:6789/0 conn(0x7fbabc0c4960 legacy=0x7fbabc0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac2000640 1 -- 172.21.15.50:0/2926668548 >> v1:172.21.15.50:6789/0 conn(0x7fbabc06ca80 legacy=0x7fbabc1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.124+0000 7fbac2000640 1 -- 172.21.15.50:0/2926668548 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc06bfa0 con 0x7fbabc0c3130 2024-01-30T08:10:38.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac2000640 1 --2- 172.21.15.50:0/2926668548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc0c3130 0x7fbabc1602d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009d90 tx=0x7fbab401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae97199749c8ac92 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:38.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbabbe00640 1 -- 172.21.15.50:0/2926668548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40a5940 con 0x7fbabc0c3130 2024-01-30T08:10:38.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbabbe00640 1 -- 172.21.15.50:0/2926668548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab40a5aa0 con 0x7fbabc0c3130 2024-01-30T08:10:38.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbabbe00640 1 -- 172.21.15.50:0/2926668548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40a5e30 con 0x7fbabc0c3130 2024-01-30T08:10:38.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac4000640 1 -- 172.21.15.50:0/2926668548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc0c3130 msgr2=0x7fbabc1602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:38.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac4000640 1 --2- 172.21.15.50:0/2926668548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc0c3130 0x7fbabc1602d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009d90 tx=0x7fbab401c8e0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac4000640 1 -- 172.21.15.50:0/2926668548 shutdown_connections 2024-01-30T08:10:38.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac4000640 1 --2- 172.21.15.50:0/2926668548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc0c3130 0x7fbabc1602d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac4000640 1 -- 172.21.15.50:0/2926668548 >> 172.21.15.50:0/2926668548 conn(0x7fbabc0a9a80 msgr2=0x7fbabc0a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:38.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac4000640 1 -- 172.21.15.50:0/2926668548 shutdown_connections 2024-01-30T08:10:38.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.128+0000 7fbac4000640 1 -- 172.21.15.50:0/2926668548 wait complete. 2024-01-30T08:10:38.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 Processor -- start 2024-01-30T08:10:38.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 -- start start 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc06ca80 0x7fbabc157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbabc0c3130 0x7fbabc06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbabc0c4960 0x7fbabc1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc1f1490 con 0x7fbabc06ca80 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc1f05e0 con 0x7fbabc0c3130 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc1f0880 con 0x7fbabc0c4960 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc06ca80 0x7fbabc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc06ca80 0x7fbabc157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44512/0 (socket says 172.21.15.50:44512) 2024-01-30T08:10:38.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 -- 172.21.15.50:0/3889892186 learned_addr learned my addr 172.21.15.50:0/3889892186 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:38.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac2000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbabc0c4960 0x7fbabc1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 -- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbabc0c4960 msgr2=0x7fbabc1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbabc0c4960 0x7fbabc1534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 -- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbabc0c3130 msgr2=0x7fbabc06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac0c00640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbabc0c3130 0x7fbabc06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbabc0c3130 0x7fbabc06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 -- 172.21.15.50:0/3889892186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4009a70 con 0x7fbabc06ca80 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac2000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbabc0c4960 0x7fbabc1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac0c00640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbabc0c3130 0x7fbabc06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac1600640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc06ca80 0x7fbabc157520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00b410 tx=0x7fbaac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbab9600640 1 -- 172.21.15.50:0/3889892186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac004020 con 0x7fbabc06ca80 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbab9600640 1 -- 172.21.15.50:0/3889892186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac004180 con 0x7fbabc06ca80 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbab9600640 1 -- 172.21.15.50:0/3889892186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac011630 con 0x7fbabc06ca80 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc155a60 con 0x7fbabc06ca80 2024-01-30T08:10:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.132+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc1f0e40 con 0x7fbabc06ca80 2024-01-30T08:10:38.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.136+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc074a20 con 0x7fbabc06ca80 2024-01-30T08:10:38.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.136+0000 7fbab9600640 1 -- 172.21.15.50:0/3889892186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbaac011790 con 0x7fbabc06ca80 2024-01-30T08:10:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.136+0000 7fbab9600640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fba94066500 0x7fba940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.136+0000 7fbab9600640 1 -- 172.21.15.50:0/3889892186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7058+0+0 (secure 0 0 0) 0x7fbaac084130 con 0x7fbabc06ca80 2024-01-30T08:10:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.136+0000 7fbac0c00640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fba94066500 0x7fba940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:38.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.136+0000 7fbac0c00640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fba94066500 0x7fba940689c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4007fd0 tx=0x7fbaa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:38.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.140+0000 7fbab9600640 1 -- 172.21.15.50:0/3889892186 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbaac050e70 con 0x7fbabc06ca80 2024-01-30T08:10:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.304+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbabc0c5cb0 con 0x7fbabc06ca80 2024-01-30T08:10:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.908+0000 7fbab9600640 1 -- 172.21.15.50:0/3889892186 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbaac054490 con 0x7fbabc06ca80 2024-01-30T08:10:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-01-30T08:10:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fba94066500 msgr2=0x7fba940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fba94066500 0x7fba940689c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4007fd0 tx=0x7fbaa4009040 comp rx=0 tx=0).stop 2024-01-30T08:10:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc06ca80 msgr2=0x7fbabc157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc06ca80 0x7fbabc157520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00b410 tx=0x7fbaac00b8d0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 shutdown_connections 2024-01-30T08:10:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbabc0c3130 0x7fbabc06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fba94066500 0x7fba940689c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbabc0c4960 0x7fbabc1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 --2- 172.21.15.50:0/3889892186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbabc06ca80 0x7fbabc157520 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 >> 172.21.15.50:0/3889892186 conn(0x7fbabc0a9a80 msgr2=0x7fbabc0c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:38.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.912+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 shutdown_connections 2024-01-30T08:10:38.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:38.916+0000 7fbac4000640 1 -- 172.21.15.50:0/3889892186 wait complete. 2024-01-30T08:10:38.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-30T08:10:39.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f4a000640 1 Processor -- start 2024-01-30T08:10:39.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f4a000640 1 -- start start 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f4a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f440a70d0 0x7f7f440c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f4a000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f4406e1f0 0x7f7f4414f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f4a000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f441535e0 con 0x7f7f4414fd90 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f4a000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f4406f2e0 con 0x7f7f440a70d0 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f4a000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f44152a60 con 0x7f7f4406e1f0 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f43400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f440a70d0 0x7f7f440c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f43400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f440a70d0 0x7f7f440c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60630/0 (socket says 172.21.15.50:60630) 2024-01-30T08:10:39.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f43400640 1 -- 172.21.15.50:0/2236396540 learned_addr learned my addr 172.21.15.50:0/2236396540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:39.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.088+0000 7f7f42a00640 1 --2- 172.21.15.50:0/2236396540 >> v2:172.21.15.125:3300/0 conn(0x7f7f4406e1f0 0x7f7f4414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:39.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f43400640 1 -- 172.21.15.50:0/2236396540 >> v2:172.21.15.125:3300/0 conn(0x7f7f4406e1f0 msgr2=0x7f7f4414f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:39.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f43400640 1 --2- 172.21.15.50:0/2236396540 >> v2:172.21.15.125:3300/0 conn(0x7f7f4406e1f0 0x7f7f4414f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f43400640 1 -- 172.21.15.50:0/2236396540 >> v1:172.21.15.50:6789/0 conn(0x7f7f4414fd90 legacy=0x7f7f440c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:39.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f43400640 1 -- 172.21.15.50:0/2236396540 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f44152d40 con 0x7f7f440a70d0 2024-01-30T08:10:39.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f43400640 1 --2- 172.21.15.50:0/2236396540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f440c7660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7f44071bf0 tx=0x7f7f3401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c273b6b0ebf27877 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:39.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f42000640 1 -- 172.21.15.50:0/2236396540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340ab600 con 0x7f7f440a70d0 2024-01-30T08:10:39.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f42000640 1 -- 172.21.15.50:0/2236396540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f340a7050 con 0x7f7f440a70d0 2024-01-30T08:10:39.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f42000640 1 -- 172.21.15.50:0/2236396540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340ab980 con 0x7f7f440a70d0 2024-01-30T08:10:39.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f4a000640 1 -- 172.21.15.50:0/2236396540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 msgr2=0x7f7f440c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.092+0000 7f7f4a000640 1 --2- 172.21.15.50:0/2236396540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f440c7660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7f44071bf0 tx=0x7f7f3401c470 comp rx=0 tx=0).stop 2024-01-30T08:10:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- 172.21.15.50:0/2236396540 shutdown_connections 2024-01-30T08:10:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 --2- 172.21.15.50:0/2236396540 >> v2:172.21.15.125:3300/0 conn(0x7f7f4406e1f0 0x7f7f4414f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 --2- 172.21.15.50:0/2236396540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f440c7660 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- 172.21.15.50:0/2236396540 >> 172.21.15.50:0/2236396540 conn(0x7f7f440a9a80 msgr2=0x7f7f440a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- 172.21.15.50:0/2236396540 shutdown_connections 2024-01-30T08:10:39.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- 172.21.15.50:0/2236396540 wait complete. 2024-01-30T08:10:39.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 Processor -- start 2024-01-30T08:10:39.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- start start 2024-01-30T08:10:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4406e1f0 0x7f7f44151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f441f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f4414fd90 0x7f7f441f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:39.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4414dfd0 con 0x7f7f440a70d0 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440ab2d0 con 0x7f7f4406e1f0 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f4a000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440ac4a0 con 0x7f7f4414fd90 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f441f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f441f03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60632/0 (socket says 172.21.15.50:60632) 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 -- 172.21.15.50:0/1827291630 learned_addr learned my addr 172.21.15.50:0/1827291630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f43e00640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f4414fd90 0x7f7f441f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f43400640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4406e1f0 0x7f7f44151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 -- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f4414fd90 msgr2=0x7f7f441f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f4414fd90 0x7f7f441f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 -- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4406e1f0 msgr2=0x7f7f44151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4406e1f0 0x7f7f44151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.096+0000 7f7f42a00640 1 -- 172.21.15.50:0/1827291630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340094d0 con 0x7f7f440a70d0 2024-01-30T08:10:39.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f42a00640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f441f03b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00d5f0 tx=0x7f7f2c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:39.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f3b400640 1 -- 172.21.15.50:0/1827291630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0125f0 con 0x7f7f440a70d0 2024-01-30T08:10:39.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f3b400640 1 -- 172.21.15.50:0/1827291630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c012750 con 0x7f7f440a70d0 2024-01-30T08:10:39.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f441f0e30 con 0x7f7f440a70d0 2024-01-30T08:10:39.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f3b400640 1 -- 172.21.15.50:0/1827291630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c012ae0 con 0x7f7f440a70d0 2024-01-30T08:10:39.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f440aad10 con 0x7f7f440a70d0 2024-01-30T08:10:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f44074a20 con 0x7f7f440a70d0 2024-01-30T08:10:39.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f3b400640 1 -- 172.21.15.50:0/1827291630 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7f2c012c40 con 0x7f7f440a70d0 2024-01-30T08:10:39.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f3b400640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f1c066530 0x7f7f1c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:39.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f3b400640 1 -- 172.21.15.50:0/1827291630 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6620+0+0 (secure 0 0 0) 0x7f7f2c084680 con 0x7f7f440a70d0 2024-01-30T08:10:39.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.100+0000 7f7f43400640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f1c066530 0x7f7f1c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:39.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.104+0000 7f7f43400640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f1c066530 0x7f7f1c0689f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f340ad000 tx=0x7f7f34008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.104+0000 7f7f3b400640 1 -- 172.21.15.50:0/1827291630 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7f2c051600 con 0x7f7f440a70d0 2024-01-30T08:10:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.264+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f440aa0b0 con 0x7f7f440a70d0 2024-01-30T08:10:39.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.916+0000 7f7f3b400640 1 -- 172.21.15.50:0/1827291630 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7f2c007380 con 0x7f7f440a70d0 2024-01-30T08:10:39.919 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-01-30T08:10:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f1c066530 msgr2=0x7f7f1c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f1c066530 0x7f7f1c0689f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f340ad000 tx=0x7f7f34008040 comp rx=0 tx=0).stop 2024-01-30T08:10:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 msgr2=0x7f7f441f03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f441f03b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00d5f0 tx=0x7f7f2c00dab0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 shutdown_connections 2024-01-30T08:10:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7f1c066530 0x7f7f1c0689f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f4414fd90 0x7f7f441f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f440a70d0 0x7f7f441f03b0 secure :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00d5f0 tx=0x7f7f2c00dab0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 --2- 172.21.15.50:0/1827291630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4406e1f0 0x7f7f44151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 >> 172.21.15.50:0/1827291630 conn(0x7f7f440a9a80 msgr2=0x7f7f440c25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 shutdown_connections 2024-01-30T08:10:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:39.920+0000 7f7f4a000640 1 -- 172.21.15.50:0/1827291630 wait complete. 2024-01-30T08:10:39.953 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:40.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feeca400640 1 Processor -- start 2024-01-30T08:10:40.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feeca400640 1 -- start start 2024-01-30T08:10:40.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feeca400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feec40c5650 0x7feec406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feeca400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c4760 0x7feec406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feeca400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40a8cf0 con 0x7feec40c1840 2024-01-30T08:10:40.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feeca400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec4072a30 con 0x7feec40c5650 2024-01-30T08:10:40.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feeca400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40a8f40 con 0x7feec40c4760 2024-01-30T08:10:40.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec3400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feec40c1840 0x7feec40a4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44196/0 (socket says 172.21.15.50:44196) 2024-01-30T08:10:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec3400640 1 -- 172.21.15.50:0/881362867 learned_addr learned my addr 172.21.15.50:0/881362867 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec2a00640 1 --2- 172.21.15.50:0/881362867 >> v2:172.21.15.125:3300/0 conn(0x7feec40c5650 0x7feec406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec3e00640 1 --2- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c4760 0x7feec406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec2000640 1 -- 172.21.15.50:0/881362867 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956197701 0 0) 0x7feec40a8cf0 con 0x7feec40c1840 2024-01-30T08:10:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec2000640 1 -- 172.21.15.50:0/881362867 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea4003530 con 0x7feec40c1840 2024-01-30T08:10:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec2a00640 1 -- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c4760 msgr2=0x7feec406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec2a00640 1 --2- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c4760 0x7feec406d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec2a00640 1 -- 172.21.15.50:0/881362867 >> v1:172.21.15.50:6789/0 conn(0x7feec40c1840 legacy=0x7feec40a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.096+0000 7feec2a00640 1 -- 172.21.15.50:0/881362867 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4072cd0 con 0x7feec40c5650 2024-01-30T08:10:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feec2a00640 1 --2- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c5650 0x7feec406cf00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097c0 tx=0x7feeac01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57075f8fee09af7e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feec2000640 1 -- 172.21.15.50:0/881362867 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0ab610 con 0x7feec40c5650 2024-01-30T08:10:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feec2000640 1 -- 172.21.15.50:0/881362867 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac0ab770 con 0x7feec40c5650 2024-01-30T08:10:40.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feec2000640 1 -- 172.21.15.50:0/881362867 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0abb00 con 0x7feec40c5650 2024-01-30T08:10:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feeca400640 1 -- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c5650 msgr2=0x7feec406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feeca400640 1 --2- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c5650 0x7feec406cf00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097c0 tx=0x7feeac01c3f0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feeca400640 1 -- 172.21.15.50:0/881362867 shutdown_connections 2024-01-30T08:10:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feeca400640 1 --2- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c4760 0x7feec406d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feeca400640 1 --2- 172.21.15.50:0/881362867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c5650 0x7feec406cf00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.100+0000 7feeca400640 1 -- 172.21.15.50:0/881362867 >> 172.21.15.50:0/881362867 conn(0x7feec40c5b50 msgr2=0x7feec40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 -- 172.21.15.50:0/881362867 shutdown_connections 2024-01-30T08:10:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 -- 172.21.15.50:0/881362867 wait complete. 2024-01-30T08:10:40.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 Processor -- start 2024-01-30T08:10:40.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 -- start start 2024-01-30T08:10:40.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c1840 0x7feec41ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec40c4760 0x7feec414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c5650 0x7feec4152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40c0aa0 con 0x7feec40c4760 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4070000 con 0x7feec40c1840 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feeca400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec41ed140 con 0x7feec40c5650 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec40c4760 0x7feec414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec40c4760 0x7feec414add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60638/0 (socket says 172.21.15.50:60638) 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 -- 172.21.15.50:0/1623912931 learned_addr learned my addr 172.21.15.50:0/1623912931 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec3400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c1840 0x7feec41ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec3e00640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c5650 0x7feec4152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 -- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c5650 msgr2=0x7feec4152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c5650 0x7feec4152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 -- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c1840 msgr2=0x7feec41ecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c1840 0x7feec41ecc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 -- 172.21.15.50:0/1623912931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac009420 con 0x7feec40c4760 2024-01-30T08:10:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec3e00640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c5650 0x7feec4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.104+0000 7feec2a00640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec40c4760 0x7feec414add0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7feeac0ad040 tx=0x7feeac01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feebb400640 1 -- 172.21.15.50:0/1623912931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0bf610 con 0x7feec40c4760 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feebb400640 1 -- 172.21.15.50:0/1623912931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac0bf770 con 0x7feec40c4760 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40a7440 con 0x7feec40c4760 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feebb400640 1 -- 172.21.15.50:0/1623912931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0bfb20 con 0x7feec40c4760 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec4070530 con 0x7feec40c4760 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec4074a20 con 0x7feec40c4760 2024-01-30T08:10:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feebb400640 1 -- 172.21.15.50:0/1623912931 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7feeac0bfc80 con 0x7feec40c4760 2024-01-30T08:10:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feebb400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee9c066500 0x7fee9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feebb400640 1 -- 172.21.15.50:0/1623912931 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7feeac11ea50 con 0x7feec40c4760 2024-01-30T08:10:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.108+0000 7feec3400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee9c066500 0x7fee9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.112+0000 7feec3400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee9c066500 0x7fee9c0689c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feeb4007fd0 tx=0x7feeb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.112+0000 7feebb400640 1 -- 172.21.15.50:0/1623912931 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7feeac0ebd70 con 0x7feec40c4760 2024-01-30T08:10:40.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.288+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feec40c4540 con 0x7feec40c4760 2024-01-30T08:10:40.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.288+0000 7feebb400640 1 -- 172.21.15.50:0/1623912931 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+17003 (secure 0 0 0) 0x7feeac0ef390 con 0x7feec40c4760 2024-01-30T08:10:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:40.292 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":48,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:39.914440+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/1837689837":"2024-01-31T08:10:36.904003+0000","172.21.15.50:6834/1837689837":"2024-01-31T08:10:36.904003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee9c066500 msgr2=0x7fee9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee9c066500 0x7fee9c0689c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feeb4007fd0 tx=0x7feeb4009040 comp rx=0 tx=0).stop 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec40c4760 msgr2=0x7feec414add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec40c4760 0x7feec414add0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7feeac0ad040 tx=0x7feeac01ac30 comp rx=0 tx=0).stop 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 shutdown_connections 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee9c066500 0x7fee9c0689c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feec40c5650 0x7feec4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec40c4760 0x7feec414add0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 --2- 172.21.15.50:0/1623912931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec40c1840 0x7feec41ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 >> 172.21.15.50:0/1623912931 conn(0x7feec40c5b50 msgr2=0x7feec4072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 shutdown_connections 2024-01-30T08:10:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.292+0000 7feeca400640 1 -- 172.21.15.50:0/1623912931 wait complete. 2024-01-30T08:10:40.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-30T08:08:35.110596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-30T08:10:09.022581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-30T08:10:10.287235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-30T08:10:40.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-30T08:10:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e40000640 1 Processor -- start 2024-01-30T08:10:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e40000640 1 -- start start 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e40000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e380c04b0 0x7f6e38153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e40000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e380c54e0 con 0x7f6e3814fbf0 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e40000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e38152bf0 con 0x7f6e380a4da0 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e40000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e38072d90 con 0x7f6e380c04b0 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e3e000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e380c04b0 0x7f6e38153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e3d600640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e3814fbf0 0x7f6e380c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44202/0 (socket says 172.21.15.50:44202) 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e3e000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e380c04b0 0x7f6e38153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60640/0 (socket says 172.21.15.50:60640) 2024-01-30T08:10:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e3d600640 1 -- 172.21.15.50:0/1179727525 learned_addr learned my addr 172.21.15.50:0/1179727525 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e3e000640 1 -- 172.21.15.50:0/1179727525 >> v1:172.21.15.125:6789/0 conn(0x7f6e380a4da0 legacy=0x7f6e3806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e3e000640 1 -- 172.21.15.50:0/1179727525 >> v1:172.21.15.50:6789/0 conn(0x7f6e3814fbf0 legacy=0x7f6e380c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.456+0000 7f6e3e000640 1 -- 172.21.15.50:0/1179727525 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e381525e0 con 0x7f6e380c04b0 2024-01-30T08:10:40.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e3e000640 1 --2- 172.21.15.50:0/1179727525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380c04b0 0x7f6e38153080 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009d90 tx=0x7f6e3001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b39a541be5e7d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e37e00640 1 -- 172.21.15.50:0/1179727525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e300a57e0 con 0x7f6e380c04b0 2024-01-30T08:10:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e37e00640 1 -- 172.21.15.50:0/1179727525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e300a5940 con 0x7f6e380c04b0 2024-01-30T08:10:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e37e00640 1 -- 172.21.15.50:0/1179727525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e300a5cd0 con 0x7f6e380c04b0 2024-01-30T08:10:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e40000640 1 -- 172.21.15.50:0/1179727525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380c04b0 msgr2=0x7f6e38153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e40000640 1 --2- 172.21.15.50:0/1179727525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380c04b0 0x7f6e38153080 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009d90 tx=0x7f6e3001c830 comp rx=0 tx=0).stop 2024-01-30T08:10:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e40000640 1 -- 172.21.15.50:0/1179727525 shutdown_connections 2024-01-30T08:10:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e40000640 1 --2- 172.21.15.50:0/1179727525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380c04b0 0x7f6e38153080 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e40000640 1 -- 172.21.15.50:0/1179727525 >> 172.21.15.50:0/1179727525 conn(0x7f6e380c5b30 msgr2=0x7f6e380c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e40000640 1 -- 172.21.15.50:0/1179727525 shutdown_connections 2024-01-30T08:10:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.460+0000 7f6e40000640 1 -- 172.21.15.50:0/1179727525 wait complete. 2024-01-30T08:10:40.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 Processor -- start 2024-01-30T08:10:40.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 -- start start 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380a4da0 0x7f6e380c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e380c04b0 0x7f6e38155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3814fbf0 0x7f6e38155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3815d0c0 con 0x7f6e380a4da0 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380abd90 con 0x7f6e380c04b0 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380abab0 con 0x7f6e3814fbf0 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380a4da0 0x7f6e380c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380a4da0 0x7f6e380c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60652/0 (socket says 172.21.15.50:60652) 2024-01-30T08:10:40.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 -- 172.21.15.50:0/2306227566 learned_addr learned my addr 172.21.15.50:0/2306227566 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3e000640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3814fbf0 0x7f6e38155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3cc00640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e380c04b0 0x7f6e38155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 -- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3814fbf0 msgr2=0x7f6e38155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3814fbf0 0x7f6e38155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 -- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e380c04b0 msgr2=0x7f6e38155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e380c04b0 0x7f6e38155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 -- 172.21.15.50:0/2306227566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30009a70 con 0x7f6e380a4da0 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3cc00640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e380c04b0 0x7f6e38155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e3d600640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380a4da0 0x7f6e380c3b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c400 tx=0x7f6e2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e35600640 1 -- 172.21.15.50:0/2306227566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28005cf0 con 0x7f6e380a4da0 2024-01-30T08:10:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e35600640 1 -- 172.21.15.50:0/2306227566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28005e50 con 0x7f6e380a4da0 2024-01-30T08:10:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e35600640 1 -- 172.21.15.50:0/2306227566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280072d0 con 0x7f6e380a4da0 2024-01-30T08:10:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3815ca00 con 0x7f6e380a4da0 2024-01-30T08:10:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.464+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e380c40b0 con 0x7f6e380a4da0 2024-01-30T08:10:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.468+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e38067cc0 con 0x7f6e380a4da0 2024-01-30T08:10:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.468+0000 7f6e35600640 1 -- 172.21.15.50:0/2306227566 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6e28007430 con 0x7f6e380a4da0 2024-01-30T08:10:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.468+0000 7f6e35600640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e10066530 0x7f6e100689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.468+0000 7f6e35600640 1 -- 172.21.15.50:0/2306227566 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f6e280834f0 con 0x7f6e380a4da0 2024-01-30T08:10:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.468+0000 7f6e3cc00640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e10066530 0x7f6e100689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.468+0000 7f6e3cc00640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e10066530 0x7f6e100689f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e381f15e0 tx=0x7f6e20009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.472+0000 7f6e35600640 1 -- 172.21.15.50:0/2306227566 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6e28050650 con 0x7f6e380a4da0 2024-01-30T08:10:40.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.632+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e38074a20 con 0x7f6e380a4da0 2024-01-30T08:10:40.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.632+0000 7f6e35600640 1 -- 172.21.15.50:0/2306227566 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e28053c70 con 0x7f6e380a4da0 2024-01-30T08:10:40.637 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-01-30T08:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e10066530 msgr2=0x7f6e100689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e10066530 0x7f6e100689f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e381f15e0 tx=0x7f6e20009040 comp rx=0 tx=0).stop 2024-01-30T08:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380a4da0 msgr2=0x7f6e380c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380a4da0 0x7f6e380c3b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c400 tx=0x7f6e2800c8c0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 shutdown_connections 2024-01-30T08:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e380c04b0 0x7f6e38155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6e10066530 0x7f6e100689f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e3814fbf0 0x7f6e38155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 --2- 172.21.15.50:0/2306227566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e380a4da0 0x7f6e380c3b70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 >> 172.21.15.50:0/2306227566 conn(0x7f6e380c5b30 msgr2=0x7f6e38072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 shutdown_connections 2024-01-30T08:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.636+0000 7f6e40000640 1 -- 172.21.15.50:0/2306227566 wait complete. 2024-01-30T08:10:40.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-30T08:10:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f6b200640 1 Processor -- start 2024-01-30T08:10:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f6b200640 1 -- start start 2024-01-30T08:10:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f6b200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f640c04b0 0x7f5f64153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f6b200640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640c54e0 con 0x7f5f640a4da0 2024-01-30T08:10:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f6b200640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f64152bf0 con 0x7f5f6414fbf0 2024-01-30T08:10:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f6b200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64072d90 con 0x7f5f640c04b0 2024-01-30T08:10:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f63400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f640a4da0 0x7f5f6406ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44206/0 (socket says 172.21.15.50:44206) 2024-01-30T08:10:40.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f63400640 1 -- 172.21.15.50:0/4000727848 learned_addr learned my addr 172.21.15.50:0/4000727848 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.800+0000 7f5f69200640 1 --2- 172.21.15.50:0/4000727848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f640c04b0 0x7f5f64153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f62a00640 1 -- 172.21.15.50:0/4000727848 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87890703 0 0) 0x7f5f640c54e0 con 0x7f5f640a4da0 2024-01-30T08:10:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f62a00640 1 -- 172.21.15.50:0/4000727848 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f44003530 con 0x7f5f640a4da0 2024-01-30T08:10:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f62a00640 1 -- 172.21.15.50:0/4000727848 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5595879 0 0) 0x7f5f64152bf0 con 0x7f5f6414fbf0 2024-01-30T08:10:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f62a00640 1 -- 172.21.15.50:0/4000727848 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f640c54e0 con 0x7f5f6414fbf0 2024-01-30T08:10:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f69200640 1 -- 172.21.15.50:0/4000727848 >> v1:172.21.15.125:6789/0 conn(0x7f5f6414fbf0 legacy=0x7f5f640c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f69200640 1 -- 172.21.15.50:0/4000727848 >> v1:172.21.15.50:6789/0 conn(0x7f5f640a4da0 legacy=0x7f5f6406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f69200640 1 -- 172.21.15.50:0/4000727848 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f641525e0 con 0x7f5f640c04b0 2024-01-30T08:10:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f69200640 1 --2- 172.21.15.50:0/4000727848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f640c04b0 0x7f5f64153080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009dc0 tx=0x7f5f5c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6001b2539ebff15c server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f62a00640 1 -- 172.21.15.50:0/4000727848 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0a5890 con 0x7f5f640c04b0 2024-01-30T08:10:40.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f62a00640 1 -- 172.21.15.50:0/4000727848 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c0a59f0 con 0x7f5f640c04b0 2024-01-30T08:10:40.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.804+0000 7f5f62a00640 1 -- 172.21.15.50:0/4000727848 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0a5d60 con 0x7f5f640c04b0 2024-01-30T08:10:40.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- 172.21.15.50:0/4000727848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f640c04b0 msgr2=0x7f5f64153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 --2- 172.21.15.50:0/4000727848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f640c04b0 0x7f5f64153080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009dc0 tx=0x7f5f5c01c8e0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- 172.21.15.50:0/4000727848 shutdown_connections 2024-01-30T08:10:40.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 --2- 172.21.15.50:0/4000727848 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f640c04b0 0x7f5f64153080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- 172.21.15.50:0/4000727848 >> 172.21.15.50:0/4000727848 conn(0x7f5f640c5b30 msgr2=0x7f5f640c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:40.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- 172.21.15.50:0/4000727848 shutdown_connections 2024-01-30T08:10:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- 172.21.15.50:0/4000727848 wait complete. 2024-01-30T08:10:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 Processor -- start 2024-01-30T08:10:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- start start 2024-01-30T08:10:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f640a4da0 0x7f5f64153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f640c04b0 0x7f5f6415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f6414fbf0 0x7f5f6414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64151a70 con 0x7f5f640a4da0 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640a59a0 con 0x7f5f640c04b0 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f6b200640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64150e60 con 0x7f5f6414fbf0 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f63e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f640a4da0 0x7f5f64153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f63e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f640a4da0 0x7f5f64153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60658/0 (socket says 172.21.15.50:60658) 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f63e00640 1 -- 172.21.15.50:0/2724302242 learned_addr learned my addr 172.21.15.50:0/2724302242 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f63400640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f640c04b0 0x7f5f6415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.808+0000 7f5f69200640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f6414fbf0 0x7f5f6414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f63e00640 1 -- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f6414fbf0 msgr2=0x7f5f6414a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f63e00640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f6414fbf0 0x7f5f6414a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f63e00640 1 -- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f640c04b0 msgr2=0x7f5f6415d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f63e00640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f640c04b0 0x7f5f6415d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f63e00640 1 -- 172.21.15.50:0/2724302242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009a70 con 0x7f5f640a4da0 2024-01-30T08:10:40.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f63e00640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f640a4da0 0x7f5f64153a40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c460 tx=0x7f5f5400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f5be00640 1 -- 172.21.15.50:0/2724302242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540052d0 con 0x7f5f640a4da0 2024-01-30T08:10:40.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f5be00640 1 -- 172.21.15.50:0/2724302242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54005450 con 0x7f5f640a4da0 2024-01-30T08:10:40.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f64151140 con 0x7f5f640a4da0 2024-01-30T08:10:40.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f5be00640 1 -- 172.21.15.50:0/2724302242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54012870 con 0x7f5f640a4da0 2024-01-30T08:10:40.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f64151700 con 0x7f5f640a4da0 2024-01-30T08:10:40.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f64067cc0 con 0x7f5f640a4da0 2024-01-30T08:10:40.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f5be00640 1 -- 172.21.15.50:0/2724302242 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5f540129d0 con 0x7f5f640a4da0 2024-01-30T08:10:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f5be00640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f3c066530 0x7f5f3c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.812+0000 7f5f5be00640 1 -- 172.21.15.50:0/2724302242 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5f540839f0 con 0x7f5f640a4da0 2024-01-30T08:10:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.816+0000 7f5f63400640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f3c066530 0x7f5f3c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.816+0000 7f5f63400640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f3c066530 0x7f5f3c0689f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5f64152110 tx=0x7f5f4c007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:40.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.816+0000 7f5f5be00640 1 -- 172.21.15.50:0/2724302242 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5f54050b50 con 0x7f5f640a4da0 2024-01-30T08:10:40.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f64074a20 con 0x7f5f640a4da0 2024-01-30T08:10:40.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f5be00640 1 -- 172.21.15.50:0/2724302242 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v48) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5f54054170 con 0x7f5f640a4da0 2024-01-30T08:10:40.982 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f3c066530 msgr2=0x7f5f3c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f3c066530 0x7f5f3c0689f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5f64152110 tx=0x7f5f4c007d40 comp rx=0 tx=0).stop 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f640a4da0 msgr2=0x7f5f64153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f640a4da0 0x7f5f64153a40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c460 tx=0x7f5f5400c920 comp rx=0 tx=0).stop 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 shutdown_connections 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f640c04b0 0x7f5f6415d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5f3c066530 0x7f5f3c0689f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f6414fbf0 0x7f5f6414a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 --2- 172.21.15.50:0/2724302242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f640a4da0 0x7f5f64153a40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 >> 172.21.15.50:0/2724302242 conn(0x7f5f640c5b30 msgr2=0x7f5f6414f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 shutdown_connections 2024-01-30T08:10:40.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:40.980+0000 7f5f6b200640 1 -- 172.21.15.50:0/2724302242 wait complete. 2024-01-30T08:10:41.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-30T08:10:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2036c00640 1 Processor -- start 2024-01-30T08:10:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2036c00640 1 -- start start 2024-01-30T08:10:41.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2036c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f203006c960 0x7f20300727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2036c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2030154290 0x7f2030154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2036c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20300c22b0 con 0x7f2030071e10 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2036c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20300c5890 con 0x7f2030154290 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2036c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20300c52d0 con 0x7f203006c960 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2034c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2030154290 0x7f2030154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f202fe00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2030071e10 0x7f20300c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44220/0 (socket says 172.21.15.50:44220) 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2034c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2030154290 0x7f2030154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60674/0 (socket says 172.21.15.50:60674) 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f202fe00640 1 -- 172.21.15.50:0/1477441939 learned_addr learned my addr 172.21.15.50:0/1477441939 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f202f400640 1 --2- 172.21.15.50:0/1477441939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f203006c960 0x7f20300727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2034c00640 1 -- 172.21.15.50:0/1477441939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f203006c960 msgr2=0x7f20300727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2034c00640 1 --2- 172.21.15.50:0/1477441939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f203006c960 0x7f20300727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2034c00640 1 -- 172.21.15.50:0/1477441939 >> v1:172.21.15.50:6789/0 conn(0x7f2030071e10 legacy=0x7f20300c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f2034c00640 1 -- 172.21.15.50:0/1477441939 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300c55b0 con 0x7f2030154290 2024-01-30T08:10:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.148+0000 7f202ea00640 1 -- 172.21.15.50:0/1477441939 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928190725 0 0) 0x7f20300c22b0 con 0x7f2030071e10 2024-01-30T08:10:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2034c00640 1 --2- 172.21.15.50:0/1477441939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2030154290 0x7f2030154720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2028009d90 tx=0x7f202801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b43433b6cd99160 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f202ea00640 1 -- 172.21.15.50:0/1477441939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280a5780 con 0x7f2030154290 2024-01-30T08:10:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f202ea00640 1 -- 172.21.15.50:0/1477441939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280a58e0 con 0x7f2030154290 2024-01-30T08:10:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f202ea00640 1 -- 172.21.15.50:0/1477441939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280a5c70 con 0x7f2030154290 2024-01-30T08:10:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 -- 172.21.15.50:0/1477441939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2030154290 msgr2=0x7f2030154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 --2- 172.21.15.50:0/1477441939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2030154290 0x7f2030154720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2028009d90 tx=0x7f202801c830 comp rx=0 tx=0).stop 2024-01-30T08:10:41.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 -- 172.21.15.50:0/1477441939 shutdown_connections 2024-01-30T08:10:41.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 --2- 172.21.15.50:0/1477441939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2030154290 0x7f2030154720 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 --2- 172.21.15.50:0/1477441939 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f203006c960 0x7f20300727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 -- 172.21.15.50:0/1477441939 >> 172.21.15.50:0/1477441939 conn(0x7f20300c5b30 msgr2=0x7f20300c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:41.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 -- 172.21.15.50:0/1477441939 shutdown_connections 2024-01-30T08:10:41.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 -- 172.21.15.50:0/1477441939 wait complete. 2024-01-30T08:10:41.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 Processor -- start 2024-01-30T08:10:41.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.152+0000 7f2036c00640 1 -- start start 2024-01-30T08:10:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203006c960 0x7f20301f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2030071e10 0x7f2030159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2030154290 0x7f2030149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20301490f0 con 0x7f203006c960 2024-01-30T08:10:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2030148df0 con 0x7f2030154290 2024-01-30T08:10:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2030152400 con 0x7f2030071e10 2024-01-30T08:10:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203006c960 0x7f20301f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202f400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2030071e10 0x7f2030159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2034c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2030154290 0x7f2030149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203006c960 0x7f20301f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60690/0 (socket says 172.21.15.50:60690) 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202f400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2030071e10 0x7f2030159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:44430/0 (socket says 172.21.15.50:44430) 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 -- 172.21.15.50:0/18188746 learned_addr learned my addr 172.21.15.50:0/18188746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 -- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2030071e10 msgr2=0x7f2030159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2030071e10 0x7f2030159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 -- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2030154290 msgr2=0x7f2030149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2030154290 0x7f2030149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 -- 172.21.15.50:0/18188746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009a70 con 0x7f203006c960 2024-01-30T08:10:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f202fe00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203006c960 0x7f20301f0920 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f202000c520 tx=0x7f202000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2027e00640 1 -- 172.21.15.50:0/18188746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200074e0 con 0x7f203006c960 2024-01-30T08:10:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2027e00640 1 -- 172.21.15.50:0/18188746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020007640 con 0x7f203006c960 2024-01-30T08:10:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2027e00640 1 -- 172.21.15.50:0/18188746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200049f0 con 0x7f203006c960 2024-01-30T08:10:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20301526e0 con 0x7f203006c960 2024-01-30T08:10:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20300c45c0 con 0x7f203006c960 2024-01-30T08:10:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.156+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2030074a20 con 0x7f203006c960 2024-01-30T08:10:41.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.160+0000 7f2027e00640 1 -- 172.21.15.50:0/18188746 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2020004b50 con 0x7f203006c960 2024-01-30T08:10:41.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.160+0000 7f2027e00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2008066500 0x7f20080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.160+0000 7f2027e00640 1 -- 172.21.15.50:0/18188746 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f20200832e0 con 0x7f203006c960 2024-01-30T08:10:41.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.160+0000 7f202f400640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2008066500 0x7f20080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.160+0000 7f202f400640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2008066500 0x7f20080689c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f203006e080 tx=0x7f2018009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.164+0000 7f2027e00640 1 -- 172.21.15.50:0/18188746 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f20200503b0 con 0x7f203006c960 2024-01-30T08:10:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2030148f30 con 0x7f203006c960 2024-01-30T08:10:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2027e00640 1 -- 172.21.15.50:0/18188746 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v48) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2030148f30 con 0x7f203006c960 2024-01-30T08:10:41.327 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2008066500 msgr2=0x7f20080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2008066500 0x7f20080689c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f203006e080 tx=0x7f2018009190 comp rx=0 tx=0).stop 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203006c960 msgr2=0x7f20301f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203006c960 0x7f20301f0920 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f202000c520 tx=0x7f202000c9e0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 shutdown_connections 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2030154290 0x7f2030149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2008066500 0x7f20080689c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2030071e10 0x7f2030159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 --2- 172.21.15.50:0/18188746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203006c960 0x7f20301f0920 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 >> 172.21.15.50:0/18188746 conn(0x7f20300c5b30 msgr2=0x7f20300724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:41.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 shutdown_connections 2024-01-30T08:10:41.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.324+0000 7f2036c00640 1 -- 172.21.15.50:0/18188746 wait complete. 2024-01-30T08:10:41.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:41.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.488+0000 7fc851c00640 1 Processor -- start 2024-01-30T08:10:41.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.488+0000 7fc851c00640 1 -- start start 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc851c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06de40 0x7fc84c0a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc851c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc84c06e220 0x7fc84c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc851c00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c0c7b40 con 0x7fc84c1582d0 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc851c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c0a7770 con 0x7fc84c06e220 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc851c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c155310 con 0x7fc84c06de40 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc84c06e220 0x7fc84c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84b400640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc84c1582d0 0x7fc84c06f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44236/0 (socket says 172.21.15.50:44236) 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84b400640 1 -- 172.21.15.50:0/3592916660 learned_addr learned my addr 172.21.15.50:0/3592916660 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:41.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84aa00640 1 --2- 172.21.15.50:0/3592916660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06de40 0x7fc84c0a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84a000640 1 -- 172.21.15.50:0/3592916660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06de40 msgr2=0x7fc84c0a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:41.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84a000640 1 --2- 172.21.15.50:0/3592916660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06de40 0x7fc84c0a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84a000640 1 -- 172.21.15.50:0/3592916660 >> v1:172.21.15.50:6789/0 conn(0x7fc84c1582d0 legacy=0x7fc84c06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc84a000640 1 -- 172.21.15.50:0/3592916660 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c155730 con 0x7fc84c06e220 2024-01-30T08:10:41.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.492+0000 7fc849600640 1 -- 172.21.15.50:0/3592916660 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159444732 0 0) 0x7fc8440014a0 con 0x7fc84c1582d0 2024-01-30T08:10:41.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc84a000640 1 --2- 172.21.15.50:0/3592916660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06e220 0x7fc84c157d90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc8340097c0 tx=0x7fc83401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71fd7e21ab0cc8a server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc849600640 1 -- 172.21.15.50:0/3592916660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340ab600 con 0x7fc84c06e220 2024-01-30T08:10:41.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc849600640 1 -- 172.21.15.50:0/3592916660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340a7050 con 0x7fc84c06e220 2024-01-30T08:10:41.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc849600640 1 -- 172.21.15.50:0/3592916660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340ab980 con 0x7fc84c06e220 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 -- 172.21.15.50:0/3592916660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06e220 msgr2=0x7fc84c157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 --2- 172.21.15.50:0/3592916660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06e220 0x7fc84c157d90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc8340097c0 tx=0x7fc83401c480 comp rx=0 tx=0).stop 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 -- 172.21.15.50:0/3592916660 shutdown_connections 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 --2- 172.21.15.50:0/3592916660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06e220 0x7fc84c157d90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 --2- 172.21.15.50:0/3592916660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06de40 0x7fc84c0a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 -- 172.21.15.50:0/3592916660 >> 172.21.15.50:0/3592916660 conn(0x7fc84c0c4830 msgr2=0x7fc84c0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 -- 172.21.15.50:0/3592916660 shutdown_connections 2024-01-30T08:10:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 -- 172.21.15.50:0/3592916660 wait complete. 2024-01-30T08:10:41.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 Processor -- start 2024-01-30T08:10:41.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.496+0000 7fc851c00640 1 -- start start 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06de40 0x7fc84c0bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06e220 0x7fc84c0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c1582d0 0x7fc84c0c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0abd60 con 0x7fc84c06de40 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0ab4b0 con 0x7fc84c1582d0 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c151690 con 0x7fc84c06e220 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06de40 0x7fc84c0bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06de40 0x7fc84c0bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60706/0 (socket says 172.21.15.50:60706) 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 -- 172.21.15.50:0/499046606 learned_addr learned my addr 172.21.15.50:0/499046606 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 -- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06e220 msgr2=0x7fc84c0ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06e220 0x7fc84c0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 -- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c1582d0 msgr2=0x7fc84c0c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c1582d0 0x7fc84c0c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 -- 172.21.15.50:0/499046606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009420 con 0x7fc84c06de40 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc84aa00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06de40 0x7fc84c0bfb80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00e930 tx=0x7fc83c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc842a00640 1 -- 172.21.15.50:0/499046606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c009690 con 0x7fc84c06de40 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc842a00640 1 -- 172.21.15.50:0/499046606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c00ca00 con 0x7fc84c06de40 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c0ab710 con 0x7fc84c06de40 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc842a00640 1 -- 172.21.15.50:0/499046606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00cd70 con 0x7fc84c06de40 2024-01-30T08:10:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c0add10 con 0x7fc84c06de40 2024-01-30T08:10:41.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c074a20 con 0x7fc84c06de40 2024-01-30T08:10:41.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.500+0000 7fc842a00640 1 -- 172.21.15.50:0/499046606 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc83c013470 con 0x7fc84c06de40 2024-01-30T08:10:41.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.504+0000 7fc842a00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc824066530 0x7fc8240689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.504+0000 7fc842a00640 1 -- 172.21.15.50:0/499046606 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fc83c084330 con 0x7fc84c06de40 2024-01-30T08:10:41.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.504+0000 7fc84a000640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc824066530 0x7fc8240689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.504+0000 7fc84a000640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc824066530 0x7fc8240689f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc8340ad000 tx=0x7fc834004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.508+0000 7fc842a00640 1 -- 172.21.15.50:0/499046606 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc83c0514a0 con 0x7fc84c06de40 2024-01-30T08:10:41.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.696+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc84c06ee10 con 0x7fc84c06de40 2024-01-30T08:10:41.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc842a00640 1 -- 172.21.15.50:0/499046606 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fc83c054ac0 con 0x7fc84c06de40 2024-01-30T08:10:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:41.702 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1118410887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1118410887},{"type":"v1","addr":"172.21.15.50:6835","nonce":1118410887}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:41.702 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-01-30T08:10:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc824066530 msgr2=0x7fc8240689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc824066530 0x7fc8240689f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc8340ad000 tx=0x7fc834004740 comp rx=0 tx=0).stop 2024-01-30T08:10:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06de40 msgr2=0x7fc84c0bfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06de40 0x7fc84c0bfb80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00e930 tx=0x7fc83c00edf0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 shutdown_connections 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c1582d0 0x7fc84c0c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc824066530 0x7fc8240689f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc84c06e220 0x7fc84c0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 --2- 172.21.15.50:0/499046606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc84c06de40 0x7fc84c0bfb80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 >> 172.21.15.50:0/499046606 conn(0x7fc84c0c4830 msgr2=0x7fc84c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 shutdown_connections 2024-01-30T08:10:41.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.700+0000 7fc851c00640 1 -- 172.21.15.50:0/499046606 wait complete. 2024-01-30T08:10:41.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.860+0000 7fef21400640 1 Processor -- start 2024-01-30T08:10:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef21400640 1 -- start start 2024-01-30T08:10:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef21400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef1c06de40 0x7fef1c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef21400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c153390 0x7fef1c0a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef21400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef1c0c4310 0x7fef1c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef21400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c152f00 con 0x7fef1c06de40 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef21400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c1525f0 con 0x7fef1c0c4310 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef21400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c0a7680 con 0x7fef1c153390 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef1c06de40 0x7fef1c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef1c06de40 0x7fef1c06e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60708/0 (socket says 172.21.15.50:60708) 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 -- 172.21.15.50:0/1765396336 learned_addr learned my addr 172.21.15.50:0/1765396336 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef19e00640 1 --2- 172.21.15.50:0/1765396336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c153390 0x7fef1c0a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1b200640 1 --2- 172.21.15.50:0/1765396336 >> v2:172.21.15.125:3300/0 conn(0x7fef1c0c4310 0x7fef1c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 -- 172.21.15.50:0/1765396336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c153390 msgr2=0x7fef1c0a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 --2- 172.21.15.50:0/1765396336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c153390 0x7fef1c0a6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 -- 172.21.15.50:0/1765396336 >> v2:172.21.15.125:3300/0 conn(0x7fef1c0c4310 msgr2=0x7fef1c155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 --2- 172.21.15.50:0/1765396336 >> v2:172.21.15.125:3300/0 conn(0x7fef1c0c4310 0x7fef1c155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.864+0000 7fef1a800640 1 -- 172.21.15.50:0/1765396336 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c1528b0 con 0x7fef1c06de40 2024-01-30T08:10:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef1a800640 1 --2- 172.21.15.50:0/1765396336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c06de40 0x7fef1c06e220 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fef1c04f120 tx=0x7fef0c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4012a90c11e749ca server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef19400640 1 -- 172.21.15.50:0/1765396336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0ab600 con 0x7fef1c06de40 2024-01-30T08:10:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef19400640 1 -- 172.21.15.50:0/1765396336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c0a7050 con 0x7fef1c06de40 2024-01-30T08:10:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef19400640 1 -- 172.21.15.50:0/1765396336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0ab980 con 0x7fef1c06de40 2024-01-30T08:10:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 -- 172.21.15.50:0/1765396336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c06de40 msgr2=0x7fef1c06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 --2- 172.21.15.50:0/1765396336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c06de40 0x7fef1c06e220 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fef1c04f120 tx=0x7fef0c01c3b0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 -- 172.21.15.50:0/1765396336 shutdown_connections 2024-01-30T08:10:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 --2- 172.21.15.50:0/1765396336 >> v2:172.21.15.125:3300/0 conn(0x7fef1c0c4310 0x7fef1c155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 --2- 172.21.15.50:0/1765396336 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c153390 0x7fef1c0a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 --2- 172.21.15.50:0/1765396336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c06de40 0x7fef1c06e220 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 -- 172.21.15.50:0/1765396336 >> 172.21.15.50:0/1765396336 conn(0x7fef1c0c4830 msgr2=0x7fef1c0c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 -- 172.21.15.50:0/1765396336 shutdown_connections 2024-01-30T08:10:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 -- 172.21.15.50:0/1765396336 wait complete. 2024-01-30T08:10:41.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.868+0000 7fef21400640 1 Processor -- start 2024-01-30T08:10:41.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 -- start start 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c06de40 0x7fef1c147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c0c4310 0x7fef1c1f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef1c153390 0x7fef1c1f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1ee140 con 0x7fef1c0c4310 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1471a0 con 0x7fef1c153390 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1ed830 con 0x7fef1c06de40 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c0c4310 0x7fef1c1f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c0c4310 0x7fef1c1f0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60716/0 (socket says 172.21.15.50:60716) 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 -- 172.21.15.50:0/4147072899 learned_addr learned my addr 172.21.15.50:0/4147072899 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef1b200640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef1c153390 0x7fef1c1f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef1a800640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c06de40 0x7fef1c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 -- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c06de40 msgr2=0x7fef1c147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c06de40 0x7fef1c147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 -- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef1c153390 msgr2=0x7fef1c1f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef1c153390 0x7fef1c1f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 -- 172.21.15.50:0/4147072899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0094d0 con 0x7fef1c0c4310 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef19e00640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c0c4310 0x7fef1c1f0da0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fef0400e870 tx=0x7fef0400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef12a00640 1 -- 172.21.15.50:0/4147072899 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04009530 con 0x7fef1c0c4310 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef12a00640 1 -- 172.21.15.50:0/4147072899 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0400c940 con 0x7fef1c0c4310 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef12a00640 1 -- 172.21.15.50:0/4147072899 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0400ccd0 con 0x7fef1c0c4310 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c0ad840 con 0x7fef1c0c4310 2024-01-30T08:10:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c1eddd0 con 0x7fef1c0c4310 2024-01-30T08:10:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.872+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c1ee2b0 con 0x7fef1c0c4310 2024-01-30T08:10:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.876+0000 7fef12a00640 1 -- 172.21.15.50:0/4147072899 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fef04013470 con 0x7fef1c0c4310 2024-01-30T08:10:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.876+0000 7fef12a00640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feef4066500 0x7feef40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.876+0000 7fef12a00640 1 -- 172.21.15.50:0/4147072899 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fef04084130 con 0x7fef1c0c4310 2024-01-30T08:10:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.876+0000 7fef1a800640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feef4066500 0x7feef40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:41.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.876+0000 7fef1a800640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feef4066500 0x7feef40689c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0ad000 tx=0x7fef0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:41.880+0000 7fef12a00640 1 -- 172.21.15.50:0/4147072899 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fef04051290 con 0x7fef1c0c4310 2024-01-30T08:10:42.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef1c074a20 con 0x7fef1c0c4310 2024-01-30T08:10:42.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef12a00640 1 -- 172.21.15.50:0/4147072899 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fef040548b0 con 0x7fef1c0c4310 2024-01-30T08:10:42.047 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:42.047 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":48,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:39.914440+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/1837689837":"2024-01-31T08:10:36.904003+0000","172.21.15.50:6834/1837689837":"2024-01-31T08:10:36.904003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feef4066500 msgr2=0x7feef40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feef4066500 0x7feef40689c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0ad000 tx=0x7fef0c008040 comp rx=0 tx=0).stop 2024-01-30T08:10:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c0c4310 msgr2=0x7fef1c1f0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c0c4310 0x7fef1c1f0da0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fef0400e870 tx=0x7fef0400ed30 comp rx=0 tx=0).stop 2024-01-30T08:10:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 shutdown_connections 2024-01-30T08:10:42.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef1c153390 0x7fef1c1f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feef4066500 0x7feef40689c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef1c0c4310 0x7fef1c1f0da0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 --2- 172.21.15.50:0/4147072899 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef1c06de40 0x7fef1c147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.044+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 >> 172.21.15.50:0/4147072899 conn(0x7fef1c0c4830 msgr2=0x7fef1c0c3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:42.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.048+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 shutdown_connections 2024-01-30T08:10:42.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.048+0000 7fef21400640 1 -- 172.21.15.50:0/4147072899 wait complete. 2024-01-30T08:10:42.070 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-30T08:10:42.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:42.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 Processor -- start 2024-01-30T08:10:42.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 -- start start 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc14fbf0 0x7fbfcc1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbfcc0c0ee0 0x7fbfcc0a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfcc0c1de0 0x7fbfcc06a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc0c3ed0 con 0x7fbfcc0c1de0 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc06bca0 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd3c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06bef0 con 0x7fbfcc14fbf0 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd1c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfcc0c1de0 0x7fbfcc06a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd1c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfcc0c1de0 0x7fbfcc06a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60728/0 (socket says 172.21.15.50:60728) 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd1c00640 1 -- 172.21.15.50:0/1104368989 learned_addr learned my addr 172.21.15.50:0/1104368989 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfd1200640 1 --2- 172.21.15.50:0/1104368989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc14fbf0 0x7fbfcc1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.208+0000 7fbfcbe00640 1 --2- 172.21.15.50:0/1104368989 >> v2:172.21.15.125:3300/0 conn(0x7fbfcc0c0ee0 0x7fbfcc0a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd1c00640 1 -- 172.21.15.50:0/1104368989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc14fbf0 msgr2=0x7fbfcc1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:42.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd1c00640 1 --2- 172.21.15.50:0/1104368989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc14fbf0 0x7fbfcc1559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd1c00640 1 -- 172.21.15.50:0/1104368989 >> v2:172.21.15.125:3300/0 conn(0x7fbfcc0c0ee0 msgr2=0x7fbfcc0a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:42.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd1c00640 1 --2- 172.21.15.50:0/1104368989 >> v2:172.21.15.125:3300/0 conn(0x7fbfcc0c0ee0 0x7fbfcc0a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd1c00640 1 -- 172.21.15.50:0/1104368989 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc0c3b60 con 0x7fbfcc0c1de0 2024-01-30T08:10:42.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd1c00640 1 --2- 172.21.15.50:0/1104368989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c1de0 0x7fbfcc06a740 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0c6c30 tx=0x7fbfc401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f76542b2564f9e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfcb400640 1 -- 172.21.15.50:0/1104368989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40a5650 con 0x7fbfcc0c1de0 2024-01-30T08:10:42.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfcb400640 1 -- 172.21.15.50:0/1104368989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc40a57b0 con 0x7fbfcc0c1de0 2024-01-30T08:10:42.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfcb400640 1 -- 172.21.15.50:0/1104368989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40a5b40 con 0x7fbfcc0c1de0 2024-01-30T08:10:42.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd3c00640 1 -- 172.21.15.50:0/1104368989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c1de0 msgr2=0x7fbfcc06a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.212+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/1104368989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c1de0 0x7fbfcc06a740 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0c6c30 tx=0x7fbfc401c8b0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- 172.21.15.50:0/1104368989 shutdown_connections 2024-01-30T08:10:42.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/1104368989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c1de0 0x7fbfcc06a740 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/1104368989 >> v2:172.21.15.125:3300/0 conn(0x7fbfcc0c0ee0 0x7fbfcc0a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/1104368989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc14fbf0 0x7fbfcc1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- 172.21.15.50:0/1104368989 >> 172.21.15.50:0/1104368989 conn(0x7fbfcc0c5b50 msgr2=0x7fbfcc0c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:42.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- 172.21.15.50:0/1104368989 shutdown_connections 2024-01-30T08:10:42.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- 172.21.15.50:0/1104368989 wait complete. 2024-01-30T08:10:42.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 Processor -- start 2024-01-30T08:10:42.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- start start 2024-01-30T08:10:42.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c0ee0 0x7fbfcc14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc0c1de0 0x7fbfcc1ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfcc14fbf0 0x7fbfcc1ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc1532e0 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc1ed090 con 0x7fbfcc14fbf0 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd3c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc1edf30 con 0x7fbfcc0c1de0 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c0ee0 0x7fbfcc14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c0ee0 0x7fbfcc14ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60736/0 (socket says 172.21.15.50:60736) 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 -- 172.21.15.50:0/3346413392 learned_addr learned my addr 172.21.15.50:0/3346413392 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfcc14fbf0 0x7fbfcc1ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfcbe00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc0c1de0 0x7fbfcc1ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 -- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc0c1de0 msgr2=0x7fbfcc1ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc0c1de0 0x7fbfcc1ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 -- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfcc14fbf0 msgr2=0x7fbfcc1ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfcc14fbf0 0x7fbfcc1ed9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.216+0000 7fbfd1200640 1 -- 172.21.15.50:0/3346413392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009b30 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfd1200640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c0ee0 0x7fbfcc14ef80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e870 tx=0x7fbfbc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfc8c00640 1 -- 172.21.15.50:0/3346413392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc009530 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfc8c00640 1 -- 172.21.15.50:0/3346413392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc00c940 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfc8c00640 1 -- 172.21.15.50:0/3346413392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00ccd0 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc1f09b0 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc1f0f70 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc074a20 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfc8c00640 1 -- 172.21.15.50:0/3346413392 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbfbc013470 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfc8c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfa4066500 0x7fbfa40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.220+0000 7fbfc8c00640 1 -- 172.21.15.50:0/3346413392 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fbfbc0840a0 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.224+0000 7fbfcbe00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfa4066500 0x7fbfa40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.224+0000 7fbfcbe00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfa4066500 0x7fbfa40689c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc1eadf0 tx=0x7fbfb4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.224+0000 7fbfc8c00640 1 -- 172.21.15.50:0/3346413392 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbfbc051200 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.420+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfcc156820 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.420+0000 7fbfc8c00640 1 -- 172.21.15.50:0/3346413392 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fbfbc054820 con 0x7fbfcc0c0ee0 2024-01-30T08:10:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:42.423 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1118410887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1118410887},{"type":"v1","addr":"172.21.15.50:6835","nonce":1118410887}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:42.424 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.420+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfa4066500 msgr2=0x7fbfa40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.420+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfa4066500 0x7fbfa40689c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc1eadf0 tx=0x7fbfb4009190 comp rx=0 tx=0).stop 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.420+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c0ee0 msgr2=0x7fbfcc14ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.420+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c0ee0 0x7fbfcc14ef80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e870 tx=0x7fbfbc00ed30 comp rx=0 tx=0).stop 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 shutdown_connections 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfcc14fbf0 0x7fbfcc1ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbfa4066500 0x7fbfa40689c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbfcc0c1de0 0x7fbfcc1ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 --2- 172.21.15.50:0/3346413392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfcc0c0ee0 0x7fbfcc14ef80 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 >> 172.21.15.50:0/3346413392 conn(0x7fbfcc0c5b50 msgr2=0x7fbfcc155630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 shutdown_connections 2024-01-30T08:10:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.424+0000 7fbfd3c00640 1 -- 172.21.15.50:0/3346413392 wait complete. 2024-01-30T08:10:42.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:10:42.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45e0800640 1 Processor -- start 2024-01-30T08:10:42.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45e0800640 1 -- start start 2024-01-30T08:10:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45e0800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45d806de40 0x7f45d80a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45e0800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45d806e220 0x7f45d8157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45e0800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d80c7b40 con 0x7f45d81582d0 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45e0800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d80a7770 con 0x7f45d806e220 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45e0800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d8155310 con 0x7f45d806de40 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dd400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45d806e220 0x7f45d8157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dd400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45d806e220 0x7f45d8157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60752/0 (socket says 172.21.15.50:60752) 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dd400640 1 -- 172.21.15.50:0/1853336121 learned_addr learned my addr 172.21.15.50:0/1853336121 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dde00640 1 --2- 172.21.15.50:0/1853336121 >> v2:172.21.15.125:3300/0 conn(0x7f45d806de40 0x7f45d80a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dd400640 1 -- 172.21.15.50:0/1853336121 >> v2:172.21.15.125:3300/0 conn(0x7f45d806de40 msgr2=0x7f45d80a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dd400640 1 --2- 172.21.15.50:0/1853336121 >> v2:172.21.15.125:3300/0 conn(0x7f45d806de40 0x7f45d80a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dd400640 1 -- 172.21.15.50:0/1853336121 >> v1:172.21.15.125:6789/0 conn(0x7f45d81582d0 legacy=0x7f45d806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dd400640 1 -- 172.21.15.50:0/1853336121 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8155730 con 0x7f45d806e220 2024-01-30T08:10:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.584+0000 7f45dca00640 1 -- 172.21.15.50:0/1853336121 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129498861 0 0) 0x7f45d00014a0 con 0x7f45d81582d0 2024-01-30T08:10:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45dd400640 1 --2- 172.21.15.50:0/1853336121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d8157d90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f45d8073f80 tx=0x7f45c001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfdb06028971e3b server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45dca00640 1 -- 172.21.15.50:0/1853336121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00ab600 con 0x7f45d806e220 2024-01-30T08:10:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45dca00640 1 -- 172.21.15.50:0/1853336121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c00a7050 con 0x7f45d806e220 2024-01-30T08:10:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45dca00640 1 -- 172.21.15.50:0/1853336121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00ab980 con 0x7f45d806e220 2024-01-30T08:10:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 -- 172.21.15.50:0/1853336121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 msgr2=0x7f45d8157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 --2- 172.21.15.50:0/1853336121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d8157d90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f45d8073f80 tx=0x7f45c001c500 comp rx=0 tx=0).stop 2024-01-30T08:10:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 -- 172.21.15.50:0/1853336121 shutdown_connections 2024-01-30T08:10:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 --2- 172.21.15.50:0/1853336121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d8157d90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 --2- 172.21.15.50:0/1853336121 >> v2:172.21.15.125:3300/0 conn(0x7f45d806de40 0x7f45d80a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 -- 172.21.15.50:0/1853336121 >> 172.21.15.50:0/1853336121 conn(0x7f45d80c4830 msgr2=0x7f45d80c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 -- 172.21.15.50:0/1853336121 shutdown_connections 2024-01-30T08:10:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.588+0000 7f45e0800640 1 -- 172.21.15.50:0/1853336121 wait complete. 2024-01-30T08:10:42.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 Processor -- start 2024-01-30T08:10:42.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 -- start start 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45d806de40 0x7f45d81ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d80c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d81582d0 0x7f45d8156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80c11a0 con 0x7f45d806e220 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81ee710 con 0x7f45d81582d0 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80c1b70 con 0x7f45d806de40 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d80c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d80c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60754/0 (socket says 172.21.15.50:60754) 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 -- 172.21.15.50:0/189607281 learned_addr learned my addr 172.21.15.50:0/189607281 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45de800640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d81582d0 0x7f45d8156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dde00640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45d806de40 0x7f45d81ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 -- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45d806de40 msgr2=0x7f45d81ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45d806de40 0x7f45d81ee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 -- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d81582d0 msgr2=0x7f45d8156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d81582d0 0x7f45d8156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 -- 172.21.15.50:0/189607281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00094d0 con 0x7f45d806e220 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dde00640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45d806de40 0x7f45d81ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45dd400640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d80c1630 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f45c00ae040 tx=0x7f45c00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45d6000640 1 -- 172.21.15.50:0/189607281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b37d0 con 0x7f45d806e220 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45d6000640 1 -- 172.21.15.50:0/189607281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c00b3930 con 0x7f45d806e220 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45d6000640 1 -- 172.21.15.50:0/189607281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b3ca0 con 0x7f45d806e220 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d80aa250 con 0x7f45d806e220 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.592+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d80c0e30 con 0x7f45d806e220 2024-01-30T08:10:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.596+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d80c1310 con 0x7f45d806e220 2024-01-30T08:10:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.596+0000 7f45d6000640 1 -- 172.21.15.50:0/189607281 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f45c00b2070 con 0x7f45d806e220 2024-01-30T08:10:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.596+0000 7f45d6000640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45b0066500 0x7f45b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.596+0000 7f45d6000640 1 -- 172.21.15.50:0/189607281 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f45c011e160 con 0x7f45d806e220 2024-01-30T08:10:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.596+0000 7f45dde00640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45b0066500 0x7f45b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.596+0000 7f45dde00640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45b0066500 0x7f45b00689c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009bb0 tx=0x7f45c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.600+0000 7f45d6000640 1 -- 172.21.15.50:0/189607281 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f45c00eb2b0 con 0x7f45d806e220 2024-01-30T08:10:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.792+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45d8155730 con 0x7f45d806e220 2024-01-30T08:10:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45d6000640 1 -- 172.21.15.50:0/189607281 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f45d8155730 con 0x7f45d806e220 2024-01-30T08:10:42.798 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:42.798 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1118410887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1118410887},{"type":"v1","addr":"172.21.15.50:6835","nonce":1118410887}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-30T08:10:11.284356+0000","modified":"2024-01-30T08:10:14.311648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5170},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5170":{"gid":5170,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.125:6837/363187157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":363187157},{"type":"v1","addr":"172.21.15.125:6837","nonce":363187157}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-30T08:10:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-01-30T08:10:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45b0066500 msgr2=0x7f45b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45b0066500 0x7f45b00689c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009bb0 tx=0x7f45c8008040 comp rx=0 tx=0).stop 2024-01-30T08:10:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 msgr2=0x7f45d80c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d80c1630 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f45c00ae040 tx=0x7f45c00192a0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 shutdown_connections 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45d81582d0 0x7f45d8156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f45b0066500 0x7f45b00689c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d806e220 0x7f45d80c1630 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 --2- 172.21.15.50:0/189607281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45d806de40 0x7f45d81ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 >> 172.21.15.50:0/189607281 conn(0x7f45d80c4830 msgr2=0x7f45d80c3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 shutdown_connections 2024-01-30T08:10:42.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.796+0000 7f45e0800640 1 -- 172.21.15.50:0/189607281 wait complete. 2024-01-30T08:10:42.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:42.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f70400640 1 Processor -- start 2024-01-30T08:10:42.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f70400640 1 -- start start 2024-01-30T08:10:42.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f70400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f68151d80 0x7f6f680c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f70400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f68158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f70400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f68157c60 con 0x7f6f680c4bb0 2024-01-30T08:10:42.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f70400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f68152160 con 0x7f6f68151d80 2024-01-30T08:10:42.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f70400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680c35f0 con 0x7f6f680c05c0 2024-01-30T08:10:42.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6da00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f68151d80 0x7f6f680c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6e400640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6f680c4bb0 0x7f6f68154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:50964/0 (socket says 172.21.15.50:50964) 2024-01-30T08:10:42.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6d000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f68158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6e400640 1 -- 172.21.15.50:0/2103417875 learned_addr learned my addr 172.21.15.50:0/2103417875 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:42.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6da00640 1 -- 172.21.15.50:0/2103417875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 msgr2=0x7f6f68158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:42.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6da00640 1 --2- 172.21.15.50:0/2103417875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f68158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6da00640 1 -- 172.21.15.50:0/2103417875 >> v1:172.21.15.125:6789/0 conn(0x7f6f680c4bb0 legacy=0x7f6f68154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.964+0000 7f6f6da00640 1 -- 172.21.15.50:0/2103417875 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680c6a30 con 0x7f6f68151d80 2024-01-30T08:10:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f6da00640 1 --2- 172.21.15.50:0/2103417875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 0x7f6f680c0080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f580097c0 tx=0x7f6f5801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=545387e11eaec722 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f67e00640 1 -- 172.21.15.50:0/2103417875 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580ab650 con 0x7f6f68151d80 2024-01-30T08:10:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f67e00640 1 -- 172.21.15.50:0/2103417875 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f580ab7b0 con 0x7f6f68151d80 2024-01-30T08:10:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f67e00640 1 -- 172.21.15.50:0/2103417875 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580abb40 con 0x7f6f68151d80 2024-01-30T08:10:42.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 -- 172.21.15.50:0/2103417875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 msgr2=0x7f6f680c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 --2- 172.21.15.50:0/2103417875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 0x7f6f680c0080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f580097c0 tx=0x7f6f5801c450 comp rx=0 tx=0).stop 2024-01-30T08:10:42.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 -- 172.21.15.50:0/2103417875 shutdown_connections 2024-01-30T08:10:42.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 --2- 172.21.15.50:0/2103417875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f68158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 --2- 172.21.15.50:0/2103417875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 0x7f6f680c0080 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 -- 172.21.15.50:0/2103417875 >> 172.21.15.50:0/2103417875 conn(0x7f6f680a9590 msgr2=0x7f6f680c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:42.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 -- 172.21.15.50:0/2103417875 shutdown_connections 2024-01-30T08:10:42.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.968+0000 7f6f70400640 1 -- 172.21.15.50:0/2103417875 wait complete. 2024-01-30T08:10:42.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 Processor -- start 2024-01-30T08:10:42.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 -- start start 2024-01-30T08:10:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f681ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f680c4bb0 0x7f6f68150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 0x7f6f681f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6806d470 con 0x7f6f680c4bb0 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6814ee50 con 0x7f6f68151d80 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681f0bb0 con 0x7f6f680c05c0 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f680c4bb0 0x7f6f68150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f680c4bb0 0x7f6f68150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60766/0 (socket says 172.21.15.50:60766) 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 -- 172.21.15.50:0/1993689806 learned_addr learned my addr 172.21.15.50:0/1993689806 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6e400640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 0x7f6f681f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6da00640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f681ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 -- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 msgr2=0x7f6f681ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f681ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 -- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 msgr2=0x7f6f681f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 0x7f6f681f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 -- 172.21.15.50:0/1993689806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58009420 con 0x7f6f680c4bb0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f6d000640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f680c4bb0 0x7f6f68150480 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e930 tx=0x7f6f5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f65600640 1 -- 172.21.15.50:0/1993689806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50009690 con 0x7f6f680c4bb0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f65600640 1 -- 172.21.15.50:0/1993689806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000ca00 con 0x7f6f680c4bb0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f65600640 1 -- 172.21.15.50:0/1993689806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000cd70 con 0x7f6f680c4bb0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6814e2d0 con 0x7f6f680c4bb0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.972+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6814e890 con 0x7f6f680c4bb0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.976+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68074a20 con 0x7f6f680c4bb0 2024-01-30T08:10:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.976+0000 7f6f65600640 1 -- 172.21.15.50:0/1993689806 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6f50013470 con 0x7f6f680c4bb0 2024-01-30T08:10:42.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.976+0000 7f6f65600640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6f40066530 0x7f6f400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:42.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.976+0000 7f6f65600640 1 -- 172.21.15.50:0/1993689806 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f6f50084240 con 0x7f6f680c4bb0 2024-01-30T08:10:42.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.976+0000 7f6f6da00640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6f40066530 0x7f6f400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:42.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.976+0000 7f6f6da00640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6f40066530 0x7f6f400689f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f580af000 tx=0x7f6f580a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:42.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:42.980+0000 7f6f65600640 1 -- 172.21.15.50:0/1993689806 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6f50051460 con 0x7f6f680c4bb0 2024-01-30T08:10:43.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.140+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f6815fd20 con 0x7f6f680c4bb0 2024-01-30T08:10:43.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.140+0000 7f6f65600640 1 -- 172.21.15.50:0/1993689806 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f6f50054a80 con 0x7f6f680c4bb0 2024-01-30T08:10:43.145 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:43.145 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":48,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:39.914440+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-30T08:10:09.022581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-30T08:10:10.287235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/1837689837":"2024-01-31T08:10:36.904003+0000","172.21.15.50:6834/1837689837":"2024-01-31T08:10:36.904003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6f40066530 msgr2=0x7f6f400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6f40066530 0x7f6f400689f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f580af000 tx=0x7f6f580a7000 comp rx=0 tx=0).stop 2024-01-30T08:10:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f680c4bb0 msgr2=0x7f6f68150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f680c4bb0 0x7f6f68150480 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e930 tx=0x7f6f5000edf0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 shutdown_connections 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f68151d80 0x7f6f681f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6f40066530 0x7f6f400689f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f680c4bb0 0x7f6f68150480 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 --2- 172.21.15.50:0/1993689806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f680c05c0 0x7f6f681ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 >> 172.21.15.50:0/1993689806 conn(0x7f6f680a9590 msgr2=0x7f6f6806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 shutdown_connections 2024-01-30T08:10:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.144+0000 7f6f70400640 1 -- 172.21.15.50:0/1993689806 wait complete. 2024-01-30T08:10:43.168 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-30T08:10:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7abfa00640 1 Processor -- start 2024-01-30T08:10:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7abfa00640 1 -- start start 2024-01-30T08:10:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7abfa00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ab8151e40 0x7f7ab81588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7abfa00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80c3fe0 con 0x7f7ab80c1b50 2024-01-30T08:10:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7abfa00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80c42c0 con 0x7f7ab8154850 2024-01-30T08:10:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7abfa00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab80c2330 con 0x7f7ab8151e40 2024-01-30T08:10:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ab80c1b50 0x7f7ab80c7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44238/0 (socket says 172.21.15.50:44238) 2024-01-30T08:10:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7e00640 1 -- 172.21.15.50:0/3839542865 learned_addr learned my addr 172.21.15.50:0/3839542865 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7abd000640 1 --2- 172.21.15.50:0/3839542865 >> v2:172.21.15.125:3300/0 conn(0x7f7ab8151e40 0x7f7ab81588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494570223 0 0) 0x7f7ab80c3fe0 con 0x7f7ab80c1b50 2024-01-30T08:10:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a98003530 con 0x7f7ab80c1b50 2024-01-30T08:10:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90292073 0 0) 0x7f7ab80c42c0 con 0x7f7ab8154850 2024-01-30T08:10:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab80c3fe0 con 0x7f7ab8154850 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 212610258 0 0) 0x7f7a98003530 con 0x7f7ab80c1b50 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 >> v2:172.21.15.125:3300/0 conn(0x7f7ab8151e40 msgr2=0x7f7ab81588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 --2- 172.21.15.50:0/3839542865 >> v2:172.21.15.125:3300/0 conn(0x7f7ab8151e40 0x7f7ab81588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 >> v1:172.21.15.125:6789/0 conn(0x7f7ab8154850 legacy=0x7f7ab8154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab806d1b0 con 0x7f7ab80c1b50 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f7aa0001680 con 0x7f7ab80c1b50 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 >> v1:172.21.15.50:6789/0 conn(0x7f7ab80c1b50 legacy=0x7f7ab80c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.307+0000 7f7ab7400640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a98003b10 0x7f7a98003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a980047d0 0x7f7a98004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98005190 0x7f7a9800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c2330 con 0x7f7a98003b10 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9800c0c0 con 0x7f7a980047d0 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9800c280 con 0x7f7a98005190 2024-01-30T08:10:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abd000640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a98003b10 0x7f7a98003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7e00640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a980047d0 0x7f7a98004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abda00640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98005190 0x7f7a9800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abd000640 1 -- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98005190 msgr2=0x7f7a9800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abd000640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98005190 0x7f7a9800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abd000640 1 -- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a980047d0 msgr2=0x7f7a98004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abd000640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a980047d0 0x7f7a98004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abd000640 1 -- 172.21.15.50:0/3839542865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98003530 con 0x7f7a98003b10 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abda00640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98005190 0x7f7a9800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abda00640 1 -- 172.21.15.50:0/3839542865 reap_dead start 2024-01-30T08:10:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7abd000640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a98003b10 0x7f7a98003f10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009ae0 tx=0x7f7aa801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5949d19a95cd107 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80a6430 con 0x7f7a98003b10 2024-01-30T08:10:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80a6590 con 0x7f7a98003b10 2024-01-30T08:10:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.311+0000 7f7ab7400640 1 -- 172.21.15.50:0/3839542865 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80a6940 con 0x7f7a98003b10 2024-01-30T08:10:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- 172.21.15.50:0/3839542865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a98003b10 msgr2=0x7f7a98003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a98003b10 0x7f7a98003f10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009ae0 tx=0x7f7aa801ca50 comp rx=0 tx=0).stop 2024-01-30T08:10:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- 172.21.15.50:0/3839542865 shutdown_connections 2024-01-30T08:10:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 --2- 172.21.15.50:0/3839542865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a98003b10 0x7f7a98003f10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- 172.21.15.50:0/3839542865 >> 172.21.15.50:0/3839542865 conn(0x7f7ab806a740 msgr2=0x7f7ab806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- 172.21.15.50:0/3839542865 shutdown_connections 2024-01-30T08:10:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- 172.21.15.50:0/3839542865 wait complete. 2024-01-30T08:10:43.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 Processor -- start 2024-01-30T08:10:43.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- start start 2024-01-30T08:10:43.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98003b10 0x7f7ab81f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ab81f1330 0x7f7ab806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80ad050 0x7f7ab806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab81f1ad0 con 0x7f7ab80ad050 2024-01-30T08:10:43.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab81e3c80 con 0x7f7ab81f1330 2024-01-30T08:10:43.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abfa00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c7660 con 0x7f7a98003b10 2024-01-30T08:10:43.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abda00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80ad050 0x7f7ab806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abda00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80ad050 0x7f7ab806efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60784/0 (socket says 172.21.15.50:60784) 2024-01-30T08:10:43.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7abda00640 1 -- 172.21.15.50:0/2462383327 learned_addr learned my addr 172.21.15.50:0/2462383327 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:43.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.315+0000 7f7ab7e00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ab81f1330 0x7f7ab806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abd000640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98003b10 0x7f7ab81f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abda00640 1 -- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98003b10 msgr2=0x7f7ab81f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abda00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98003b10 0x7f7ab81f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abda00640 1 -- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ab81f1330 msgr2=0x7f7ab806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abda00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ab81f1330 0x7f7ab806eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abda00640 1 -- 172.21.15.50:0/2462383327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab81f17f0 con 0x7f7ab80ad050 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abda00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80ad050 0x7f7ab806efe0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80c1900 tx=0x7f7ab000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7ab4c00640 1 -- 172.21.15.50:0/2462383327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0017070 con 0x7f7ab80ad050 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7ab4c00640 1 -- 172.21.15.50:0/2462383327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab000eec0 con 0x7f7ab80ad050 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab8157660 con 0x7f7ab80ad050 2024-01-30T08:10:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7ab4c00640 1 -- 172.21.15.50:0/2462383327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0003b90 con 0x7f7ab80ad050 2024-01-30T08:10:43.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab8157c20 con 0x7f7ab80ad050 2024-01-30T08:10:43.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab806e7c0 con 0x7f7ab80ad050 2024-01-30T08:10:43.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.319+0000 7f7ab4c00640 1 -- 172.21.15.50:0/2462383327 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7ab0003cf0 con 0x7f7ab80ad050 2024-01-30T08:10:43.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.323+0000 7f7ab4c00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7a90066500 0x7f7a900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.323+0000 7f7ab4c00640 1 -- 172.21.15.50:0/2462383327 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f7ab00835e0 con 0x7f7ab80ad050 2024-01-30T08:10:43.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.323+0000 7f7abd000640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7a90066500 0x7f7a900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.323+0000 7f7abd000640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7a90066500 0x7f7a900689c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80ad000 tx=0x7f7aa80b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:43.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.327+0000 7f7ab4c00640 1 -- 172.21.15.50:0/2462383327 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7ab806e7c0 con 0x7f7ab80ad050 2024-01-30T08:10:43.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.519+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f7ab806e7c0 con 0x7f7ab80ad050 2024-01-30T08:10:43.523 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-01-30T08:10:43.519+0000 7f42f8600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-30T08:10:43.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.519+0000 7f7ab4c00640 1 -- 172.21.15.50:0/2462383327 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 163+0+0 (secure 0 0 0) 0x7f7ab806e7c0 con 0x7f7ab80ad050 2024-01-30T08:10:43.525 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-30T08:10:43.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7a90066500 msgr2=0x7f7a900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7a90066500 0x7f7a900689c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80ad000 tx=0x7f7aa80b3040 comp rx=0 tx=0).stop 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80ad050 msgr2=0x7f7ab806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80ad050 0x7f7ab806efe0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80c1900 tx=0x7f7ab000ecd0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 shutdown_connections 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ab81f1330 0x7f7ab806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7a90066500 0x7f7a900689c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ab80ad050 0x7f7ab806efe0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 --2- 172.21.15.50:0/2462383327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a98003b10 0x7f7ab81f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 >> 172.21.15.50:0/2462383327 conn(0x7f7ab806a740 msgr2=0x7f7ab806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 shutdown_connections 2024-01-30T08:10:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.523+0000 7f7abfa00640 1 -- 172.21.15.50:0/2462383327 wait complete. 2024-01-30T08:10:43.536 INFO:tasks.ceph.mds.d.smithi125.stderr: -2080> 2024-01-30T08:10:17.883+0000 7fd574a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-30T08:10:43.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-30T08:10:43.581 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2024-01-30T08:10:43.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.687+0000 7f2fbda00640 1 Processor -- start 2024-01-30T08:10:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.687+0000 7f2fbda00640 1 -- start start 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fbda00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fb8072b60 0x7f2fb80a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fbda00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb806bfe0 0x7f2fb80c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fbda00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fb80a51e0 0x7f2fb80c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fbda00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb806c4c0 con 0x7f2fb80a51e0 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fbda00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb80c0550 con 0x7f2fb8072b60 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fbda00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb80c07c0 con 0x7f2fb806bfe0 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fb80a51e0 0x7f2fb80c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fb80a51e0 0x7f2fb80c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60792/0 (socket says 172.21.15.50:60792) 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 -- 172.21.15.50:0/501569057 learned_addr learned my addr 172.21.15.50:0/501569057 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb6000640 1 --2- 172.21.15.50:0/501569057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb806bfe0 0x7f2fb80c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb6a00640 1 --2- 172.21.15.50:0/501569057 >> v2:172.21.15.125:3300/0 conn(0x7f2fb8072b60 0x7f2fb80a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 -- 172.21.15.50:0/501569057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb806bfe0 msgr2=0x7f2fb80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 --2- 172.21.15.50:0/501569057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb806bfe0 0x7f2fb80c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 -- 172.21.15.50:0/501569057 >> v2:172.21.15.125:3300/0 conn(0x7f2fb8072b60 msgr2=0x7f2fb80a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:43.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 --2- 172.21.15.50:0/501569057 >> v2:172.21.15.125:3300/0 conn(0x7f2fb8072b60 0x7f2fb80a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 -- 172.21.15.50:0/501569057 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80c0aa0 con 0x7f2fb80a51e0 2024-01-30T08:10:43.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.691+0000 7f2fb7400640 1 --2- 172.21.15.50:0/501569057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80a51e0 0x7f2fb80c17e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8073fd0 tx=0x7f2fb001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdff73af240e15e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:43.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fb5600640 1 -- 172.21.15.50:0/501569057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00a5730 con 0x7f2fb80a51e0 2024-01-30T08:10:43.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fb5600640 1 -- 172.21.15.50:0/501569057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb00a5890 con 0x7f2fb80a51e0 2024-01-30T08:10:43.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fb5600640 1 -- 172.21.15.50:0/501569057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00a5c20 con 0x7f2fb80a51e0 2024-01-30T08:10:43.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 -- 172.21.15.50:0/501569057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80a51e0 msgr2=0x7f2fb80c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 --2- 172.21.15.50:0/501569057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80a51e0 0x7f2fb80c17e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8073fd0 tx=0x7f2fb001c910 comp rx=0 tx=0).stop 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 -- 172.21.15.50:0/501569057 shutdown_connections 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 --2- 172.21.15.50:0/501569057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80a51e0 0x7f2fb80c17e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 --2- 172.21.15.50:0/501569057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb806bfe0 0x7f2fb80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 --2- 172.21.15.50:0/501569057 >> v2:172.21.15.125:3300/0 conn(0x7f2fb8072b60 0x7f2fb80a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 -- 172.21.15.50:0/501569057 >> 172.21.15.50:0/501569057 conn(0x7f2fb80c5b30 msgr2=0x7f2fb80c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 -- 172.21.15.50:0/501569057 shutdown_connections 2024-01-30T08:10:43.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 -- 172.21.15.50:0/501569057 wait complete. 2024-01-30T08:10:43.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 Processor -- start 2024-01-30T08:10:43.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 -- start start 2024-01-30T08:10:43.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fb806bfe0 0x7f2fb8150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb8072b60 0x7f2fb814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb80a51e0 0x7f2fb814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.695+0000 7f2fbda00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb80ab780 con 0x7f2fb8072b60 2024-01-30T08:10:43.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fbda00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb814c820 con 0x7f2fb806bfe0 2024-01-30T08:10:43.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fbda00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb814c540 con 0x7f2fb80a51e0 2024-01-30T08:10:43.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb8072b60 0x7f2fb814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb8072b60 0x7f2fb814dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60794/0 (socket says 172.21.15.50:60794) 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 -- 172.21.15.50:0/824444857 learned_addr learned my addr 172.21.15.50:0/824444857 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6a00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fb806bfe0 0x7f2fb8150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb7400640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb80a51e0 0x7f2fb814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 -- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb80a51e0 msgr2=0x7f2fb814e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb80a51e0 0x7f2fb814e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 -- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fb806bfe0 msgr2=0x7f2fb8150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fb806bfe0 0x7f2fb8150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 -- 172.21.15.50:0/824444857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0009b30 con 0x7f2fb8072b60 2024-01-30T08:10:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fb6000640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb8072b60 0x7f2fb814dcf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000eb10 tx=0x7f2fa000d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2faea00640 1 -- 172.21.15.50:0/824444857 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0010440 con 0x7f2fb8072b60 2024-01-30T08:10:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2faea00640 1 -- 172.21.15.50:0/824444857 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa00105a0 con 0x7f2fb8072b60 2024-01-30T08:10:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb80ab4a0 con 0x7f2fb8072b60 2024-01-30T08:10:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2faea00640 1 -- 172.21.15.50:0/824444857 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0010930 con 0x7f2fb8072b60 2024-01-30T08:10:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb81509c0 con 0x7f2fb8072b60 2024-01-30T08:10:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb80ab300 con 0x7f2fb8072b60 2024-01-30T08:10:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.699+0000 7f2faea00640 1 -- 172.21.15.50:0/824444857 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2fa0010a90 con 0x7f2fb8072b60 2024-01-30T08:10:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.703+0000 7f2faea00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f90066500 0x7f2f900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.703+0000 7f2faea00640 1 -- 172.21.15.50:0/824444857 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6263+0+0 (secure 0 0 0) 0x7f2fa0084930 con 0x7f2fb8072b60 2024-01-30T08:10:43.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.703+0000 7f2fb6a00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f90066500 0x7f2f900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:43.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.703+0000 7f2fb6a00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f90066500 0x7f2f900689c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8067a00 tx=0x7f2fa8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:43.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.703+0000 7f2faea00640 1 -- 172.21.15.50:0/824444857 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2fb80ab300 con 0x7f2fb8072b60 2024-01-30T08:10:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:43.899+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2fb81edcd0 con 0x7f2fb8072b60 2024-01-30T08:10:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.523+0000 7f2faea00640 1 -- 172.21.15.50:0/824444857 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2fb81edcd0 con 0x7f2fb8072b60 2024-01-30T08:10:44.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f90066500 msgr2=0x7f2f900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:44.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f90066500 0x7f2f900689c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8067a00 tx=0x7f2fa8009190 comp rx=0 tx=0).stop 2024-01-30T08:10:44.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb8072b60 msgr2=0x7f2fb814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:44.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb8072b60 0x7f2fb814dcf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000eb10 tx=0x7f2fa000d350 comp rx=0 tx=0).stop 2024-01-30T08:10:44.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 shutdown_connections 2024-01-30T08:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f2f90066500 0x7f2f900689c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2fb80a51e0 0x7f2fb814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb8072b60 0x7f2fb814dcf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 --2- 172.21.15.50:0/824444857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fb806bfe0 0x7f2fb8150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 >> 172.21.15.50:0/824444857 conn(0x7f2fb80c5b30 msgr2=0x7f2fb815b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 shutdown_connections 2024-01-30T08:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.527+0000 7f2fbda00640 1 -- 172.21.15.50:0/824444857 wait complete. 2024-01-30T08:10:44.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-30T08:10:44.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.699+0000 7fee7d600640 1 Processor -- start 2024-01-30T08:10:44.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.699+0000 7fee7d600640 1 -- start start 2024-01-30T08:10:44.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee7d600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee780712f0 0x7fee780c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:44.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee7d600640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee78072830 0x7fee7806a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:44.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee7d600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee78154ad0 con 0x7fee78151da0 2024-01-30T08:10:44.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee7d600640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee78072e80 con 0x7fee78072830 2024-01-30T08:10:44.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee7d600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee78154780 con 0x7fee780712f0 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee77400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee78072830 0x7fee7806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee77400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee78072830 0x7fee7806a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60800/0 (socket says 172.21.15.50:60800) 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee77400640 1 -- 172.21.15.50:0/972637718 learned_addr learned my addr 172.21.15.50:0/972637718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee76000640 1 --2- 172.21.15.50:0/972637718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee780712f0 0x7fee780c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee77400640 1 -- 172.21.15.50:0/972637718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee780712f0 msgr2=0x7fee780c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee77400640 1 --2- 172.21.15.50:0/972637718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee780712f0 0x7fee780c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee77400640 1 -- 172.21.15.50:0/972637718 >> v1:172.21.15.125:6789/0 conn(0x7fee78151da0 legacy=0x7fee78154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.703+0000 7fee77400640 1 -- 172.21.15.50:0/972637718 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78155670 con 0x7fee78072830 2024-01-30T08:10:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee77400640 1 --2- 172.21.15.50:0/972637718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee78072830 0x7fee7806a740 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fee70009e50 tx=0x7fee7001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb91afcac5147f45 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee75600640 1 -- 172.21.15.50:0/972637718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700a57b0 con 0x7fee78072830 2024-01-30T08:10:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee75600640 1 -- 172.21.15.50:0/972637718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee700a5910 con 0x7fee78072830 2024-01-30T08:10:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee75600640 1 -- 172.21.15.50:0/972637718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700a5ca0 con 0x7fee78072830 2024-01-30T08:10:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 -- 172.21.15.50:0/972637718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee78072830 msgr2=0x7fee7806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 --2- 172.21.15.50:0/972637718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee78072830 0x7fee7806a740 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fee70009e50 tx=0x7fee7001c8f0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 -- 172.21.15.50:0/972637718 shutdown_connections 2024-01-30T08:10:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 --2- 172.21.15.50:0/972637718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee78072830 0x7fee7806a740 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 --2- 172.21.15.50:0/972637718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee780712f0 0x7fee780c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 -- 172.21.15.50:0/972637718 >> 172.21.15.50:0/972637718 conn(0x7fee780c3750 msgr2=0x7fee780c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 -- 172.21.15.50:0/972637718 shutdown_connections 2024-01-30T08:10:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 -- 172.21.15.50:0/972637718 wait complete. 2024-01-30T08:10:44.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 Processor -- start 2024-01-30T08:10:44.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.707+0000 7fee7d600640 1 -- start start 2024-01-30T08:10:44.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee780712f0 0x7fee780ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:44.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee78072830 0x7fee7814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee78151da0 0x7fee7814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7814eb70 con 0x7fee780712f0 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780a9ea0 con 0x7fee78151da0 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780a9b70 con 0x7fee78072830 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee780712f0 0x7fee780ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee780712f0 0x7fee780ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60804/0 (socket says 172.21.15.50:60804) 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 -- 172.21.15.50:0/3291719957 learned_addr learned my addr 172.21.15.50:0/3291719957 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee77400640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee78151da0 0x7fee7814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76000640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee78072830 0x7fee7814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 -- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee78072830 msgr2=0x7fee7814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee78072830 0x7fee7814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 -- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee78151da0 msgr2=0x7fee7814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee78151da0 0x7fee7814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 -- 172.21.15.50:0/3291719957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70009b30 con 0x7fee780712f0 2024-01-30T08:10:44.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee76a00640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee780712f0 0x7fee780ac910 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c370 tx=0x7fee6800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee6ea00640 1 -- 172.21.15.50:0/3291719957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee680052d0 con 0x7fee780712f0 2024-01-30T08:10:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee6ea00640 1 -- 172.21.15.50:0/3291719957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68005430 con 0x7fee780712f0 2024-01-30T08:10:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee781eda60 con 0x7fee780712f0 2024-01-30T08:10:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee6ea00640 1 -- 172.21.15.50:0/3291719957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68007260 con 0x7fee780712f0 2024-01-30T08:10:44.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee780aba90 con 0x7fee780712f0 2024-01-30T08:10:44.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78074a20 con 0x7fee780712f0 2024-01-30T08:10:44.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.711+0000 7fee6ea00640 1 -- 172.21.15.50:0/3291719957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fee680073c0 con 0x7fee780712f0 2024-01-30T08:10:44.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.715+0000 7fee6ea00640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee50066500 0x7fee500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:44.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.715+0000 7fee6ea00640 1 -- 172.21.15.50:0/3291719957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6263+0+0 (secure 0 0 0) 0x7fee68083390 con 0x7fee780712f0 2024-01-30T08:10:44.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.715+0000 7fee76000640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee50066500 0x7fee500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:44.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.715+0000 7fee76000640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee50066500 0x7fee500689c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee780c0cd0 tx=0x7fee60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:44.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.719+0000 7fee6ea00640 1 -- 172.21.15.50:0/3291719957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fee680504c0 con 0x7fee780712f0 2024-01-30T08:10:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:44.875+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee7806b460 con 0x7fee780712f0 2024-01-30T08:10:45.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.527+0000 7fee6ea00640 1 -- 172.21.15.50:0/3291719957 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v50) v1 ==== 184+0+0 (secure 0 0 0) 0x7fee68053ae0 con 0x7fee780712f0 2024-01-30T08:10:45.530 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs2_metadata' removed 2024-01-30T08:10:45.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee50066500 msgr2=0x7fee500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:45.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee50066500 0x7fee500689c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee780c0cd0 tx=0x7fee60008040 comp rx=0 tx=0).stop 2024-01-30T08:10:45.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee780712f0 msgr2=0x7fee780ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:45.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee780712f0 0x7fee780ac910 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c370 tx=0x7fee6800c830 comp rx=0 tx=0).stop 2024-01-30T08:10:45.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 shutdown_connections 2024-01-30T08:10:45.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee78151da0 0x7fee7814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fee50066500 0x7fee500689c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee78072830 0x7fee7814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 --2- 172.21.15.50:0/3291719957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee780712f0 0x7fee780ac910 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 >> 172.21.15.50:0/3291719957 conn(0x7fee780c3750 msgr2=0x7fee78154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:45.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 shutdown_connections 2024-01-30T08:10:45.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.531+0000 7fee7d600640 1 -- 172.21.15.50:0/3291719957 wait complete. 2024-01-30T08:10:45.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-30T08:10:45.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 Processor -- start 2024-01-30T08:10:45.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 -- start start 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814fb20 0x7f96e80a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96e814ff00 0x7f96e80c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96e81530a0 0x7f96e80c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e8153550 con 0x7f96e81530a0 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e8152c10 con 0x7f96e814ff00 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96ee000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81525e0 con 0x7f96e814fb20 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96e81530a0 0x7f96e80c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96e81530a0 0x7f96e80c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60806/0 (socket says 172.21.15.50:60806) 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 -- 172.21.15.50:0/1373179476 learned_addr learned my addr 172.21.15.50:0/1373179476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e6a00640 1 --2- 172.21.15.50:0/1373179476 >> v2:172.21.15.125:3300/0 conn(0x7f96e814ff00 0x7f96e80c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7400640 1 --2- 172.21.15.50:0/1373179476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814fb20 0x7f96e80a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 -- 172.21.15.50:0/1373179476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814fb20 msgr2=0x7f96e80a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 --2- 172.21.15.50:0/1373179476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814fb20 0x7f96e80a5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 -- 172.21.15.50:0/1373179476 >> v2:172.21.15.125:3300/0 conn(0x7f96e814ff00 msgr2=0x7f96e80c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 --2- 172.21.15.50:0/1373179476 >> v2:172.21.15.125:3300/0 conn(0x7f96e814ff00 0x7f96e80c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e7e00640 1 -- 172.21.15.50:0/1373179476 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80a6320 con 0x7f96e81530a0 2024-01-30T08:10:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.707+0000 7f96e6a00640 1 --2- 172.21.15.50:0/1373179476 >> v2:172.21.15.125:3300/0 conn(0x7f96e814ff00 0x7f96e80c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96e7e00640 1 --2- 172.21.15.50:0/1373179476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e80c4bd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f96e8072fc0 tx=0x7f96e001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a94ab24428f4e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96e6000640 1 -- 172.21.15.50:0/1373179476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00090d0 con 0x7f96e81530a0 2024-01-30T08:10:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96e6000640 1 -- 172.21.15.50:0/1373179476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e0009230 con 0x7f96e81530a0 2024-01-30T08:10:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96e6000640 1 -- 172.21.15.50:0/1373179476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a58c0 con 0x7f96e81530a0 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 -- 172.21.15.50:0/1373179476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 msgr2=0x7f96e80c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 --2- 172.21.15.50:0/1373179476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e80c4bd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f96e8072fc0 tx=0x7f96e001c910 comp rx=0 tx=0).stop 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 -- 172.21.15.50:0/1373179476 shutdown_connections 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 --2- 172.21.15.50:0/1373179476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e80c4bd0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 --2- 172.21.15.50:0/1373179476 >> v2:172.21.15.125:3300/0 conn(0x7f96e814ff00 0x7f96e80c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 --2- 172.21.15.50:0/1373179476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814fb20 0x7f96e80a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 -- 172.21.15.50:0/1373179476 >> 172.21.15.50:0/1373179476 conn(0x7f96e80c3750 msgr2=0x7f96e80c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 -- 172.21.15.50:0/1373179476 shutdown_connections 2024-01-30T08:10:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.711+0000 7f96ee000640 1 -- 172.21.15.50:0/1373179476 wait complete. 2024-01-30T08:10:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 Processor -- start 2024-01-30T08:10:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 -- start start 2024-01-30T08:10:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e814fb20 0x7f96e806a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814ff00 0x7f96e80a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80aab00 con 0x7f96e81530a0 2024-01-30T08:10:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81ec940 con 0x7f96e814fb20 2024-01-30T08:10:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81ed910 con 0x7f96e814ff00 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e814b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60820/0 (socket says 172.21.15.50:60820) 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 -- 172.21.15.50:0/178087286 learned_addr learned my addr 172.21.15.50:0/178087286 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e6a00640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814ff00 0x7f96e80a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7400640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e814fb20 0x7f96e806a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 -- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814ff00 msgr2=0x7f96e80a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814ff00 0x7f96e80a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 -- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e814fb20 msgr2=0x7f96e806a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e814fb20 0x7f96e806a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 -- 172.21.15.50:0/178087286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0009b30 con 0x7f96e81530a0 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96e7e00640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e814b020 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f96e00af040 tx=0x7f96e00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96df400640 1 -- 172.21.15.50:0/178087286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00090d0 con 0x7f96e81530a0 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96df400640 1 -- 172.21.15.50:0/178087286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00b88a0 con 0x7f96e81530a0 2024-01-30T08:10:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96df400640 1 -- 172.21.15.50:0/178087286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00b8c50 con 0x7f96e81530a0 2024-01-30T08:10:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e81ed480 con 0x7f96e81530a0 2024-01-30T08:10:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.715+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e80c2030 con 0x7f96e81530a0 2024-01-30T08:10:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.719+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e81ed610 con 0x7f96e81530a0 2024-01-30T08:10:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.719+0000 7f96df400640 1 -- 172.21.15.50:0/178087286 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f96e00b6440 con 0x7f96e81530a0 2024-01-30T08:10:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.719+0000 7f96df400640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96c0066500 0x7f96c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.719+0000 7f96df400640 1 -- 172.21.15.50:0/178087286 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f96e011f2b0 con 0x7f96e81530a0 2024-01-30T08:10:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.719+0000 7f96e7400640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96c0066500 0x7f96c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.723+0000 7f96e7400640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96c0066500 0x7f96c00689c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f96e80aceb0 tx=0x7f96d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.723+0000 7f96df400640 1 -- 172.21.15.50:0/178087286 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f96e00ec640 con 0x7f96e81530a0 2024-01-30T08:10:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:45.895+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96e8074a20 con 0x7f96e81530a0 2024-01-30T08:10:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.527+0000 7f96df400640 1 -- 172.21.15.50:0/178087286 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v51) v1 ==== 172+0+0 (secure 0 0 0) 0x7f96e0009510 con 0x7f96e81530a0 2024-01-30T08:10:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs2_data' removed 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96c0066500 msgr2=0x7f96c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96c0066500 0x7f96c00689c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f96e80aceb0 tx=0x7f96d8008040 comp rx=0 tx=0).stop 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 msgr2=0x7f96e814b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e814b020 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f96e00af040 tx=0x7f96e00196b0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 shutdown_connections 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f96c0066500 0x7f96c00689c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96e81530a0 0x7f96e814b020 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96e814ff00 0x7f96e80a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 --2- 172.21.15.50:0/178087286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96e814fb20 0x7f96e806a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 >> 172.21.15.50:0/178087286 conn(0x7f96e80c3750 msgr2=0x7f96e8151dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 shutdown_connections 2024-01-30T08:10:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.531+0000 7f96ee000640 1 -- 172.21.15.50:0/178087286 wait complete. 2024-01-30T08:10:46.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-30T08:10:46.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.707+0000 7f3d60400640 1 Processor -- start 2024-01-30T08:10:46.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.707+0000 7f3d60400640 1 -- start start 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d60400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3d5806eb30 0x7f3d580a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d60400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d580ac3a0 0x7f3d5806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d60400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58152650 0x7f3d58152b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d60400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d580a6a60 con 0x7f3d580ac3a0 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d60400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d580a6430 con 0x7f3d5806eb30 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d60400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5806bfe0 con 0x7f3d58152650 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d580ac3a0 0x7f3d5806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d580ac3a0 0x7f3d5806baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60834/0 (socket says 172.21.15.50:60834) 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 -- 172.21.15.50:0/1066793273 learned_addr learned my addr 172.21.15.50:0/1066793273 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5da00640 1 --2- 172.21.15.50:0/1066793273 >> v2:172.21.15.125:3300/0 conn(0x7f3d5806eb30 0x7f3d580a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5e400640 1 --2- 172.21.15.50:0/1066793273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58152650 0x7f3d58152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:46.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 -- 172.21.15.50:0/1066793273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58152650 msgr2=0x7f3d58152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:46.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 --2- 172.21.15.50:0/1066793273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58152650 0x7f3d58152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 -- 172.21.15.50:0/1066793273 >> v2:172.21.15.125:3300/0 conn(0x7f3d5806eb30 msgr2=0x7f3d580a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:46.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 --2- 172.21.15.50:0/1066793273 >> v2:172.21.15.125:3300/0 conn(0x7f3d5806eb30 0x7f3d580a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5d000640 1 -- 172.21.15.50:0/1066793273 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5806b3e0 con 0x7f3d580ac3a0 2024-01-30T08:10:46.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.711+0000 7f3d5da00640 1 --2- 172.21.15.50:0/1066793273 >> v2:172.21.15.125:3300/0 conn(0x7f3d5806eb30 0x7f3d580a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d5d000640 1 --2- 172.21.15.50:0/1066793273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d580ac3a0 0x7f3d5806baa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3d5806f3c0 tx=0x7f3d4001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef9f982bef13ed4 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d57e00640 1 -- 172.21.15.50:0/1066793273 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400ab600 con 0x7f3d580ac3a0 2024-01-30T08:10:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d57e00640 1 -- 172.21.15.50:0/1066793273 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400ab760 con 0x7f3d580ac3a0 2024-01-30T08:10:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d57e00640 1 -- 172.21.15.50:0/1066793273 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400abaf0 con 0x7f3d580ac3a0 2024-01-30T08:10:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 -- 172.21.15.50:0/1066793273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d580ac3a0 msgr2=0x7f3d5806baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 --2- 172.21.15.50:0/1066793273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d580ac3a0 0x7f3d5806baa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3d5806f3c0 tx=0x7f3d4001c440 comp rx=0 tx=0).stop 2024-01-30T08:10:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 -- 172.21.15.50:0/1066793273 shutdown_connections 2024-01-30T08:10:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 --2- 172.21.15.50:0/1066793273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d580ac3a0 0x7f3d5806baa0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 --2- 172.21.15.50:0/1066793273 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d58152650 0x7f3d58152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 --2- 172.21.15.50:0/1066793273 >> v2:172.21.15.125:3300/0 conn(0x7f3d5806eb30 0x7f3d580a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 -- 172.21.15.50:0/1066793273 >> 172.21.15.50:0/1066793273 conn(0x7f3d5806a740 msgr2=0x7f3d5806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 -- 172.21.15.50:0/1066793273 shutdown_connections 2024-01-30T08:10:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 -- 172.21.15.50:0/1066793273 wait complete. 2024-01-30T08:10:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 Processor -- start 2024-01-30T08:10:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.715+0000 7f3d60400640 1 -- start start 2024-01-30T08:10:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5806eb30 0x7f3d581e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d580ac3a0 0x7f3d581f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d58152650 0x7f3d581f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581f0c20 con 0x7f3d58152650 2024-01-30T08:10:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581f0f00 con 0x7f3d580ac3a0 2024-01-30T08:10:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581ee010 con 0x7f3d5806eb30 2024-01-30T08:10:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d58152650 0x7f3d581f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d58152650 0x7f3d581f05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60840/0 (socket says 172.21.15.50:60840) 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 -- 172.21.15.50:0/3194069968 learned_addr learned my addr 172.21.15.50:0/3194069968 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5d000640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d580ac3a0 0x7f3d581f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5da00640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5806eb30 0x7f3d581e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 -- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5806eb30 msgr2=0x7f3d581e9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5806eb30 0x7f3d581e9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 -- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d580ac3a0 msgr2=0x7f3d581f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d580ac3a0 0x7f3d581f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 -- 172.21.15.50:0/3194069968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400094d0 con 0x7f3d58152650 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d5e400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d58152650 0x7f3d581f05b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009fd0 tx=0x7f3d5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d55600640 1 -- 172.21.15.50:0/3194069968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50014420 con 0x7f3d58152650 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d55600640 1 -- 172.21.15.50:0/3194069968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50014580 con 0x7f3d58152650 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d55600640 1 -- 172.21.15.50:0/3194069968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50014930 con 0x7f3d58152650 2024-01-30T08:10:46.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d581ee2f0 con 0x7f3d58152650 2024-01-30T08:10:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d580ab630 con 0x7f3d58152650 2024-01-30T08:10:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d58074a20 con 0x7f3d58152650 2024-01-30T08:10:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.719+0000 7f3d55600640 1 -- 172.21.15.50:0/3194069968 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3d50014a90 con 0x7f3d58152650 2024-01-30T08:10:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.723+0000 7f3d55600640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3d30066500 0x7f3d300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.723+0000 7f3d55600640 1 -- 172.21.15.50:0/3194069968 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3d50084500 con 0x7f3d58152650 2024-01-30T08:10:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.723+0000 7f3d5da00640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3d30066500 0x7f3d300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:46.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.723+0000 7f3d5da00640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3d30066500 0x7f3d300689c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3d480098d0 tx=0x7f3d48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.727+0000 7f3d55600640 1 -- 172.21.15.50:0/3194069968 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3d500519a0 con 0x7f3d58152650 2024-01-30T08:10:46.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.887+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3d580a7290 con 0x7f3d58152650 2024-01-30T08:10:46.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.891+0000 7f3d55600640 1 -- 172.21.15.50:0/3194069968 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3d580a7290 con 0x7f3d58152650 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.891+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3d30066500 msgr2=0x7f3d300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.891+0000 7f3d60400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3d30066500 0x7f3d300689c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3d480098d0 tx=0x7f3d48008040 comp rx=0 tx=0).stop 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.891+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d58152650 msgr2=0x7f3d581f05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.891+0000 7f3d60400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d58152650 0x7f3d581f05b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009fd0 tx=0x7f3d5000e4b0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 shutdown_connections 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d580ac3a0 0x7f3d581f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3d30066500 0x7f3d300689c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d58152650 0x7f3d581f05b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 --2- 172.21.15.50:0/3194069968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d5806eb30 0x7f3d581e9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 >> 172.21.15.50:0/3194069968 conn(0x7f3d5806a740 msgr2=0x7f3d581550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:46.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 shutdown_connections 2024-01-30T08:10:46.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:46.895+0000 7f3d60400640 1 -- 172.21.15.50:0/3194069968 wait complete. 2024-01-30T08:10:46.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-30T08:10:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e7e00640 1 Processor -- start 2024-01-30T08:10:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e7e00640 1 -- start start 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e7e00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78e006de40 0x7f78e00a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e7e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78e01584a0 0x7f78e015f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e7e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e00c7b40 con 0x7f78e006e220 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e7e00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e00a7770 con 0x7f78e01584a0 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e7e00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e0155310 con 0x7f78e006de40 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78e01584a0 0x7f78e015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e4a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f78e006e220 0x7f78e0157d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44242/0 (socket says 172.21.15.50:44242) 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e5e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78e01584a0 0x7f78e015f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60844/0 (socket says 172.21.15.50:60844) 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e4a00640 1 -- 172.21.15.50:0/4197293067 learned_addr learned my addr 172.21.15.50:0/4197293067 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e5400640 1 --2- 172.21.15.50:0/4197293067 >> v2:172.21.15.125:3300/0 conn(0x7f78e006de40 0x7f78e00a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:47.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e5e00640 1 -- 172.21.15.50:0/4197293067 >> v2:172.21.15.125:3300/0 conn(0x7f78e006de40 msgr2=0x7f78e00a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:47.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e5e00640 1 --2- 172.21.15.50:0/4197293067 >> v2:172.21.15.125:3300/0 conn(0x7f78e006de40 0x7f78e00a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e5e00640 1 -- 172.21.15.50:0/4197293067 >> v1:172.21.15.50:6789/0 conn(0x7f78e006e220 legacy=0x7f78e0157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:47.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.055+0000 7f78e5e00640 1 -- 172.21.15.50:0/4197293067 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0155730 con 0x7f78e01584a0 2024-01-30T08:10:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e5e00640 1 --2- 172.21.15.50:0/4197293067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e015f120 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f78e0073f80 tx=0x7f78d801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138dcb4cb60580f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78dfe00640 1 -- 172.21.15.50:0/4197293067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80a57d0 con 0x7f78e01584a0 2024-01-30T08:10:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78dfe00640 1 -- 172.21.15.50:0/4197293067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d80a5930 con 0x7f78e01584a0 2024-01-30T08:10:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78dfe00640 1 -- 172.21.15.50:0/4197293067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80a5cc0 con 0x7f78e01584a0 2024-01-30T08:10:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e7e00640 1 -- 172.21.15.50:0/4197293067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 msgr2=0x7f78e015f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e7e00640 1 --2- 172.21.15.50:0/4197293067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e015f120 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f78e0073f80 tx=0x7f78d801c910 comp rx=0 tx=0).stop 2024-01-30T08:10:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e7e00640 1 -- 172.21.15.50:0/4197293067 shutdown_connections 2024-01-30T08:10:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e7e00640 1 --2- 172.21.15.50:0/4197293067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e015f120 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e7e00640 1 --2- 172.21.15.50:0/4197293067 >> v2:172.21.15.125:3300/0 conn(0x7f78e006de40 0x7f78e00a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e7e00640 1 -- 172.21.15.50:0/4197293067 >> 172.21.15.50:0/4197293067 conn(0x7f78e00c4830 msgr2=0x7f78e00c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.059+0000 7f78e7e00640 1 -- 172.21.15.50:0/4197293067 shutdown_connections 2024-01-30T08:10:47.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 -- 172.21.15.50:0/4197293067 wait complete. 2024-01-30T08:10:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 Processor -- start 2024-01-30T08:10:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 -- start start 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e006de40 0x7f78e0155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e006e220 0x7f78e0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e01f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01565d0 con 0x7f78e01584a0 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0146c80 con 0x7f78e006de40 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01f1160 con 0x7f78e006e220 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e01f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e01f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60852/0 (socket says 172.21.15.50:60852) 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 -- 172.21.15.50:0/2561242791 learned_addr learned my addr 172.21.15.50:0/2561242791 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 -- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e006e220 msgr2=0x7f78e0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e4a00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e006e220 0x7f78e0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5400640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e006de40 0x7f78e0155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e006e220 0x7f78e0156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 -- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e006de40 msgr2=0x7f78e0155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e006de40 0x7f78e0155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 -- 172.21.15.50:0/2561242791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d8009a70 con 0x7f78e01584a0 2024-01-30T08:10:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5400640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e006de40 0x7f78e0155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e4a00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e006e220 0x7f78e0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:47.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e5e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e01f03e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f78d8019520 tx=0x7f78d80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78dd600640 1 -- 172.21.15.50:0/2561242791 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80b9860 con 0x7f78e01584a0 2024-01-30T08:10:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78dd600640 1 -- 172.21.15.50:0/2561242791 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d80b99c0 con 0x7f78e01584a0 2024-01-30T08:10:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e0146f10 con 0x7f78e01584a0 2024-01-30T08:10:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.063+0000 7f78dd600640 1 -- 172.21.15.50:0/2561242791 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80b9d70 con 0x7f78e01584a0 2024-01-30T08:10:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.067+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e01474d0 con 0x7f78e01584a0 2024-01-30T08:10:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.067+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e0074a20 con 0x7f78e01584a0 2024-01-30T08:10:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.067+0000 7f78dd600640 1 -- 172.21.15.50:0/2561242791 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f78d80c4460 con 0x7f78e01584a0 2024-01-30T08:10:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.067+0000 7f78dd600640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f78b8066500 0x7f78b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.067+0000 7f78dd600640 1 -- 172.21.15.50:0/2561242791 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f78d811efe0 con 0x7f78e01584a0 2024-01-30T08:10:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.067+0000 7f78e5400640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f78b8066500 0x7f78b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.071+0000 7f78e5400640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f78b8066500 0x7f78b80689c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009ae0 tx=0x7f78d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:47.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.071+0000 7f78dd600640 1 -- 172.21.15.50:0/2561242791 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f78d80ec3a0 con 0x7f78e01584a0 2024-01-30T08:10:47.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.299+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f78e0155730 con 0x7f78e01584a0 2024-01-30T08:10:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.527+0000 7f78dd600640 1 -- 172.21.15.50:0/2561242791 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v136) v1 ==== 159+0+0 (secure 0 0 0) 0x7f78e0155730 con 0x7f78e01584a0 2024-01-30T08:10:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f78b8066500 msgr2=0x7f78b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f78b8066500 0x7f78b80689c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009ae0 tx=0x7f78d0008040 comp rx=0 tx=0).stop 2024-01-30T08:10:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 msgr2=0x7f78e01f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e01f03e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f78d8019520 tx=0x7f78d80196b0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 shutdown_connections 2024-01-30T08:10:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f78b8066500 0x7f78b80689c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e01584a0 0x7f78e01f03e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78e006e220 0x7f78e0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 --2- 172.21.15.50:0/2561242791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78e006de40 0x7f78e0155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 >> 172.21.15.50:0/2561242791 conn(0x7f78e00c4830 msgr2=0x7f78e01522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 shutdown_connections 2024-01-30T08:10:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:47.531+0000 7f78e7e00640 1 -- 172.21.15.50:0/2561242791 wait complete. 2024-01-30T08:10:47.556 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... FAIL 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner: 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner:FAIL: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 293, in test_mount_all_caps_absent 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner: self.check_that_mount_failed_for_right_reason(retval[2]) 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 274, in check_that_mount_failed_for_right_reason 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner: raise AssertionError('can\'t find expected set of words in the ' 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner:AssertionError: can't find expected set of words in the stderr 2024-01-30T08:10:47.557 INFO:tasks.cephfs_test_runner:self.errmsgs - ('permission denied', 'no mds server is up or the cluster is laggy', 'no such file or directory', 'input/output error') 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:stderr - mount error: no mds (metadata server) is up. the cluster might be laggy, or you may not be authorized 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner: 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner: 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:Ran 1 test in 77.723s 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner: 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner: 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:FAIL: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 293, in test_mount_all_caps_absent 2024-01-30T08:10:47.558 INFO:tasks.cephfs_test_runner: self.check_that_mount_failed_for_right_reason(retval[2]) 2024-01-30T08:10:47.559 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 274, in check_that_mount_failed_for_right_reason 2024-01-30T08:10:47.559 INFO:tasks.cephfs_test_runner: raise AssertionError('can\'t find expected set of words in the ' 2024-01-30T08:10:47.559 INFO:tasks.cephfs_test_runner:AssertionError: can't find expected set of words in the stderr 2024-01-30T08:10:47.559 INFO:tasks.cephfs_test_runner:self.errmsgs - ('permission denied', 'no mds server is up or the cluster is laggy', 'no such file or directory', 'input/output error') 2024-01-30T08:10:47.559 INFO:tasks.cephfs_test_runner:stderr - mount error: no mds (metadata server) is up. the cluster might be laggy, or you may not be authorized 2024-01-30T08:10:47.559 INFO:tasks.cephfs_test_runner: 2024-01-30T08:10:47.559 INFO:tasks.cephfs_test_runner: 2024-01-30T08:10:47.559 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-30T08:10:47.780 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6451fd514ecb4e3985085520adbb7212 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-30T08:10:47.781 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-30T08:10:47.790 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-30T08:10:47.796 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-30T08:10:47.797 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-01-30T08:10:47.797 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:47.819 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357744k,nr_inodes=4089436,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-30T08:10:47.819 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-01-30T08:10:47.819 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-30T08:10:47.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354580k,nr_inodes=4088645,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275360k,nr_inodes=818840,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-30T08:10:47.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:47.829 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-01-30T08:10:47.869 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-30T08:10:47.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:47.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-30T08:10:47.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:47.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-01-30T08:10:48.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:48.104 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-01-30T08:10:48.114 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-30T08:10:48.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:48.115 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-30T08:10:48.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-30T08:10:48.180 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2024-01-30T08:10:48.385 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-30T08:10:48.394 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-30T08:10:48.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:48.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.531+0000 7fb461000640 1 Processor -- start 2024-01-30T08:10:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.531+0000 7fb461000640 1 -- start start 2024-01-30T08:10:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb461000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb45c0af780 0x7fb45c158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb461000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb461000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0c7fc0 con 0x7fb45c154730 2024-01-30T08:10:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb461000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c152220 con 0x7fb45c0af780 2024-01-30T08:10:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb461000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0afb60 con 0x7fb45c0abb20 2024-01-30T08:10:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb45a800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb45c154730 0x7fb45c154bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44244/0 (socket says 172.21.15.50:44244) 2024-01-30T08:10:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb45a800640 1 -- 172.21.15.50:0/3314513034 learned_addr learned my addr 172.21.15.50:0/3314513034 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb459e00640 1 --2- 172.21.15.50:0/3314513034 >> v2:172.21.15.125:3300/0 conn(0x7fb45c0af780 0x7fb45c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb459400640 1 --2- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb458a00640 1 -- 172.21.15.50:0/3314513034 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424117019 0 0) 0x7fb45c0c7fc0 con 0x7fb45c154730 2024-01-30T08:10:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb459e00640 1 -- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 msgr2=0x7fb45c0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb459e00640 1 --2- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb459e00640 1 -- 172.21.15.50:0/3314513034 >> v1:172.21.15.50:6789/0 conn(0x7fb45c154730 legacy=0x7fb45c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb459e00640 1 -- 172.21.15.50:0/3314513034 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0c4a40 con 0x7fb45c0af780 2024-01-30T08:10:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.535+0000 7fb459e00640 1 --2- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 0x7fb45c158730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097c0 tx=0x7fb44c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70da8ca6752797a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb458a00640 1 -- 172.21.15.50:0/3314513034 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0ab600 con 0x7fb45c0af780 2024-01-30T08:10:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb458a00640 1 -- 172.21.15.50:0/3314513034 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c0a7050 con 0x7fb45c0af780 2024-01-30T08:10:48.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb458a00640 1 -- 172.21.15.50:0/3314513034 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0ab980 con 0x7fb45c0af780 2024-01-30T08:10:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 msgr2=0x7fb45c158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 --2- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 0x7fb45c158730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097c0 tx=0x7fb44c01c3f0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- 172.21.15.50:0/3314513034 shutdown_connections 2024-01-30T08:10:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 --2- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 --2- 172.21.15.50:0/3314513034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 0x7fb45c158730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- 172.21.15.50:0/3314513034 >> 172.21.15.50:0/3314513034 conn(0x7fb45c072470 msgr2=0x7fb45c0ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- 172.21.15.50:0/3314513034 shutdown_connections 2024-01-30T08:10:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- 172.21.15.50:0/3314513034 wait complete. 2024-01-30T08:10:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 Processor -- start 2024-01-30T08:10:48.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- start start 2024-01-30T08:10:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0be660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 0x7fb45c1ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c154730 0x7fb45c1ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0bf1f0 con 0x7fb45c154730 2024-01-30T08:10:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0c3150 con 0x7fb45c0af780 2024-01-30T08:10:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.539+0000 7fb461000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0bda60 con 0x7fb45c0abb20 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb45a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c154730 0x7fb45c1ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb45a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c154730 0x7fb45c1ed050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60858/0 (socket says 172.21.15.50:60858) 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb45a800640 1 -- 172.21.15.50:0/1949793303 learned_addr learned my addr 172.21.15.50:0/1949793303 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459e00640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459400640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 0x7fb45c1ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459e00640 1 -- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 msgr2=0x7fb45c1ecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459e00640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 0x7fb45c1ecb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459e00640 1 -- 172.21.15.50:0/1949793303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c154730 msgr2=0x7fb45c1ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459e00640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c154730 0x7fb45c1ed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459e00640 1 -- 172.21.15.50:0/1949793303 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009420 con 0x7fb45c0abb20 2024-01-30T08:10:48.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb45a800640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c154730 0x7fb45c1ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb459e00640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0be660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0ab000 tx=0x7fb44c019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb452000640 1 -- 172.21.15.50:0/1949793303 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b4840 con 0x7fb45c0abb20 2024-01-30T08:10:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb452000640 1 -- 172.21.15.50:0/1949793303 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c0b49a0 con 0x7fb45c0abb20 2024-01-30T08:10:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb452000640 1 -- 172.21.15.50:0/1949793303 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b4d50 con 0x7fb45c0abb20 2024-01-30T08:10:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c0c8d00 con 0x7fb45c0abb20 2024-01-30T08:10:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0beba0 con 0x7fb45c0abb20 2024-01-30T08:10:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c074a20 con 0x7fb45c0abb20 2024-01-30T08:10:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.543+0000 7fb452000640 1 -- 172.21.15.50:0/1949793303 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb44c0b2040 con 0x7fb45c0abb20 2024-01-30T08:10:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.547+0000 7fb452000640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb434066500 0x7fb4340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.547+0000 7fb452000640 1 -- 172.21.15.50:0/1949793303 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb44c0abe40 con 0x7fb45c0abb20 2024-01-30T08:10:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.547+0000 7fb459400640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb434066500 0x7fb4340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.547+0000 7fb459400640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb434066500 0x7fb4340689c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0c9c80 tx=0x7fb444009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:48.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.551+0000 7fb452000640 1 -- 172.21.15.50:0/1949793303 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb44c0eb2d0 con 0x7fb45c0abb20 2024-01-30T08:10:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.707+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb45c0cad60 con 0x7fb434066500 2024-01-30T08:10:48.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb452000640 1 -- 172.21.15.50:0/1949793303 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50751 (secure 0 0 0) 0x7fb4440119d0 con 0x7fb434066500 2024-01-30T08:10:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb434066500 msgr2=0x7fb4340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb434066500 0x7fb4340689c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0c9c80 tx=0x7fb444009190 comp rx=0 tx=0).stop 2024-01-30T08:10:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 msgr2=0x7fb45c0be660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0be660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0ab000 tx=0x7fb44c019190 comp rx=0 tx=0).stop 2024-01-30T08:10:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 shutdown_connections 2024-01-30T08:10:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb45c0af780 0x7fb45c1ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb434066500 0x7fb4340689c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45c154730 0x7fb45c1ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 --2- 172.21.15.50:0/1949793303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb45c0abb20 0x7fb45c0be660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 >> 172.21.15.50:0/1949793303 conn(0x7fb45c072470 msgr2=0x7fb45c15e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:48.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 shutdown_connections 2024-01-30T08:10:48.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.715+0000 7fb461000640 1 -- 172.21.15.50:0/1949793303 wait complete. 2024-01-30T08:10:48.737 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-01-30T08:10:47.083094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237480,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737240,"statfs":{"total":773094113280,"available":772850933760,"internally_reserved":0,"allocated":4792320,"data_stored":3289190,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001537"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-30T08:10:44.132935+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:44.132935+0000","last_peered":"2024-01-30T08:10:44.132935+0000","last_clean":"2024-01-30T08:10:44.132935+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:44.132935+0000","last_undegraded":"2024-01-30T08:10:44.132935+0000","last_fullsized":"2024-01-30T08:10:44.132935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":854738,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.92700000000000005,"15min":0.96699999999999997},"min":{"1min":0.51800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.82299999999999995,"15min":0.85299999999999998},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.542,"15min":1.542},"last":0.747},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.88600000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":0.81499999999999995},"min":{"1min":0.50700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0349999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.94399999999999995,"15min":0.97999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92200000000000004,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":264898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.627},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88700000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84099999999999997,"15min":0.86799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0980000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.016},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.51700000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68100000000000005,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.80200000000000005},"min":{"1min":0.52900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.753,"15min":0.752},"min":{"1min":0.53300000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.077,"5min":1.159,"15min":1.159},"last":0.752},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":581632,"data_stored":264828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.624,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.376}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58799999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2250000000000001,"5min":1.387,"15min":1.387},"last":0.627},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.56200000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56899999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":267262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56200000000000006,"5min":1.137,"15min":1.137},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.58099999999999996,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.63500000000000001,"15min":0.67500000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52600000000000002,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55100000000000005,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.69099999999999995,"15min":0.72699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64400000000000002,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.86299999999999999,"15min":0.88800000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.878,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.63100000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89500000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94899999999999995,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91200000000000003,"5min":1.097,"15min":1.097},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":1.288,"15min":1.288},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.63700000000000001,"5min":0.625,"15min":0.625},"max":{"1min":1.01,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80900000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":267240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63600000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1020000000000001,"5min":1.121,"15min":1.121},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.044,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98399999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.62}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":264406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.52800000000000002,"15min":0.54900000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55700000000000005,"5min":2.657,"15min":2.657},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.26900000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.57199999999999995,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66900000000000004,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.626,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.376}]},{"osd":3,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.67000000000000004,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.626,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96099999999999997,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.51,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96899999999999997,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.80500000000000005}]},{"osd":6,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98199999999999998,"5min":1.639,"15min":1.639},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.95099999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.409,"5min":5.383,"15min":5.383},"last":0.89400000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0049999999999999,"5min":1.79,"15min":1.79},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":257697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.6989999999999998,"5min":4.6989999999999998,"15min":4.6989999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.71599999999999997,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.436,"15min":0.436},"max":{"1min":6.3719999999999999,"5min":6.3719999999999999,"15min":6.3719999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.1859999999999999,"5min":7.1859999999999999,"15min":7.1859999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.1639999999999997,"5min":6.1639999999999997,"15min":6.1639999999999997},"last":0.60399999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.748,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":6.1180000000000003,"5min":6.1180000000000003,"15min":6.1180000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.75}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73699999999999999,"15min":0.71999999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.46800000000000003}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":638976,"data_stored":848121,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.437,"15min":0.435},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.318}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.67400000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.432},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52500000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1080000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.153,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.079,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.149,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.405,"15min":1.405},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:48.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:48.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.875+0000 7fb62ca00640 1 Processor -- start 2024-01-30T08:10:48.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.875+0000 7fb62ca00640 1 -- start start 2024-01-30T08:10:48.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.875+0000 7fb62ca00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb62406de40 0x7fb62406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.875+0000 7fb62ca00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6240c4310 0x7fb624155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.875+0000 7fb62ca00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb624152f00 con 0x7fb624153390 2024-01-30T08:10:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.875+0000 7fb62ca00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6241525f0 con 0x7fb62406de40 2024-01-30T08:10:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.875+0000 7fb62ca00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240a7680 con 0x7fb6240c4310 2024-01-30T08:10:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb62406de40 0x7fb62406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb62406de40 0x7fb62406e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60870/0 (socket says 172.21.15.50:60870) 2024-01-30T08:10:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 -- 172.21.15.50:0/2579226686 learned_addr learned my addr 172.21.15.50:0/2579226686 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 -- 172.21.15.50:0/2579226686 >> v2:172.21.15.125:3300/0 conn(0x7fb6240c4310 msgr2=0x7fb624155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62aa00640 1 --2- 172.21.15.50:0/2579226686 >> v2:172.21.15.125:3300/0 conn(0x7fb6240c4310 0x7fb624155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 --2- 172.21.15.50:0/2579226686 >> v2:172.21.15.125:3300/0 conn(0x7fb6240c4310 0x7fb624155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 -- 172.21.15.50:0/2579226686 >> v1:172.21.15.125:6789/0 conn(0x7fb624153390 legacy=0x7fb6240a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 -- 172.21.15.50:0/2579226686 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6241528b0 con 0x7fb62406de40 2024-01-30T08:10:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62aa00640 1 --2- 172.21.15.50:0/2579226686 >> v2:172.21.15.125:3300/0 conn(0x7fb6240c4310 0x7fb624155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb62a000640 1 --2- 172.21.15.50:0/2579226686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb62406de40 0x7fb62406e220 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb6240c7d50 tx=0x7fb61401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89aa1b7cd73f003d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb628c00640 1 -- 172.21.15.50:0/2579226686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140ab600 con 0x7fb62406de40 2024-01-30T08:10:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb628c00640 1 -- 172.21.15.50:0/2579226686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6140a7050 con 0x7fb62406de40 2024-01-30T08:10:48.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.879+0000 7fb628c00640 1 -- 172.21.15.50:0/2579226686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140ab980 con 0x7fb62406de40 2024-01-30T08:10:48.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- 172.21.15.50:0/2579226686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb62406de40 msgr2=0x7fb62406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 --2- 172.21.15.50:0/2579226686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb62406de40 0x7fb62406e220 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb6240c7d50 tx=0x7fb61401c370 comp rx=0 tx=0).stop 2024-01-30T08:10:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- 172.21.15.50:0/2579226686 shutdown_connections 2024-01-30T08:10:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 --2- 172.21.15.50:0/2579226686 >> v2:172.21.15.125:3300/0 conn(0x7fb6240c4310 0x7fb624155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 --2- 172.21.15.50:0/2579226686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb62406de40 0x7fb62406e220 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- 172.21.15.50:0/2579226686 >> 172.21.15.50:0/2579226686 conn(0x7fb6240c4830 msgr2=0x7fb6240c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- 172.21.15.50:0/2579226686 shutdown_connections 2024-01-30T08:10:48.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- 172.21.15.50:0/2579226686 wait complete. 2024-01-30T08:10:48.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 Processor -- start 2024-01-30T08:10:48.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- start start 2024-01-30T08:10:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb62406de40 0x7fb62414cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6240c4310 0x7fb62414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb624153390 0x7fb62414b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241ed7a0 con 0x7fb624153390 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241eda60 con 0x7fb62406de40 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62ca00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241edd40 con 0x7fb6240c4310 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb624153390 0x7fb62414b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb624153390 0x7fb62414b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60880/0 (socket says 172.21.15.50:60880) 2024-01-30T08:10:48.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62aa00640 1 -- 172.21.15.50:0/3292102266 learned_addr learned my addr 172.21.15.50:0/3292102266 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb629600640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6240c4310 0x7fb62414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.883+0000 7fb62a000640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb62406de40 0x7fb62414cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62aa00640 1 -- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6240c4310 msgr2=0x7fb62414add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62aa00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6240c4310 0x7fb62414add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62aa00640 1 -- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb62406de40 msgr2=0x7fb62414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62aa00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb62406de40 0x7fb62414cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62aa00640 1 -- 172.21.15.50:0/3292102266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140094d0 con 0x7fb624153390 2024-01-30T08:10:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb629600640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6240c4310 0x7fb62414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62a000640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb62406de40 0x7fb62414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62aa00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb624153390 0x7fb62414b310 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00ce70 tx=0x7fb61c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb622000640 1 -- 172.21.15.50:0/3292102266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c003ba0 con 0x7fb624153390 2024-01-30T08:10:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb622000640 1 -- 172.21.15.50:0/3292102266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c003d20 con 0x7fb624153390 2024-01-30T08:10:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6241ee020 con 0x7fb624153390 2024-01-30T08:10:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb622000640 1 -- 172.21.15.50:0/3292102266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00d880 con 0x7fb624153390 2024-01-30T08:10:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62414b850 con 0x7fb624153390 2024-01-30T08:10:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb624074a20 con 0x7fb624153390 2024-01-30T08:10:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb622000640 1 -- 172.21.15.50:0/3292102266 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb61c00d9e0 con 0x7fb624153390 2024-01-30T08:10:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb622000640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5fc066530 0x7fb5fc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.887+0000 7fb622000640 1 -- 172.21.15.50:0/3292102266 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb61c084630 con 0x7fb624153390 2024-01-30T08:10:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.891+0000 7fb62a000640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5fc066530 0x7fb5fc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.891+0000 7fb62a000640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5fc066530 0x7fb5fc0689f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6140ad000 tx=0x7fb6140a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:48.891+0000 7fb622000640 1 -- 172.21.15.50:0/3292102266 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb61c051a20 con 0x7fb624153390 2024-01-30T08:10:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.047+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6240adf80 con 0x7fb5fc066530 2024-01-30T08:10:49.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.051+0000 7fb622000640 1 -- 172.21.15.50:0/3292102266 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50751 (secure 0 0 0) 0x7fb6240adf80 con 0x7fb5fc066530 2024-01-30T08:10:49.056 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:49.057 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.051+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5fc066530 msgr2=0x7fb5fc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.051+0000 7fb62ca00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5fc066530 0x7fb5fc0689f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6140ad000 tx=0x7fb6140a6000 comp rx=0 tx=0).stop 2024-01-30T08:10:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.051+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb624153390 msgr2=0x7fb62414b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.051+0000 7fb62ca00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb624153390 0x7fb62414b310 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00ce70 tx=0x7fb61c00a710 comp rx=0 tx=0).stop 2024-01-30T08:10:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 shutdown_connections 2024-01-30T08:10:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fb5fc066530 0x7fb5fc0689f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb624153390 0x7fb62414b310 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6240c4310 0x7fb62414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 --2- 172.21.15.50:0/3292102266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb62406de40 0x7fb62414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 >> 172.21.15.50:0/3292102266 conn(0x7fb6240c4830 msgr2=0x7fb6240705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 shutdown_connections 2024-01-30T08:10:49.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.055+0000 7fb62ca00640 1 -- 172.21.15.50:0/3292102266 wait complete. 2024-01-30T08:10:49.078 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-01-30T08:10:47.083094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237480,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737240,"statfs":{"total":773094113280,"available":772850933760,"internally_reserved":0,"allocated":4792320,"data_stored":3289190,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001537"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-30T08:10:44.132935+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:44.132935+0000","last_peered":"2024-01-30T08:10:44.132935+0000","last_clean":"2024-01-30T08:10:44.132935+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:44.132935+0000","last_undegraded":"2024-01-30T08:10:44.132935+0000","last_fullsized":"2024-01-30T08:10:44.132935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":854738,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.92700000000000005,"15min":0.96699999999999997},"min":{"1min":0.51800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.82299999999999995,"15min":0.85299999999999998},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.542,"15min":1.542},"last":0.747},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.88600000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":0.81499999999999995},"min":{"1min":0.50700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0349999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.94399999999999995,"15min":0.97999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92200000000000004,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":264898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.627},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88700000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84099999999999997,"15min":0.86799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0980000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.016},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.51700000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68100000000000005,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.80200000000000005},"min":{"1min":0.52900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.753,"15min":0.752},"min":{"1min":0.53300000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.077,"5min":1.159,"15min":1.159},"last":0.752},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":581632,"data_stored":264828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.624,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.376}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58799999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2250000000000001,"5min":1.387,"15min":1.387},"last":0.627},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.56200000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56899999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":267262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56200000000000006,"5min":1.137,"15min":1.137},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.58099999999999996,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.63500000000000001,"15min":0.67500000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52600000000000002,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55100000000000005,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.69099999999999995,"15min":0.72699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64400000000000002,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.86299999999999999,"15min":0.88800000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.878,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.63100000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89500000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94899999999999995,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91200000000000003,"5min":1.097,"15min":1.097},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":1.288,"15min":1.288},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.63700000000000001,"5min":0.625,"15min":0.625},"max":{"1min":1.01,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80900000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":267240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63600000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1020000000000001,"5min":1.121,"15min":1.121},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.044,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98399999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.62}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":264406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.52800000000000002,"15min":0.54900000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55700000000000005,"5min":2.657,"15min":2.657},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.26900000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.57199999999999995,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66900000000000004,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.626,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.376}]},{"osd":3,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.67000000000000004,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.626,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96099999999999997,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.51,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96899999999999997,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.80500000000000005}]},{"osd":6,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98199999999999998,"5min":1.639,"15min":1.639},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.95099999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.409,"5min":5.383,"15min":5.383},"last":0.89400000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0049999999999999,"5min":1.79,"15min":1.79},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":257697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.6989999999999998,"5min":4.6989999999999998,"15min":4.6989999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.71599999999999997,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.436,"15min":0.436},"max":{"1min":6.3719999999999999,"5min":6.3719999999999999,"15min":6.3719999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.1859999999999999,"5min":7.1859999999999999,"15min":7.1859999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.1639999999999997,"5min":6.1639999999999997,"15min":6.1639999999999997},"last":0.60399999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.748,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":6.1180000000000003,"5min":6.1180000000000003,"15min":6.1180000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.75}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73699999999999999,"15min":0.71999999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.46800000000000003}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":638976,"data_stored":848121,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.437,"15min":0.435},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.318}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.67400000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.432},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52500000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1080000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.153,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.079,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.149,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.405,"15min":1.405},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:49.080 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-30T08:10:49.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.215+0000 7f9cf0800640 1 Processor -- start 2024-01-30T08:10:49.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.215+0000 7f9cf0800640 1 -- start start 2024-01-30T08:10:49.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9cf0800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ce80c0ee0 0x7f9ce81559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9cf0800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ce80c1de0 0x7f9ce806a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9cf0800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80c3ed0 con 0x7f9ce814fbf0 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9cf0800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce80a5520 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9cf0800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce806bca0 con 0x7f9ce80c1de0 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ce80c0ee0 0x7f9ce81559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ce80c0ee0 0x7f9ce81559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42258/0 (socket says 172.21.15.50:42258) 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 -- 172.21.15.50:0/4150911050 learned_addr learned my addr 172.21.15.50:0/4150911050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9cede00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ce814fbf0 0x7f9ce80a4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51398/0 (socket says 172.21.15.50:51398) 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9cee800640 1 --2- 172.21.15.50:0/4150911050 >> v2:172.21.15.125:3300/0 conn(0x7f9ce80c1de0 0x7f9ce806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 -- 172.21.15.50:0/4150911050 >> v2:172.21.15.125:3300/0 conn(0x7f9ce80c1de0 msgr2=0x7f9ce806a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:49.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 --2- 172.21.15.50:0/4150911050 >> v2:172.21.15.125:3300/0 conn(0x7f9ce80c1de0 0x7f9ce806a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 -- 172.21.15.50:0/4150911050 >> v1:172.21.15.50:6789/0 conn(0x7f9ce814fbf0 legacy=0x7f9ce80a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ceca00640 1 -- 172.21.15.50:0/4150911050 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745428936 0 0) 0x7f9ce80c3ed0 con 0x7f9ce814fbf0 2024-01-30T08:10:49.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 -- 172.21.15.50:0/4150911050 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce806bef0 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ced400640 1 --2- 172.21.15.50:0/4150911050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce81559c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80c1660 tx=0x7f9cd001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70d4b195748dce4 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:49.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ceca00640 1 -- 172.21.15.50:0/4150911050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00ab600 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.219+0000 7f9ceca00640 1 -- 172.21.15.50:0/4150911050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd00ab760 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9ceca00640 1 -- 172.21.15.50:0/4150911050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00abaf0 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- 172.21.15.50:0/4150911050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 msgr2=0x7f9ce81559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4150911050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce81559c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80c1660 tx=0x7f9cd001c3e0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- 172.21.15.50:0/4150911050 shutdown_connections 2024-01-30T08:10:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4150911050 >> v2:172.21.15.125:3300/0 conn(0x7f9ce80c1de0 0x7f9ce806a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4150911050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce81559c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- 172.21.15.50:0/4150911050 >> 172.21.15.50:0/4150911050 conn(0x7f9ce80c5b50 msgr2=0x7f9ce80c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:49.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- 172.21.15.50:0/4150911050 shutdown_connections 2024-01-30T08:10:49.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- 172.21.15.50:0/4150911050 wait complete. 2024-01-30T08:10:49.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 Processor -- start 2024-01-30T08:10:49.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- start start 2024-01-30T08:10:49.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce80c1de0 0x7f9ce80a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce814fbf0 0x7f9ce80a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8149d40 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80a9290 con 0x7f9ce80c1de0 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cf0800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80a9530 con 0x7f9ce814fbf0 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.223+0000 7f9cede00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce814a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42266/0 (socket says 172.21.15.50:42266) 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 -- 172.21.15.50:0/4277158250 learned_addr learned my addr 172.21.15.50:0/4277158250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:49.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cee800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce814fbf0 0x7f9ce80a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ced400640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce80c1de0 0x7f9ce80a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 -- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce814fbf0 msgr2=0x7f9ce80a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce814fbf0 0x7f9ce80a6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 -- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce80c1de0 msgr2=0x7f9ce80a8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce80c1de0 0x7f9ce80a8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 -- 172.21.15.50:0/4277158250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00094d0 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ced400640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce80c1de0 0x7f9ce80a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:49.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cee800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce814fbf0 0x7f9ce80a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cede00640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce814a7e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80011f0 tx=0x7f9cd800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ce6000640 1 -- 172.21.15.50:0/4277158250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80074e0 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ce6000640 1 -- 172.21.15.50:0/4277158250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd8007640 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ce6000640 1 -- 172.21.15.50:0/4277158250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8004a10 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce8149fe0 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce80a6fd0 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce814a500 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ce6000640 1 -- 172.21.15.50:0/4277158250 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9cd8004b70 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ce6000640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9cc0066530 0x7f9cc00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.227+0000 7f9ce6000640 1 -- 172.21.15.50:0/4277158250 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9cd8083330 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.231+0000 7f9ced400640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9cc0066530 0x7f9cc00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.231+0000 7f9ced400640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9cc0066530 0x7f9cc00689f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00af000 tx=0x7f9cd00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:49.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.231+0000 7f9ce6000640 1 -- 172.21.15.50:0/4277158250 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9ce814a500 con 0x7f9ce80c0ee0 2024-01-30T08:10:49.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.387+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ce814a500 con 0x7f9cc0066530 2024-01-30T08:10:49.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9ce6000640 1 -- 172.21.15.50:0/4277158250 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50793 (secure 0 0 0) 0x7f9ce814a500 con 0x7f9cc0066530 2024-01-30T08:10:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:49.396 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:49.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9cc0066530 msgr2=0x7f9cc00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9cc0066530 0x7f9cc00689f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00af000 tx=0x7f9cd00a7000 comp rx=0 tx=0).stop 2024-01-30T08:10:49.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 msgr2=0x7f9ce814a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce814a7e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80011f0 tx=0x7f9cd800c9b0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 shutdown_connections 2024-01-30T08:10:49.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ce80c1de0 0x7f9ce80a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9cc0066530 0x7f9cc00689f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ce814fbf0 0x7f9ce80a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 --2- 172.21.15.50:0/4277158250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ce80c0ee0 0x7f9ce814a7e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 >> 172.21.15.50:0/4277158250 conn(0x7f9ce80c5b50 msgr2=0x7f9ce814b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:49.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 shutdown_connections 2024-01-30T08:10:49.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.391+0000 7f9cf0800640 1 -- 172.21.15.50:0/4277158250 wait complete. 2024-01-30T08:10:49.416 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-01-30T08:10:49.083522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237568,"kb_used_data":4760,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737152,"statfs":{"total":773094113280,"available":772850843648,"internally_reserved":0,"allocated":4874240,"data_stored":3327188,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001227"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-30T08:10:44.132935+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:44.132935+0000","last_peered":"2024-01-30T08:10:44.132935+0000","last_clean":"2024-01-30T08:10:44.132935+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:44.132935+0000","last_undegraded":"2024-01-30T08:10:44.132935+0000","last_fullsized":"2024-01-30T08:10:44.132935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":854738,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.92700000000000005,"15min":0.96699999999999997},"min":{"1min":0.51800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.82299999999999995,"15min":0.85299999999999998},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.542,"15min":1.542},"last":0.747},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.88600000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":0.81499999999999995},"min":{"1min":0.50700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0349999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.94399999999999995,"15min":0.97999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92200000000000004,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":264898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.627},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88700000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.70999999999999996}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84099999999999997,"15min":0.86799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0980000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.016},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.51700000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68100000000000005,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.80200000000000005},"min":{"1min":0.52900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.753,"15min":0.752},"min":{"1min":0.53300000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.077,"5min":1.159,"15min":1.159},"last":0.752},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":581632,"data_stored":264828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.624,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.376}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58799999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2250000000000001,"5min":1.387,"15min":1.387},"last":0.627},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.56200000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56899999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":267262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56200000000000006,"5min":1.137,"15min":1.137},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.58099999999999996,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.63500000000000001,"15min":0.67500000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52600000000000002,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55100000000000005,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.69099999999999995,"15min":0.72699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64400000000000002,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.86299999999999999,"15min":0.88800000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.878,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.63100000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89500000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94899999999999995,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91200000000000003,"5min":1.097,"15min":1.097},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":1.288,"15min":1.288},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.63700000000000001,"5min":0.625,"15min":0.625},"max":{"1min":1.01,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.80900000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":267240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63600000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1020000000000001,"5min":1.121,"15min":1.121},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.044,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98399999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.62}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":264406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.52800000000000002,"15min":0.54900000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55700000000000005,"5min":2.657,"15min":2.657},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.26900000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.57199999999999995,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66900000000000004,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.626,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.376}]},{"osd":3,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.67000000000000004,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.626,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96099999999999997,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.51,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96899999999999997,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.80500000000000005}]},{"osd":6,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98199999999999998,"5min":1.639,"15min":1.639},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.95099999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.409,"5min":5.383,"15min":5.383},"last":0.89400000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0049999999999999,"5min":1.79,"15min":1.79},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.6989999999999998,"5min":4.6989999999999998,"15min":4.6989999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.503}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.71599999999999997,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.436,"15min":0.436},"max":{"1min":6.3719999999999999,"5min":6.3719999999999999,"15min":6.3719999999999999},"last":0.62},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.1859999999999999,"5min":7.1859999999999999,"15min":7.1859999999999999},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.1639999999999997,"5min":6.1639999999999997,"15min":6.1639999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.748,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":6.1180000000000003,"5min":6.1180000000000003,"15min":6.1180000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.35199999999999998}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73699999999999999,"15min":0.71999999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":867092,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.437,"15min":0.435},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.33300000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.67400000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.38500000000000001}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1080000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.153,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.77700000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.079,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.149,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.405,"15min":1.405},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:49.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-30T08:10:49.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ee00640 1 Processor -- start 2024-01-30T08:10:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ee00640 1 -- start start 2024-01-30T08:10:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ee00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed8806b850 0x7fed88151b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ee00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed88071240 con 0x7fed88071de0 2024-01-30T08:10:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ee00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed88152210 con 0x7fed88072990 2024-01-30T08:10:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ee00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8814bc70 con 0x7fed8806b850 2024-01-30T08:10:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ce00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed88071de0 0x7fed8815bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51410/0 (socket says 172.21.15.50:51410) 2024-01-30T08:10:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed8ce00640 1 -- 172.21.15.50:0/4128517984 learned_addr learned my addr 172.21.15.50:0/4128517984 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed87e00640 1 --2- 172.21.15.50:0/4128517984 >> v2:172.21.15.125:3300/0 conn(0x7fed8806b850 0x7fed88151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815153513 0 0) 0x7fed88071240 con 0x7fed88071de0 2024-01-30T08:10:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed68003530 con 0x7fed88071de0 2024-01-30T08:10:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357516325 0 0) 0x7fed88152210 con 0x7fed88072990 2024-01-30T08:10:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed88071240 con 0x7fed88072990 2024-01-30T08:10:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed87e00640 1 -- 172.21.15.50:0/4128517984 >> v1:172.21.15.125:6789/0 conn(0x7fed88072990 legacy=0x7fed880716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed87e00640 1 -- 172.21.15.50:0/4128517984 >> v1:172.21.15.50:6789/0 conn(0x7fed88071de0 legacy=0x7fed8815bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2877888221 0 0) 0x7fed68003530 con 0x7fed88071de0 2024-01-30T08:10:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.555+0000 7fed87e00640 1 -- 172.21.15.50:0/4128517984 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed880c4dc0 con 0x7fed8806b850 2024-01-30T08:10:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed87e00640 1 --2- 172.21.15.50:0/4128517984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8806b850 0x7fed88151b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fed780097c0 tx=0x7fed7801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2cbd6d87e08b07 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80001a00 con 0x7fed8806b850 2024-01-30T08:10:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed780a7050 con 0x7fed8806b850 2024-01-30T08:10:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed86a00640 1 -- 172.21.15.50:0/4128517984 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780ab600 con 0x7fed8806b850 2024-01-30T08:10:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed8ee00640 1 -- 172.21.15.50:0/4128517984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8806b850 msgr2=0x7fed88151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed8ee00640 1 --2- 172.21.15.50:0/4128517984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8806b850 0x7fed88151b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fed780097c0 tx=0x7fed7801c310 comp rx=0 tx=0).stop 2024-01-30T08:10:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed8ee00640 1 -- 172.21.15.50:0/4128517984 shutdown_connections 2024-01-30T08:10:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed8ee00640 1 --2- 172.21.15.50:0/4128517984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed8806b850 0x7fed88151b70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed8ee00640 1 -- 172.21.15.50:0/4128517984 >> 172.21.15.50:0/4128517984 conn(0x7fed880a9590 msgr2=0x7fed880c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed8ee00640 1 -- 172.21.15.50:0/4128517984 shutdown_connections 2024-01-30T08:10:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.559+0000 7fed8ee00640 1 -- 172.21.15.50:0/4128517984 wait complete. 2024-01-30T08:10:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 Processor -- start 2024-01-30T08:10:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 -- start start 2024-01-30T08:10:49.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed8806b850 0x7fed881f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed88071de0 0x7fed8814c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed88072990 0x7fed8814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8814b630 con 0x7fed8806b850 2024-01-30T08:10:49.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8814e2f0 con 0x7fed88072990 2024-01-30T08:10:49.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8814e5d0 con 0x7fed88071de0 2024-01-30T08:10:49.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed8806b850 0x7fed881f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed8806b850 0x7fed881f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42272/0 (socket says 172.21.15.50:42272) 2024-01-30T08:10:49.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 -- 172.21.15.50:0/904187614 learned_addr learned my addr 172.21.15.50:0/904187614 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:49.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87400640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed88071de0 0x7fed8814c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ce00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed88072990 0x7fed8814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 -- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed88071de0 msgr2=0x7fed8814c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed88071de0 0x7fed8814c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 -- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed88072990 msgr2=0x7fed8814ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed88072990 0x7fed8814ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 -- 172.21.15.50:0/904187614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78009420 con 0x7fed8806b850 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed87e00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed8806b850 0x7fed881f1200 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed78000c10 tx=0x7fed780190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed7fe00640 1 -- 172.21.15.50:0/904187614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78003ab0 con 0x7fed8806b850 2024-01-30T08:10:49.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed7fe00640 1 -- 172.21.15.50:0/904187614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed78003c10 con 0x7fed8806b850 2024-01-30T08:10:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed881f1a50 con 0x7fed8806b850 2024-01-30T08:10:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed7fe00640 1 -- 172.21.15.50:0/904187614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780b4400 con 0x7fed8806b850 2024-01-30T08:10:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.563+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed881f1740 con 0x7fed8806b850 2024-01-30T08:10:49.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.567+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8814c7c0 con 0x7fed8806b850 2024-01-30T08:10:49.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.567+0000 7fed7fe00640 1 -- 172.21.15.50:0/904187614 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fed780b2040 con 0x7fed8806b850 2024-01-30T08:10:49.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.567+0000 7fed7fe00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fed60066500 0x7fed600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:49.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.567+0000 7fed7fe00640 1 -- 172.21.15.50:0/904187614 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fed7811dd70 con 0x7fed8806b850 2024-01-30T08:10:49.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.567+0000 7fed87400640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fed60066500 0x7fed600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:49.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.571+0000 7fed87400640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fed60066500 0x7fed600689c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed8806ebd0 tx=0x7fed70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:49.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.571+0000 7fed7fe00640 1 -- 172.21.15.50:0/904187614 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fed780eb0e0 con 0x7fed8806b850 2024-01-30T08:10:49.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed88074a20 con 0x7fed8806b850 2024-01-30T08:10:49.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed7fe00640 1 -- 172.21.15.50:0/904187614 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13322 (secure 0 0 0) 0x7fed780ee700 con 0x7fed8806b850 2024-01-30T08:10:49.735 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:49.736 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":51,"fsid":"d5419c7a-21ba-491f-86e9-4d6001549d1c","created":"2024-01-30T08:08:24.055794+0000","modified":"2024-01-30T08:10:46.531304+0000","last_up_change":"2024-01-30T08:08:34.840402+0000","last_in_change":"2024-01-30T08:08:26.542577+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-30T08:08:35.110596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7704d7b5-acb4-42fd-a6f8-9dd35a4f109b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6809","nonce":2622512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6811","nonce":2622512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6815","nonce":2622512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2622512062},{"type":"v1","addr":"172.21.15.50:6813","nonce":2622512062}]},"public_addr":"172.21.15.50:6809/2622512062","cluster_addr":"172.21.15.50:6811/2622512062","heartbeat_back_addr":"172.21.15.50:6815/2622512062","heartbeat_front_addr":"172.21.15.50:6813/2622512062","state":["exists","up"]},{"osd":1,"uuid":"c429378a-e521-47f6-b8ab-13e57215f8e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6801","nonce":1684920044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6803","nonce":1684920044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6807","nonce":1684920044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1684920044},{"type":"v1","addr":"172.21.15.50:6805","nonce":1684920044}]},"public_addr":"172.21.15.50:6801/1684920044","cluster_addr":"172.21.15.50:6803/1684920044","heartbeat_back_addr":"172.21.15.50:6807/1684920044","heartbeat_front_addr":"172.21.15.50:6805/1684920044","state":["exists","up"]},{"osd":2,"uuid":"352c0520-b9ee-41ea-b931-fa6ba5c8faea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6817","nonce":2310842832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6819","nonce":2310842832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6823","nonce":2310842832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2310842832},{"type":"v1","addr":"172.21.15.50:6821","nonce":2310842832}]},"public_addr":"172.21.15.50:6817/2310842832","cluster_addr":"172.21.15.50:6819/2310842832","heartbeat_back_addr":"172.21.15.50:6823/2310842832","heartbeat_front_addr":"172.21.15.50:6821/2310842832","state":["exists","up"]},{"osd":3,"uuid":"0a2aedc7-85af-45ec-b308-d82dc6f7d1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6825","nonce":116773969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6827","nonce":116773969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6831","nonce":116773969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":116773969},{"type":"v1","addr":"172.21.15.50:6829","nonce":116773969}]},"public_addr":"172.21.15.50:6825/116773969","cluster_addr":"172.21.15.50:6827/116773969","heartbeat_back_addr":"172.21.15.50:6831/116773969","heartbeat_front_addr":"172.21.15.50:6829/116773969","state":["exists","up"]},{"osd":4,"uuid":"51da0b6b-27de-4642-a142-8ce77861f79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6825","nonce":2753947898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6827","nonce":2753947898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6831","nonce":2753947898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2753947898},{"type":"v1","addr":"172.21.15.125:6829","nonce":2753947898}]},"public_addr":"172.21.15.125:6825/2753947898","cluster_addr":"172.21.15.125:6827/2753947898","heartbeat_back_addr":"172.21.15.125:6831/2753947898","heartbeat_front_addr":"172.21.15.125:6829/2753947898","state":["exists","up"]},{"osd":5,"uuid":"43c69935-7f50-41fa-a0af-4170c25981c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6801","nonce":1470340400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6803","nonce":1470340400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6807","nonce":1470340400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1470340400},{"type":"v1","addr":"172.21.15.125:6805","nonce":1470340400}]},"public_addr":"172.21.15.125:6801/1470340400","cluster_addr":"172.21.15.125:6803/1470340400","heartbeat_back_addr":"172.21.15.125:6807/1470340400","heartbeat_front_addr":"172.21.15.125:6805/1470340400","state":["exists","up"]},{"osd":6,"uuid":"6cf5c5e6-25d7-4ff3-aa73-0ebb62a4de1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6811","nonce":2977185679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6815","nonce":2977185679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6822","nonce":2977185679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":2977185679},{"type":"v1","addr":"172.21.15.125:6819","nonce":2977185679}]},"public_addr":"172.21.15.125:6811/2977185679","cluster_addr":"172.21.15.125:6815/2977185679","heartbeat_back_addr":"172.21.15.125:6822/2977185679","heartbeat_front_addr":"172.21.15.125:6819/2977185679","state":["exists","up"]},{"osd":7,"uuid":"7e9f93f3-551f-401a-bd6e-f33de84f619a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6810","nonce":1793140907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6814","nonce":1793140907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6823","nonce":1793140907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":1793140907},{"type":"v1","addr":"172.21.15.125:6818","nonce":1793140907}]},"public_addr":"172.21.15.125:6810/1793140907","cluster_addr":"172.21.15.125:6814/1793140907","heartbeat_back_addr":"172.21.15.125:6823/1793140907","heartbeat_front_addr":"172.21.15.125:6818/1793140907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.856303+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.106425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.147110+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.191246+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.193702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:31.966882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.145228+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-30T08:08:32.228855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6837/363187157":"2024-01-31T08:10:43.524835+0000","172.21.15.50:6835/1837689837":"2024-01-31T08:10:36.904003+0000","172.21.15.125:6835/363187157":"2024-01-31T08:10:43.524835+0000","172.21.15.50:6834/1837689837":"2024-01-31T08:10:36.904003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-30T08:10:49.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fed60066500 msgr2=0x7fed600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fed60066500 0x7fed600689c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed8806ebd0 tx=0x7fed70009040 comp rx=0 tx=0).stop 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed8806b850 msgr2=0x7fed881f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed8806b850 0x7fed881f1200 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed78000c10 tx=0x7fed780190b0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 shutdown_connections 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed88072990 0x7fed8814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fed60066500 0x7fed600689c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed88071de0 0x7fed8814c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 --2- 172.21.15.50:0/904187614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed8806b850 0x7fed881f1200 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:49.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.731+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 >> 172.21.15.50:0/904187614 conn(0x7fed880a9590 msgr2=0x7fed8806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.735+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 shutdown_connections 2024-01-30T08:10:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:49.735+0000 7fed8ee00640 1 -- 172.21.15.50:0/904187614 wait complete. 2024-01-30T08:10:50.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:10:50.206 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:10:50.759 INFO:tasks.ceph:Scrubbing osd.0 2024-01-30T08:10:50.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 Processor -- start 2024-01-30T08:10:50.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 -- start start 2024-01-30T08:10:50.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6f80c4e20 0x7fd6f80c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f80a8f80 0x7fd6f8072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6f8072ad0 0x7fd6f80c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f80a9b50 con 0x7fd6f8072ad0 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f80aa640 con 0x7fd6f80c4e20 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6ffe00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80c17a0 con 0x7fd6f80a8f80 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6f8072ad0 0x7fd6f80c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6f8072ad0 0x7fd6f80c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42286/0 (socket says 172.21.15.50:42286) 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 -- 172.21.15.50:0/151742572 learned_addr learned my addr 172.21.15.50:0/151742572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fd400640 1 --2- 172.21.15.50:0/151742572 >> v2:172.21.15.125:3300/0 conn(0x7fd6f80c4e20 0x7fd6f80c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fca00640 1 --2- 172.21.15.50:0/151742572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f80a8f80 0x7fd6f8072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 -- 172.21.15.50:0/151742572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f80a8f80 msgr2=0x7fd6f8072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:50.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 --2- 172.21.15.50:0/151742572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f80a8f80 0x7fd6f8072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 -- 172.21.15.50:0/151742572 >> v2:172.21.15.125:3300/0 conn(0x7fd6f80c4e20 msgr2=0x7fd6f80c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:50.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 --2- 172.21.15.50:0/151742572 >> v2:172.21.15.125:3300/0 conn(0x7fd6f80c4e20 0x7fd6f80c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fde00640 1 -- 172.21.15.50:0/151742572 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80a9da0 con 0x7fd6f8072ad0 2024-01-30T08:10:50.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.911+0000 7fd6fca00640 1 --2- 172.21.15.50:0/151742572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f80a8f80 0x7fd6f8072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:50.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6fde00640 1 --2- 172.21.15.50:0/151742572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f8072ad0 0x7fd6f80c24a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80c6ad0 tx=0x7fd6f001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367a926a785b8d77 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:50.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6f7e00640 1 -- 172.21.15.50:0/151742572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80c31f0 con 0x7fd6f8072ad0 2024-01-30T08:10:50.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6f7e00640 1 -- 172.21.15.50:0/151742572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f00a5700 con 0x7fd6f8072ad0 2024-01-30T08:10:50.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6f7e00640 1 -- 172.21.15.50:0/151742572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00a5a90 con 0x7fd6f8072ad0 2024-01-30T08:10:50.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 -- 172.21.15.50:0/151742572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f8072ad0 msgr2=0x7fd6f80c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:50.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 --2- 172.21.15.50:0/151742572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f8072ad0 0x7fd6f80c24a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80c6ad0 tx=0x7fd6f001c880 comp rx=0 tx=0).stop 2024-01-30T08:10:50.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 -- 172.21.15.50:0/151742572 shutdown_connections 2024-01-30T08:10:50.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 --2- 172.21.15.50:0/151742572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f8072ad0 0x7fd6f80c24a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 --2- 172.21.15.50:0/151742572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f80a8f80 0x7fd6f8072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 --2- 172.21.15.50:0/151742572 >> v2:172.21.15.125:3300/0 conn(0x7fd6f80c4e20 0x7fd6f80c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 -- 172.21.15.50:0/151742572 >> 172.21.15.50:0/151742572 conn(0x7fd6f80c5bb0 msgr2=0x7fd6f80c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:50.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 -- 172.21.15.50:0/151742572 shutdown_connections 2024-01-30T08:10:50.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.915+0000 7fd6ffe00640 1 -- 172.21.15.50:0/151742572 wait complete. 2024-01-30T08:10:50.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 Processor -- start 2024-01-30T08:10:50.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 -- start start 2024-01-30T08:10:50.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f8072ad0 0x7fd6f80bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f80a8f80 0x7fd6f80bd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6f80c4e20 0x7fd6f80a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80bfa50 con 0x7fd6f80a8f80 2024-01-30T08:10:50.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f81ed350 con 0x7fd6f80c4e20 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f81ed630 con 0x7fd6f8072ad0 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f80a8f80 0x7fd6f80bd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f80a8f80 0x7fd6f80bd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42302/0 (socket says 172.21.15.50:42302) 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 -- 172.21.15.50:0/2638691372 learned_addr learned my addr 172.21.15.50:0/2638691372 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fd400640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f8072ad0 0x7fd6f80bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fde00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6f80c4e20 0x7fd6f80a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 -- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f8072ad0 msgr2=0x7fd6f80bcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:50.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6f8072ad0 0x7fd6f80bcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 -- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6f80c4e20 msgr2=0x7fd6f80a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:50.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6f80c4e20 0x7fd6f80a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 -- 172.21.15.50:0/2638691372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0009b30 con 0x7fd6f80a8f80 2024-01-30T08:10:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6fca00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f80a8f80 0x7fd6f80bd2e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000e7e0 tx=0x7fd6e000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0004030 con 0x7fd6f80a8f80 2024-01-30T08:10:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e0004190 con 0x7fd6f80a8f80 2024-01-30T08:10:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f8156050 con 0x7fd6f80a8f80 2024-01-30T08:10:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0004500 con 0x7fd6f80a8f80 2024-01-30T08:10:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.919+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f8156610 con 0x7fd6f80a8f80 2024-01-30T08:10:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6f8155ed0 con 0x7fd6f80a8f80 2024-01-30T08:10:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd6e000c6d0 con 0x7fd6f80a8f80 2024-01-30T08:10:50.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6f5600640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd6d0066500 0x7fd6d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd6e0083ea0 con 0x7fd6f80a8f80 2024-01-30T08:10:50.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6f5600640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7fd6d006c8a0 0x7fd6d006ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:50.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 --> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6d006f3b0 con 0x7fd6d006c8a0 2024-01-30T08:10:50.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6e00842f0 con 0x7fd6f80a8f80 2024-01-30T08:10:50.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6fd400640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd6d0066500 0x7fd6d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6fde00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7fd6d006c8a0 0x7fd6d006ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:50.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6fde00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7fd6d006c8a0 0x7fd6d006ece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:50.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.923+0000 7fd6fd400640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd6d0066500 0x7fd6d00689c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009ac0 tx=0x7fd6e8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:50.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.927+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== osd.0 v2:172.21.15.50:6808/2622512062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd6d006f3b0 con 0x7fd6d006c8a0 2024-01-30T08:10:50.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 --> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd6f8154bd0 con 0x7fd6d006c8a0 2024-01-30T08:10:50.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6f5600640 1 -- 172.21.15.50:0/2638691372 <== osd.0 v2:172.21.15.50:6808/2622512062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd6f00a5870 con 0x7fd6d006c8a0 2024-01-30T08:10:50.943 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:50.944 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:50.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7fd6d006c8a0 msgr2=0x7fd6d006ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:6808/2622512062,v1:172.21.15.50:6809/2622512062] conn(0x7fd6d006c8a0 0x7fd6d006ece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd6d0066500 msgr2=0x7fd6d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd6d0066500 0x7fd6d00689c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009ac0 tx=0x7fd6e8009190 comp rx=0 tx=0).stop 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f80a8f80 msgr2=0x7fd6f80bd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 --2- 172.21.15.50:0/2638691372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6f80a8f80 0x7fd6f80bd2e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000e7e0 tx=0x7fd6e000eca0 comp rx=0 tx=0).stop 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6fde00640 1 -- 172.21.15.50:0/2638691372 reap_dead start 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 shutdown_connections 2024-01-30T08:10:50.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 >> 172.21.15.50:0/2638691372 conn(0x7fd6f80c5bb0 msgr2=0x7fd6f815a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:50.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 shutdown_connections 2024-01-30T08:10:50.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:50.939+0000 7fd6ffe00640 1 -- 172.21.15.50:0/2638691372 wait complete. 2024-01-30T08:10:50.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-30T08:10:51.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31ed800640 1 Processor -- start 2024-01-30T08:10:51.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31ed800640 1 -- start start 2024-01-30T08:10:51.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31ed800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31e80adb30 0x7f31e80c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31ed800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31e80c4b90 0x7f31e81523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31ed800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e81528f0 con 0x7f31e80c47b0 2024-01-30T08:10:51.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31ed800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80a78f0 con 0x7f31e80adb30 2024-01-30T08:10:51.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31ed800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80c5020 con 0x7f31e80c4b90 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e6000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31e80adb30 0x7f31e80c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e6000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31e80adb30 0x7f31e80c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42318/0 (socket says 172.21.15.50:42318) 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e6000640 1 -- 172.21.15.50:0/1350519976 learned_addr learned my addr 172.21.15.50:0/1350519976 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e7400640 1 --2- 172.21.15.50:0/1350519976 >> v2:172.21.15.125:3300/0 conn(0x7f31e80c4b90 0x7f31e81523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e6000640 1 -- 172.21.15.50:0/1350519976 >> v2:172.21.15.125:3300/0 conn(0x7f31e80c4b90 msgr2=0x7f31e81523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e6000640 1 --2- 172.21.15.50:0/1350519976 >> v2:172.21.15.125:3300/0 conn(0x7f31e80c4b90 0x7f31e81523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e6000640 1 -- 172.21.15.50:0/1350519976 >> v1:172.21.15.125:6789/0 conn(0x7f31e80c47b0 legacy=0x7f31e80a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.103+0000 7f31e6000640 1 -- 172.21.15.50:0/1350519976 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80c4500 con 0x7f31e80adb30 2024-01-30T08:10:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31e6000640 1 --2- 172.21.15.50:0/1350519976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e80c3f20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009870 tx=0x7f31d001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38518c6b026e14ff server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31e5600640 1 -- 172.21.15.50:0/1350519976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00ad660 con 0x7f31e80adb30 2024-01-30T08:10:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31e5600640 1 -- 172.21.15.50:0/1350519976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d00ad7c0 con 0x7f31e80adb30 2024-01-30T08:10:51.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31e5600640 1 -- 172.21.15.50:0/1350519976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00adb50 con 0x7f31e80adb30 2024-01-30T08:10:51.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 -- 172.21.15.50:0/1350519976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 msgr2=0x7f31e80c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 --2- 172.21.15.50:0/1350519976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e80c3f20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009870 tx=0x7f31d001c470 comp rx=0 tx=0).stop 2024-01-30T08:10:51.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 -- 172.21.15.50:0/1350519976 shutdown_connections 2024-01-30T08:10:51.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 --2- 172.21.15.50:0/1350519976 >> v2:172.21.15.125:3300/0 conn(0x7f31e80c4b90 0x7f31e81523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 --2- 172.21.15.50:0/1350519976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e80c3f20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 -- 172.21.15.50:0/1350519976 >> 172.21.15.50:0/1350519976 conn(0x7f31e806ad40 msgr2=0x7f31e80c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:51.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 -- 172.21.15.50:0/1350519976 shutdown_connections 2024-01-30T08:10:51.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.107+0000 7f31ed800640 1 -- 172.21.15.50:0/1350519976 wait complete. 2024-01-30T08:10:51.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 Processor -- start 2024-01-30T08:10:51.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 -- start start 2024-01-30T08:10:51.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31e80c47b0 0x7f31e80c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31e80c4b90 0x7f31e81ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81eced0 con 0x7f31e80adb30 2024-01-30T08:10:51.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81ed150 con 0x7f31e80c47b0 2024-01-30T08:10:51.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e806bd80 con 0x7f31e80c4b90 2024-01-30T08:10:51.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e806d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42330/0 (socket says 172.21.15.50:42330) 2024-01-30T08:10:51.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 -- 172.21.15.50:0/2710615513 learned_addr learned my addr 172.21.15.50:0/2710615513 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:51.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e7400640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31e80c4b90 0x7f31e81ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6000640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31e80c47b0 0x7f31e80c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 -- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31e80c4b90 msgr2=0x7f31e81ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31e80c4b90 0x7f31e81ed5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 -- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31e80c47b0 msgr2=0x7f31e80c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31e80c47b0 0x7f31e80c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 -- 172.21.15.50:0/2710615513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00094d0 con 0x7f31e80adb30 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31e6a00640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e806d320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f31d800c420 tx=0x7f31d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31dea00640 1 -- 172.21.15.50:0/2710615513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80052d0 con 0x7f31e80adb30 2024-01-30T08:10:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31dea00640 1 -- 172.21.15.50:0/2710615513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d8005430 con 0x7f31e80adb30 2024-01-30T08:10:51.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31dea00640 1 -- 172.21.15.50:0/2710615513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8007260 con 0x7f31e80adb30 2024-01-30T08:10:51.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e81518d0 con 0x7f31e80adb30 2024-01-30T08:10:51.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.111+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e8151e90 con 0x7f31e80adb30 2024-01-30T08:10:51.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.115+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e81520b0 con 0x7f31e80adb30 2024-01-30T08:10:51.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.115+0000 7f31dea00640 1 -- 172.21.15.50:0/2710615513 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f31d80073c0 con 0x7f31e80adb30 2024-01-30T08:10:51.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.115+0000 7f31dea00640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f31c0066500 0x7f31c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.115+0000 7f31dea00640 1 -- 172.21.15.50:0/2710615513 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f31d80830b0 con 0x7f31e80adb30 2024-01-30T08:10:51.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.115+0000 7f31e6000640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f31c0066500 0x7f31c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.115+0000 7f31e6000640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f31c0066500 0x7f31c00689c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f31d00af000 tx=0x7f31d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.119+0000 7f31dea00640 1 -- 172.21.15.50:0/2710615513 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f31d8050550 con 0x7f31e80adb30 2024-01-30T08:10:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e80c84c0 con 0x7f31c0066500 2024-01-30T08:10:51.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31dea00640 1 -- 172.21.15.50:0/2710615513 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f31d00ad930 con 0x7f31c0066500 2024-01-30T08:10:51.283 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2024-01-30T08:10:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f31c0066500 msgr2=0x7f31c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f31c0066500 0x7f31c00689c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f31d00af000 tx=0x7f31d0008040 comp rx=0 tx=0).stop 2024-01-30T08:10:51.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 msgr2=0x7f31e806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e806d320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f31d800c420 tx=0x7f31d800c8e0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 shutdown_connections 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31e80c47b0 0x7f31e80c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f31c0066500 0x7f31c00689c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31e80c4b90 0x7f31e81ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 --2- 172.21.15.50:0/2710615513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80adb30 0x7f31e806d320 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 >> 172.21.15.50:0/2710615513 conn(0x7f31e806ad40 msgr2=0x7f31e806f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 shutdown_connections 2024-01-30T08:10:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.279+0000 7f31ed800640 1 -- 172.21.15.50:0/2710615513 wait complete. 2024-01-30T08:10:51.305 INFO:tasks.ceph:Scrubbing osd.1 2024-01-30T08:10:51.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6381000640 1 Processor -- start 2024-01-30T08:10:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6381000640 1 -- start start 2024-01-30T08:10:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6381000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 0x7f637c0a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6381000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0c0ae0 con 0x7f637c0a96d0 2024-01-30T08:10:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6381000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0c10e0 con 0x7f637c0c0570 2024-01-30T08:10:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6381000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0c13c0 con 0x7f637c070020 2024-01-30T08:10:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f637c0a96d0 0x7f637c0c1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51422/0 (socket says 172.21.15.50:51422) 2024-01-30T08:10:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379e00640 1 -- 172.21.15.50:0/4252963307 learned_addr learned my addr 172.21.15.50:0/4252963307 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379400640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 0x7f637c0a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902939912 0 0) 0x7f637c0c0ae0 con 0x7f637c0a96d0 2024-01-30T08:10:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f635c003530 con 0x7f637c0a96d0 2024-01-30T08:10:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322101377 0 0) 0x7f637c0c10e0 con 0x7f637c0c0570 2024-01-30T08:10:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f637c0c0ae0 con 0x7f637c0c0570 2024-01-30T08:10:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814790648 0 0) 0x7f635c003530 con 0x7f637c0a96d0 2024-01-30T08:10:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 msgr2=0x7f637c0a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 0x7f637c0a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 >> v1:172.21.15.125:6789/0 conn(0x7f637c0c0570 legacy=0x7f637c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0c16a0 con 0x7f637c0a96d0 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f636c001680 con 0x7f637c0a96d0 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 >> v1:172.21.15.50:6789/0 conn(0x7f637c0a96d0 legacy=0x7f637c0c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c003b40 0x7f635c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f635c0047d0 0x7f635c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 0x7f635c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0c13c0 con 0x7f635c0047d0 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c00bb20 con 0x7f635c003b40 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c00dec0 con 0x7f637c070020 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379400640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f635c0047d0 0x7f635c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379e00640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c003b40 0x7f635c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f637a800640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 0x7f635c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379400640 1 -- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 msgr2=0x7f635c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379400640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f637c070020 0x7f635c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379400640 1 -- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c003b40 msgr2=0x7f635c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379400640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c003b40 0x7f635c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379400640 1 -- 172.21.15.50:0/4252963307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c003530 con 0x7f635c0047d0 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.451+0000 7f6379e00640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c003b40 0x7f635c003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6379400640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f635c0047d0 0x7f635c004c50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f636400aa90 tx=0x7f636401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c24641141bc4d44 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640a5ac0 con 0x7f635c0047d0 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63640a5c20 con 0x7f635c0047d0 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6378a00640 1 -- 172.21.15.50:0/4252963307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640ad440 con 0x7f635c0047d0 2024-01-30T08:10:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6381000640 1 -- 172.21.15.50:0/4252963307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f635c0047d0 msgr2=0x7f635c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6381000640 1 --2- 172.21.15.50:0/4252963307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f635c0047d0 0x7f635c004c50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f636400aa90 tx=0x7f636401cc10 comp rx=0 tx=0).stop 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f637a800640 1 -- 172.21.15.50:0/4252963307 reap_dead start 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6381000640 1 -- 172.21.15.50:0/4252963307 shutdown_connections 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6381000640 1 -- 172.21.15.50:0/4252963307 >> 172.21.15.50:0/4252963307 conn(0x7f637c0c5bb0 msgr2=0x7f637c0c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6381000640 1 -- 172.21.15.50:0/4252963307 shutdown_connections 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.455+0000 7f6381000640 1 -- 172.21.15.50:0/4252963307 wait complete. 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 Processor -- start 2024-01-30T08:10:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 -- start start 2024-01-30T08:10:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f635c0047d0 0x7f637c140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c152de0 0x7f637c1412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c152130 0x7f637c1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1417f0 con 0x7f637c152130 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1e9ff0 con 0x7f637c152de0 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c152610 con 0x7f635c0047d0 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c152130 0x7f637c1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c152130 0x7f637c1503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42336/0 (socket says 172.21.15.50:42336) 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 -- 172.21.15.50:0/1722550641 learned_addr learned my addr 172.21.15.50:0/1722550641 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6379e00640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f635c0047d0 0x7f637c140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6379400640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c152de0 0x7f637c1412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 -- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f635c0047d0 msgr2=0x7f637c140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f635c0047d0 0x7f637c140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 -- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c152de0 msgr2=0x7f637c1412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c152de0 0x7f637c1412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 -- 172.21.15.50:0/1722550641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c1528f0 con 0x7f637c152130 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f637a800640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c152130 0x7f637c1503f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f637c0c0950 tx=0x7f637400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374017070 con 0x7f637c152130 2024-01-30T08:10:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637400ee50 con 0x7f637c152130 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c1ea240 con 0x7f637c152130 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374003b90 con 0x7f637c152130 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.459+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c150930 con 0x7f637c152130 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f637c0a9cc0 con 0x7f637c152130 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6374003cf0 con 0x7f637c152130 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6372000640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6354066500 0x7f63540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f63740830d0 con 0x7f637c152130 2024-01-30T08:10:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6372000640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f635406c8a0 0x7f635406ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 --> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f635406f3b0 con 0x7f635406c8a0 2024-01-30T08:10:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6374085790 con 0x7f637c152130 2024-01-30T08:10:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6379e00640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6354066500 0x7f63540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6379400640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f635406c8a0 0x7f635406ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6379e00640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6354066500 0x7f63540689c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f636c001ec0 tx=0x7f636c007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.463+0000 7f6379400640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f635406c8a0 0x7f635406ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.467+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== osd.1 v2:172.21.15.50:6800/1684920044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f635406f3b0 con 0x7f635406c8a0 2024-01-30T08:10:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 --> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f637c152b30 con 0x7f635406c8a0 2024-01-30T08:10:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6372000640 1 -- 172.21.15.50:0/1722550641 <== osd.1 v2:172.21.15.50:6800/1684920044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f637c152b30 con 0x7f635406c8a0 2024-01-30T08:10:51.485 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:51.485 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:51.485 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f635406c8a0 msgr2=0x7f635406ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:6800/1684920044,v1:172.21.15.50:6801/1684920044] conn(0x7f635406c8a0 0x7f635406ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6354066500 msgr2=0x7f63540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6354066500 0x7f63540689c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f636c001ec0 tx=0x7f636c007040 comp rx=0 tx=0).stop 2024-01-30T08:10:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c152130 msgr2=0x7f637c1503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 --2- 172.21.15.50:0/1722550641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c152130 0x7f637c1503f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f637c0c0950 tx=0x7f637400ec00 comp rx=0 tx=0).stop 2024-01-30T08:10:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f637a800640 1 -- 172.21.15.50:0/1722550641 reap_dead start 2024-01-30T08:10:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 shutdown_connections 2024-01-30T08:10:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 >> 172.21.15.50:0/1722550641 conn(0x7f637c0c5bb0 msgr2=0x7f637c0c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.479+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 shutdown_connections 2024-01-30T08:10:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.483+0000 7f6381000640 1 -- 172.21.15.50:0/1722550641 wait complete. 2024-01-30T08:10:51.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-30T08:10:51.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de7c00640 1 Processor -- start 2024-01-30T08:10:51.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de7c00640 1 -- start start 2024-01-30T08:10:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de7c00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6de00bca00 0x7f6de00c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de7c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de7c00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de00a80a0 con 0x7f6de00c4810 2024-01-30T08:10:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de7c00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de00c1bd0 con 0x7f6de00bca00 2024-01-30T08:10:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de7c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c3ff0 con 0x7f6de00bb980 2024-01-30T08:10:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddfe00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6de00bca00 0x7f6de00c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de5c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddfe00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6de00bca00 0x7f6de00c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:49152/0 (socket says 172.21.15.50:49152) 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de5c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de0154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:33292/0 (socket says 172.21.15.50:33292) 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6de5200640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6de00c4810 0x7f6de00c0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:56664/0 (socket says 172.21.15.50:56664) 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddfe00640 1 -- 172.21.15.50:0/1958049208 learned_addr learned my addr 172.21.15.50:0/1958049208 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddfe00640 1 -- 172.21.15.50:0/1958049208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 msgr2=0x7f6de0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddfe00640 1 --2- 172.21.15.50:0/1958049208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddfe00640 1 -- 172.21.15.50:0/1958049208 >> v1:172.21.15.125:6789/0 conn(0x7f6de00c4810 legacy=0x7f6de00c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddfe00640 1 -- 172.21.15.50:0/1958049208 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de00a7770 con 0x7f6de00bca00 2024-01-30T08:10:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.643+0000 7f6ddf400640 1 -- 172.21.15.50:0/1958049208 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777868452 0 0) 0x7f6de00a80a0 con 0x7f6de00c4810 2024-01-30T08:10:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6ddfe00640 1 --2- 172.21.15.50:0/1958049208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00bca00 0x7f6de00c0d50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009870 tx=0x7f6dc801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fc5f9873def56d server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6ddf400640 1 -- 172.21.15.50:0/1958049208 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80ab600 con 0x7f6de00bca00 2024-01-30T08:10:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6ddf400640 1 -- 172.21.15.50:0/1958049208 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80a7050 con 0x7f6de00bca00 2024-01-30T08:10:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6ddf400640 1 -- 172.21.15.50:0/1958049208 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80ab980 con 0x7f6de00bca00 2024-01-30T08:10:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 -- 172.21.15.50:0/1958049208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00bca00 msgr2=0x7f6de00c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 --2- 172.21.15.50:0/1958049208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00bca00 0x7f6de00c0d50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009870 tx=0x7f6dc801c480 comp rx=0 tx=0).stop 2024-01-30T08:10:51.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 -- 172.21.15.50:0/1958049208 shutdown_connections 2024-01-30T08:10:51.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 --2- 172.21.15.50:0/1958049208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 --2- 172.21.15.50:0/1958049208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00bca00 0x7f6de00c0d50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 -- 172.21.15.50:0/1958049208 >> 172.21.15.50:0/1958049208 conn(0x7f6de00c5f10 msgr2=0x7f6de00c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:51.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 -- 172.21.15.50:0/1958049208 shutdown_connections 2024-01-30T08:10:51.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.647+0000 7f6de7c00640 1 -- 172.21.15.50:0/1958049208 wait complete. 2024-01-30T08:10:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 Processor -- start 2024-01-30T08:10:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 -- start start 2024-01-30T08:10:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de00bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de00bca00 0x7f6de00bf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00c4810 0x7f6de0071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00bd7c0 con 0x7f6de00bca00 2024-01-30T08:10:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00bdaa0 con 0x7f6de00c4810 2024-01-30T08:10:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00704b0 con 0x7f6de00bb980 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de00bca00 0x7f6de00bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de00bca00 0x7f6de00bf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42346/0 (socket says 172.21.15.50:42346) 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 -- 172.21.15.50:0/408292926 learned_addr learned my addr 172.21.15.50:0/408292926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de5200640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de00bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de5c00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00c4810 0x7f6de0071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 -- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 msgr2=0x7f6de00bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de00bf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 -- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00c4810 msgr2=0x7f6de0071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00c4810 0x7f6de0071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 -- 172.21.15.50:0/408292926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80094d0 con 0x7f6de00bca00 2024-01-30T08:10:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddfe00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de00bca00 0x7f6de00bf930 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80ae040 tx=0x7f6dc8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddcc00640 1 -- 172.21.15.50:0/408292926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80b4440 con 0x7f6de00bca00 2024-01-30T08:10:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddcc00640 1 -- 172.21.15.50:0/408292926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80b45a0 con 0x7f6de00bca00 2024-01-30T08:10:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6ddcc00640 1 -- 172.21.15.50:0/408292926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80b4950 con 0x7f6de00bca00 2024-01-30T08:10:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de0070790 con 0x7f6de00bca00 2024-01-30T08:10:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.651+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de0158eb0 con 0x7f6de00bca00 2024-01-30T08:10:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.655+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de00717f0 con 0x7f6de00bca00 2024-01-30T08:10:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.655+0000 7f6ddcc00640 1 -- 172.21.15.50:0/408292926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6dc80b2070 con 0x7f6de00bca00 2024-01-30T08:10:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.655+0000 7f6ddcc00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6db8066500 0x7f6db80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.655+0000 7f6ddcc00640 1 -- 172.21.15.50:0/408292926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6dc811dab0 con 0x7f6de00bca00 2024-01-30T08:10:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.655+0000 7f6de5200640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6db8066500 0x7f6db80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.655+0000 7f6de5200640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6db8066500 0x7f6db80689c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000f70 tx=0x7f6dd0007df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.659+0000 7f6ddcc00640 1 -- 172.21.15.50:0/408292926 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6de00717f0 con 0x7f6de00bca00 2024-01-30T08:10:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.819+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6de00c4bf0 con 0x7f6db8066500 2024-01-30T08:10:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6ddcc00640 1 -- 172.21.15.50:0/408292926 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6dd0004c80 con 0x7f6db8066500 2024-01-30T08:10:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2024-01-30T08:10:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6db8066500 msgr2=0x7f6db80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6db8066500 0x7f6db80689c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000f70 tx=0x7f6dd0007df0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de00bca00 msgr2=0x7f6de00bf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de00bca00 0x7f6de00bf930 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80ae040 tx=0x7f6dc8019220 comp rx=0 tx=0).stop 2024-01-30T08:10:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 shutdown_connections 2024-01-30T08:10:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de00c4810 0x7f6de0071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6db8066500 0x7f6db80689c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de00bca00 0x7f6de00bf930 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 --2- 172.21.15.50:0/408292926 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de00bb980 0x7f6de00bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:51.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 >> 172.21.15.50:0/408292926 conn(0x7f6de00c5f10 msgr2=0x7f6de00bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:51.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 shutdown_connections 2024-01-30T08:10:51.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.823+0000 7f6de7c00640 1 -- 172.21.15.50:0/408292926 wait complete. 2024-01-30T08:10:51.847 INFO:tasks.ceph:Scrubbing osd.2 2024-01-30T08:10:51.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbca00640 1 Processor -- start 2024-01-30T08:10:51.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbca00640 1 -- start start 2024-01-30T08:10:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbca00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddb406d930 0x7fddb40c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbca00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb406d370 con 0x7fddb40c0530 2024-01-30T08:10:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbca00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb40c26f0 con 0x7fddb40a4f00 2024-01-30T08:10:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbca00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb4156260 con 0x7fddb406d930 2024-01-30T08:10:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddb9600640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddb40c0530 0x7fddb414fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51432/0 (socket says 172.21.15.50:51432) 2024-01-30T08:10:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddb9600640 1 -- 172.21.15.50:0/355987879 learned_addr learned my addr 172.21.15.50:0/355987879 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbaa00640 1 --2- 172.21.15.50:0/355987879 >> v2:172.21.15.50:3300/0 conn(0x7fddb406d930 0x7fddb40c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbaa00640 1 -- 172.21.15.50:0/355987879 >> v1:172.21.15.125:6789/0 conn(0x7fddb40a4f00 legacy=0x7fddb4155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbaa00640 1 -- 172.21.15.50:0/355987879 >> v1:172.21.15.50:6789/0 conn(0x7fddb40c0530 legacy=0x7fddb414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.991+0000 7fddbaa00640 1 -- 172.21.15.50:0/355987879 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb406dd30 con 0x7fddb406d930 2024-01-30T08:10:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbaa00640 1 --2- 172.21.15.50:0/355987879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb40c2b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fddac009d90 tx=0x7fddac01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105a94a694407e0e server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddb8c00640 1 -- 172.21.15.50:0/355987879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0a5980 con 0x7fddb406d930 2024-01-30T08:10:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddb8c00640 1 -- 172.21.15.50:0/355987879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac0a5ae0 con 0x7fddb406d930 2024-01-30T08:10:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddb8c00640 1 -- 172.21.15.50:0/355987879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0a5e70 con 0x7fddb406d930 2024-01-30T08:10:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbca00640 1 -- 172.21.15.50:0/355987879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 msgr2=0x7fddb40c2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbca00640 1 --2- 172.21.15.50:0/355987879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb40c2b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fddac009d90 tx=0x7fddac01c8c0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbca00640 1 -- 172.21.15.50:0/355987879 shutdown_connections 2024-01-30T08:10:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbca00640 1 --2- 172.21.15.50:0/355987879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb40c2b80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbca00640 1 -- 172.21.15.50:0/355987879 >> 172.21.15.50:0/355987879 conn(0x7fddb40c5bb0 msgr2=0x7fddb40c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbca00640 1 -- 172.21.15.50:0/355987879 shutdown_connections 2024-01-30T08:10:52.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.995+0000 7fddbca00640 1 -- 172.21.15.50:0/355987879 wait complete. 2024-01-30T08:10:52.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 Processor -- start 2024-01-30T08:10:52.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 -- start start 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb41ec820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb40a4f00 0x7fddb414f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddb40c0530 0x7fddb41f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb414cc90 con 0x7fddb406d930 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb414cf70 con 0x7fddb40a4f00 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb41efe30 con 0x7fddb40c0530 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb41ec820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb41ec820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42374/0 (socket says 172.21.15.50:42374) 2024-01-30T08:10:52.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 -- 172.21.15.50:0/3120869880 learned_addr learned my addr 172.21.15.50:0/3120869880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:52.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddb9600640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb40a4f00 0x7fddb414f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbaa00640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddb40c0530 0x7fddb41f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 -- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddb40c0530 msgr2=0x7fddb41f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddb40c0530 0x7fddb41f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 -- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb40a4f00 msgr2=0x7fddb414f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb40a4f00 0x7fddb414f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 -- 172.21.15.50:0/3120869880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac009a70 con 0x7fddb406d930 2024-01-30T08:10:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddba000640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb41ec820 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fdda400c420 tx=0x7fdda400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40052d0 con 0x7fddb406d930 2024-01-30T08:10:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda4005430 con 0x7fddb406d930 2024-01-30T08:10:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb41f0110 con 0x7fddb406d930 2024-01-30T08:10:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4007260 con 0x7fddb406d930 2024-01-30T08:10:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:51.999+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb40c4150 con 0x7fddb406d930 2024-01-30T08:10:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fddb40c2380 con 0x7fddb406d930 2024-01-30T08:10:52.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdda40073c0 con 0x7fddb406d930 2024-01-30T08:10:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb2000640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd8c066500 0x7fdd8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdda4083140 con 0x7fddb406d930 2024-01-30T08:10:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb2000640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7fdd8c06c8a0 0x7fdd8c06ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 --> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd8c06f3b0 con 0x7fdd8c06c8a0 2024-01-30T08:10:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdda4085800 con 0x7fddb406d930 2024-01-30T08:10:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb9600640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd8c066500 0x7fdd8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddbaa00640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7fdd8c06c8a0 0x7fdd8c06ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddbaa00640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7fdd8c06c8a0 0x7fdd8c06ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.003+0000 7fddb9600640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd8c066500 0x7fdd8c0689c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddb40c5960 tx=0x7fdd9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.007+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== osd.2 v2:172.21.15.50:6816/2310842832 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdd8c06f3b0 con 0x7fdd8c06c8a0 2024-01-30T08:10:52.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 --> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fddb41560f0 con 0x7fdd8c06c8a0 2024-01-30T08:10:52.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddb2000640 1 -- 172.21.15.50:0/3120869880 <== osd.2 v2:172.21.15.50:6816/2310842832 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fddb41560f0 con 0x7fdd8c06c8a0 2024-01-30T08:10:52.024 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:52.024 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:52.024 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7fdd8c06c8a0 msgr2=0x7fdd8c06ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:6816/2310842832,v1:172.21.15.50:6817/2310842832] conn(0x7fdd8c06c8a0 0x7fdd8c06ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd8c066500 msgr2=0x7fdd8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fdd8c066500 0x7fdd8c0689c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddb40c5960 tx=0x7fdd9c009040 comp rx=0 tx=0).stop 2024-01-30T08:10:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 msgr2=0x7fddb41ec820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 --2- 172.21.15.50:0/3120869880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb406d930 0x7fddb41ec820 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fdda400c420 tx=0x7fdda400c8e0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbaa00640 1 -- 172.21.15.50:0/3120869880 reap_dead start 2024-01-30T08:10:52.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 shutdown_connections 2024-01-30T08:10:52.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 >> 172.21.15.50:0/3120869880 conn(0x7fddb40c5bb0 msgr2=0x7fddb40c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 shutdown_connections 2024-01-30T08:10:52.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.019+0000 7fddbca00640 1 -- 172.21.15.50:0/3120869880 wait complete. 2024-01-30T08:10:52.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-30T08:10:52.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.179+0000 7f57e7e00640 1 Processor -- start 2024-01-30T08:10:52.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.179+0000 7f57e7e00640 1 -- start start 2024-01-30T08:10:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 0x7f57e00c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e7e00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00c0980 con 0x7f57e006dc50 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e7e00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e01564e0 con 0x7f57e014fbb0 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e7e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0156780 con 0x7f57e00a4dc0 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57e006dc50 0x7f57e0152660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51436/0 (socket says 172.21.15.50:51436) 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 -- 172.21.15.50:0/2137828050 learned_addr learned my addr 172.21.15.50:0/2137828050 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e4a00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 0x7f57e00c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908595024 0 0) 0x7f57e00c0980 con 0x7f57e006dc50 2024-01-30T08:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c0003530 con 0x7f57e006dc50 2024-01-30T08:10:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 617345592 0 0) 0x7f57c0003530 con 0x7f57e006dc50 2024-01-30T08:10:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 msgr2=0x7f57e00c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 0x7f57e00c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 >> v1:172.21.15.125:6789/0 conn(0x7f57e014fbb0 legacy=0x7f57e006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00c0610 con 0x7f57e006dc50 2024-01-30T08:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f57d8001a00 con 0x7f57e006dc50 2024-01-30T08:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 >> v1:172.21.15.50:6789/0 conn(0x7f57e006dc50 legacy=0x7f57e0152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c00039b0 0x7f57c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 0x7f57c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c0004d10 0x7f57c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0156780 con 0x7f57c0004d10 2024-01-30T08:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c000ba40 con 0x7f57c00039b0 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c000bbb0 con 0x7f57e00a4dc0 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c0004d10 0x7f57c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5400640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c00039b0 0x7f57c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e4a00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 0x7f57c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 -- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 msgr2=0x7f57c00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e00a4dc0 0x7f57c00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 -- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c00039b0 msgr2=0x7f57c0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c00039b0 0x7f57c0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.183+0000 7f57e5e00640 1 -- 172.21.15.50:0/2137828050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c0003530 con 0x7f57c0004d10 2024-01-30T08:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e5e00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c0004d10 0x7f57c0005190 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f57d800a810 tx=0x7f57d801fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccf72a63ba41fe6 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80ac680 con 0x7f57c0004d10 2024-01-30T08:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80ac7e0 con 0x7f57c0004d10 2024-01-30T08:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57dfe00640 1 -- 172.21.15.50:0/2137828050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80acb90 con 0x7f57c0004d10 2024-01-30T08:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e7e00640 1 -- 172.21.15.50:0/2137828050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c0004d10 msgr2=0x7f57c0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e7e00640 1 --2- 172.21.15.50:0/2137828050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57c0004d10 0x7f57c0005190 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f57d800a810 tx=0x7f57d801fa60 comp rx=0 tx=0).stop 2024-01-30T08:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e5e00640 1 -- 172.21.15.50:0/2137828050 reap_dead start 2024-01-30T08:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e7e00640 1 -- 172.21.15.50:0/2137828050 shutdown_connections 2024-01-30T08:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e7e00640 1 -- 172.21.15.50:0/2137828050 >> 172.21.15.50:0/2137828050 conn(0x7f57e00c5f10 msgr2=0x7f57e00c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e7e00640 1 -- 172.21.15.50:0/2137828050 shutdown_connections 2024-01-30T08:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.187+0000 7f57e7e00640 1 -- 172.21.15.50:0/2137828050 wait complete. 2024-01-30T08:10:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 Processor -- start 2024-01-30T08:10:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 -- start start 2024-01-30T08:10:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0004d10 0x7f57e0155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e0150d00 0x7f57e0151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e0148200 0x7f57e0148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0148bc0 con 0x7f57e0150d00 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01ea8d0 con 0x7f57c0004d10 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01e9cc0 con 0x7f57e0148200 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e0150d00 0x7f57e0151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e0150d00 0x7f57e0151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42394/0 (socket says 172.21.15.50:42394) 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 -- 172.21.15.50:0/2638381987 learned_addr learned my addr 172.21.15.50:0/2638381987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e5400640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0004d10 0x7f57e0155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e5e00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e0148200 0x7f57e0148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 -- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e0148200 msgr2=0x7f57e0148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e0148200 0x7f57e0148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 -- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0004d10 msgr2=0x7f57e0155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0004d10 0x7f57e0155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 -- 172.21.15.50:0/2638381987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e01e9fa0 con 0x7f57e0150d00 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e4a00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e0150d00 0x7f57e0151180 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f57c8011590 tx=0x7f57c8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57dd600640 1 -- 172.21.15.50:0/2638381987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8004220 con 0x7f57e0150d00 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57dd600640 1 -- 172.21.15.50:0/2638381987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8004380 con 0x7f57e0150d00 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e01ea280 con 0x7f57e0150d00 2024-01-30T08:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57dd600640 1 -- 172.21.15.50:0/2638381987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8015870 con 0x7f57e0150d00 2024-01-30T08:10:52.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e01558c0 con 0x7f57e0150d00 2024-01-30T08:10:52.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.191+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e004ead0 con 0x7f57e0150d00 2024-01-30T08:10:52.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.195+0000 7f57dd600640 1 -- 172.21.15.50:0/2638381987 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f57c80159d0 con 0x7f57e0150d00 2024-01-30T08:10:52.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.195+0000 7f57dd600640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f57b8066500 0x7f57b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.195+0000 7f57dd600640 1 -- 172.21.15.50:0/2638381987 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f57c8083f00 con 0x7f57e0150d00 2024-01-30T08:10:52.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.195+0000 7f57e5400640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f57b8066500 0x7f57b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.195+0000 7f57e5400640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f57b8066500 0x7f57b80689c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f57d0000c10 tx=0x7f57d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.199+0000 7f57dd600640 1 -- 172.21.15.50:0/2638381987 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f57c8051320 con 0x7f57e0150d00 2024-01-30T08:10:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.355+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f57e006abe0 con 0x7f57b8066500 2024-01-30T08:10:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57dd600640 1 -- 172.21.15.50:0/2638381987 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f57e006abe0 con 0x7f57b8066500 2024-01-30T08:10:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2024-01-30T08:10:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f57b8066500 msgr2=0x7f57b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f57b8066500 0x7f57b80689c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f57d0000c10 tx=0x7f57d0009040 comp rx=0 tx=0).stop 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e0150d00 msgr2=0x7f57e0151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e0150d00 0x7f57e0151180 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f57c8011590 tx=0x7f57c8011a50 comp rx=0 tx=0).stop 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 shutdown_connections 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f57b8066500 0x7f57b80689c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57e0148200 0x7f57e0148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e0150d00 0x7f57e0151180 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 --2- 172.21.15.50:0/2638381987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0004d10 0x7f57e0155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 >> 172.21.15.50:0/2638381987 conn(0x7f57e00c5f10 msgr2=0x7f57e00c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 shutdown_connections 2024-01-30T08:10:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.359+0000 7f57e7e00640 1 -- 172.21.15.50:0/2638381987 wait complete. 2024-01-30T08:10:52.383 INFO:tasks.ceph:Scrubbing osd.3 2024-01-30T08:10:52.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:52.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 Processor -- start 2024-01-30T08:10:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 -- start start 2024-01-30T08:10:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e40c4960 0x7fc3e40c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc3e406ca80 0x7fc3e40c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3e40c6410 0x7fc3e41551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40c3a20 con 0x7fc3e40c6410 2024-01-30T08:10:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40c3670 con 0x7fc3e406ca80 2024-01-30T08:10:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e9400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e406c5f0 con 0x7fc3e40c4960 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.523+0000 7fc3e3200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3e40c6410 0x7fc3e41551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3e40c6410 0x7fc3e41551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42410/0 (socket says 172.21.15.50:42410) 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 -- 172.21.15.50:0/2836082317 learned_addr learned my addr 172.21.15.50:0/2836082317 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e1e00640 1 --2- 172.21.15.50:0/2836082317 >> v2:172.21.15.125:3300/0 conn(0x7fc3e406ca80 0x7fc3e40c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e2800640 1 --2- 172.21.15.50:0/2836082317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e40c4960 0x7fc3e40c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 -- 172.21.15.50:0/2836082317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e40c4960 msgr2=0x7fc3e40c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 --2- 172.21.15.50:0/2836082317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e40c4960 0x7fc3e40c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 -- 172.21.15.50:0/2836082317 >> v2:172.21.15.125:3300/0 conn(0x7fc3e406ca80 msgr2=0x7fc3e40c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 --2- 172.21.15.50:0/2836082317 >> v2:172.21.15.125:3300/0 conn(0x7fc3e406ca80 0x7fc3e40c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 -- 172.21.15.50:0/2836082317 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4158d80 con 0x7fc3e40c6410 2024-01-30T08:10:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e3200640 1 --2- 172.21.15.50:0/2836082317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c6410 0x7fc3e41551d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4070d10 tx=0x7fc3dc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e244c038964c833 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e1400640 1 -- 172.21.15.50:0/2836082317 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0a5820 con 0x7fc3e40c6410 2024-01-30T08:10:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e1400640 1 -- 172.21.15.50:0/2836082317 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc0a5980 con 0x7fc3e40c6410 2024-01-30T08:10:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.527+0000 7fc3e1400640 1 -- 172.21.15.50:0/2836082317 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0a5d10 con 0x7fc3e40c6410 2024-01-30T08:10:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- 172.21.15.50:0/2836082317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c6410 msgr2=0x7fc3e41551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 --2- 172.21.15.50:0/2836082317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c6410 0x7fc3e41551d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4070d10 tx=0x7fc3dc01c9a0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- 172.21.15.50:0/2836082317 shutdown_connections 2024-01-30T08:10:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 --2- 172.21.15.50:0/2836082317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c6410 0x7fc3e41551d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 --2- 172.21.15.50:0/2836082317 >> v2:172.21.15.125:3300/0 conn(0x7fc3e406ca80 0x7fc3e40c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 --2- 172.21.15.50:0/2836082317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e40c4960 0x7fc3e40c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- 172.21.15.50:0/2836082317 >> 172.21.15.50:0/2836082317 conn(0x7fc3e40a9a80 msgr2=0x7fc3e40a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- 172.21.15.50:0/2836082317 shutdown_connections 2024-01-30T08:10:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- 172.21.15.50:0/2836082317 wait complete. 2024-01-30T08:10:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 Processor -- start 2024-01-30T08:10:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- start start 2024-01-30T08:10:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e406ca80 0x7fc3e41f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c4960 0x7fc3e40acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3e40c6410 0x7fc3e40ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4154200 con 0x7fc3e40c4960 2024-01-30T08:10:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e415a010 con 0x7fc3e40c6410 2024-01-30T08:10:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e9400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4154470 con 0x7fc3e406ca80 2024-01-30T08:10:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c4960 0x7fc3e40acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c4960 0x7fc3e40acae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42426/0 (socket says 172.21.15.50:42426) 2024-01-30T08:10:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e1e00640 1 -- 172.21.15.50:0/804854174 learned_addr learned my addr 172.21.15.50:0/804854174 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e2800640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e406ca80 0x7fc3e41f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.531+0000 7fc3e3200640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3e40c6410 0x7fc3e40ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e1e00640 1 -- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e406ca80 msgr2=0x7fc3e41f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e1e00640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3e406ca80 0x7fc3e41f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e1e00640 1 -- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3e40c6410 msgr2=0x7fc3e40ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e1e00640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3e40c6410 0x7fc3e40ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e1e00640 1 -- 172.21.15.50:0/804854174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc009b30 con 0x7fc3e40c4960 2024-01-30T08:10:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e1e00640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c4960 0x7fc3e40acae0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e870 tx=0x7fc3cc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00ee60 con 0x7fc3e40c4960 2024-01-30T08:10:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00c940 con 0x7fc3e40c4960 2024-01-30T08:10:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00ccf0 con 0x7fc3e40c4960 2024-01-30T08:10:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e41f0ff0 con 0x7fc3e40c4960 2024-01-30T08:10:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e415a510 con 0x7fc3e40c4960 2024-01-30T08:10:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3e4159e90 con 0x7fc3e40c4960 2024-01-30T08:10:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc3cc013470 con 0x7fc3e40c4960 2024-01-30T08:10:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc3bc066500 0x7fc3bc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc3cc0840f0 con 0x7fc3e40c4960 2024-01-30T08:10:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7fc3bc06c8a0 0x7fc3bc06ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 --> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3bc06f3b0 con 0x7fc3bc06c8a0 2024-01-30T08:10:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.535+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3cc084460 con 0x7fc3e40c4960 2024-01-30T08:10:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.539+0000 7fc3e2800640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc3bc066500 0x7fc3bc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.539+0000 7fc3e3200640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7fc3bc06c8a0 0x7fc3bc06ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.539+0000 7fc3e2800640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc3bc066500 0x7fc3bc0689c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009ac0 tx=0x7fc3d4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.539+0000 7fc3e3200640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7fc3bc06c8a0 0x7fc3bc06ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.539+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== osd.3 v2:172.21.15.50:6824/116773969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc3bc06f3b0 con 0x7fc3bc06c8a0 2024-01-30T08:10:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 --> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3e406d100 con 0x7fc3bc06c8a0 2024-01-30T08:10:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3daa00640 1 -- 172.21.15.50:0/804854174 <== osd.3 v2:172.21.15.50:6824/116773969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc3dc009150 con 0x7fc3bc06c8a0 2024-01-30T08:10:52.557 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:52.557 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:52.557 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7fc3bc06c8a0 msgr2=0x7fc3bc06ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:6824/116773969,v1:172.21.15.50:6825/116773969] conn(0x7fc3bc06c8a0 0x7fc3bc06ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc3bc066500 msgr2=0x7fc3bc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc3bc066500 0x7fc3bc0689c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009ac0 tx=0x7fc3d4009190 comp rx=0 tx=0).stop 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c4960 msgr2=0x7fc3e40acae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 --2- 172.21.15.50:0/804854174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e40c4960 0x7fc3e40acae0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e870 tx=0x7fc3cc00ed30 comp rx=0 tx=0).stop 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e3200640 1 -- 172.21.15.50:0/804854174 reap_dead start 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 shutdown_connections 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.551+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 >> 172.21.15.50:0/804854174 conn(0x7fc3e40a9a80 msgr2=0x7fc3e4157e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.555+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 shutdown_connections 2024-01-30T08:10:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.555+0000 7fc3e9400640 1 -- 172.21.15.50:0/804854174 wait complete. 2024-01-30T08:10:52.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-30T08:10:52.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.711+0000 7ffb7e800640 1 Processor -- start 2024-01-30T08:10:52.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb7e800640 1 -- start start 2024-01-30T08:10:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb7e800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb7814fbb0 0x7ffb780c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb7e800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb780a4dc0 0x7ffb7806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb7e800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb780c0980 con 0x7ffb7806dc50 2024-01-30T08:10:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb7e800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb781564e0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb7e800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78156780 con 0x7ffb780a4dc0 2024-01-30T08:10:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb7814fbb0 0x7ffb780c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffb7814fbb0 0x7ffb780c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:49206/0 (socket says 172.21.15.50:49206) 2024-01-30T08:10:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77400640 1 -- 172.21.15.50:0/3190228560 learned_addr learned my addr 172.21.15.50:0/3190228560 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77e00640 1 --1- 172.21.15.50:0/3190228560 >> v1:172.21.15.125:6789/0 conn(0x7ffb7806dc50 0x7ffb78152660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.50:56686/0 (socket says 172.21.15.50:56686) 2024-01-30T08:10:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb76a00640 1 --2- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb780a4dc0 0x7ffb7806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77400640 1 -- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb780a4dc0 msgr2=0x7ffb7806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77400640 1 --2- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb780a4dc0 0x7ffb7806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77400640 1 -- 172.21.15.50:0/3190228560 >> v1:172.21.15.125:6789/0 conn(0x7ffb7806dc50 legacy=0x7ffb78152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb77400640 1 -- 172.21.15.50:0/3190228560 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780c0610 con 0x7ffb7814fbb0 2024-01-30T08:10:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.715+0000 7ffb76a00640 1 --2- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb780a4dc0 0x7ffb7806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb77400640 1 --2- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7814fbb0 0x7ffb780c1fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009870 tx=0x7ffb6801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7291640b843a8b96 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb76000640 1 -- 172.21.15.50:0/3190228560 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680ab650 con 0x7ffb7814fbb0 2024-01-30T08:10:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb76000640 1 -- 172.21.15.50:0/3190228560 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb680ab7b0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb76000640 1 -- 172.21.15.50:0/3190228560 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680abb40 con 0x7ffb7814fbb0 2024-01-30T08:10:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 -- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7814fbb0 msgr2=0x7ffb780c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 --2- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7814fbb0 0x7ffb780c1fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009870 tx=0x7ffb6801c540 comp rx=0 tx=0).stop 2024-01-30T08:10:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 -- 172.21.15.50:0/3190228560 shutdown_connections 2024-01-30T08:10:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 --2- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb780a4dc0 0x7ffb7806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 --2- 172.21.15.50:0/3190228560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7814fbb0 0x7ffb780c1fd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 -- 172.21.15.50:0/3190228560 >> 172.21.15.50:0/3190228560 conn(0x7ffb780c5f10 msgr2=0x7ffb780c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 -- 172.21.15.50:0/3190228560 shutdown_connections 2024-01-30T08:10:52.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 -- 172.21.15.50:0/3190228560 wait complete. 2024-01-30T08:10:52.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.719+0000 7ffb7e800640 1 Processor -- start 2024-01-30T08:10:52.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 -- start start 2024-01-30T08:10:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb7806dc50 0x7ffb78153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb780a4dc0 0x7ffb78072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb7814fbb0 0x7ffb78072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781504c0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78151040 con 0x7ffb780a4dc0 2024-01-30T08:10:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78150710 con 0x7ffb7806dc50 2024-01-30T08:10:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb7814fbb0 0x7ffb78072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb7814fbb0 0x7ffb78072640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42428/0 (socket says 172.21.15.50:42428) 2024-01-30T08:10:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 -- 172.21.15.50:0/1332550249 learned_addr learned my addr 172.21.15.50:0/1332550249 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb76a00640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb780a4dc0 0x7ffb78072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77400640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb7806dc50 0x7ffb78153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 -- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb7806dc50 msgr2=0x7ffb78153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb7806dc50 0x7ffb78153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 -- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb780a4dc0 msgr2=0x7ffb78072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb780a4dc0 0x7ffb78072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 -- 172.21.15.50:0/1332550249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60009420 con 0x7ffb7814fbb0 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb77e00640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb7814fbb0 0x7ffb78072640 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c7d0 tx=0x7ffb7000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb6f400640 1 -- 172.21.15.50:0/1332550249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000a640 con 0x7ffb7814fbb0 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb6f400640 1 -- 172.21.15.50:0/1332550249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000a7a0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb6f400640 1 -- 172.21.15.50:0/1332550249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000ab10 con 0x7ffb7814fbb0 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb680094d0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb78150cd0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.723+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7804ead0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.727+0000 7ffb6f400640 1 -- 172.21.15.50:0/1332550249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ffb7000ac70 con 0x7ffb7814fbb0 2024-01-30T08:10:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.727+0000 7ffb6f400640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffb50066500 0x7ffb500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.727+0000 7ffb6f400640 1 -- 172.21.15.50:0/1332550249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ffb700834e0 con 0x7ffb7814fbb0 2024-01-30T08:10:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.727+0000 7ffb77400640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffb50066500 0x7ffb500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.727+0000 7ffb77400640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffb50066500 0x7ffb500689c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffb680af000 tx=0x7ffb680b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.731+0000 7ffb6f400640 1 -- 172.21.15.50:0/1332550249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ffb70050980 con 0x7ffb7814fbb0 2024-01-30T08:10:52.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb78151180 con 0x7ffb50066500 2024-01-30T08:10:52.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb6f400640 1 -- 172.21.15.50:0/1332550249 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb78151180 con 0x7ffb50066500 2024-01-30T08:10:52.894 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2024-01-30T08:10:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffb50066500 msgr2=0x7ffb500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffb50066500 0x7ffb500689c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffb680af000 tx=0x7ffb680b6040 comp rx=0 tx=0).stop 2024-01-30T08:10:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb7814fbb0 msgr2=0x7ffb78072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb7814fbb0 0x7ffb78072640 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c7d0 tx=0x7ffb7000cc90 comp rx=0 tx=0).stop 2024-01-30T08:10:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 shutdown_connections 2024-01-30T08:10:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb780a4dc0 0x7ffb78072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7ffb50066500 0x7ffb500689c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb7814fbb0 0x7ffb78072640 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 --2- 172.21.15.50:0/1332550249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb7806dc50 0x7ffb78153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 >> 172.21.15.50:0/1332550249 conn(0x7ffb780c5f10 msgr2=0x7ffb7814d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 shutdown_connections 2024-01-30T08:10:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:52.891+0000 7ffb7e800640 1 -- 172.21.15.50:0/1332550249 wait complete. 2024-01-30T08:10:52.918 INFO:tasks.ceph:Scrubbing osd.4 2024-01-30T08:10:52.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febb1800640 1 Processor -- start 2024-01-30T08:10:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febb1800640 1 -- start start 2024-01-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febb1800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febac0c4960 0x7febac0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febb1800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7febac06ca80 0x7febac0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febb1800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0c3670 con 0x7febac0c6410 2024-01-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febb1800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0c3a20 con 0x7febac0c4960 2024-01-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febb1800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac06c5f0 con 0x7febac06ca80 2024-01-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaaa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febac0c4960 0x7febac0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaaa00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febac0c4960 0x7febac0c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42430/0 (socket says 172.21.15.50:42430) 2024-01-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaaa00640 1 -- 172.21.15.50:0/3416663497 learned_addr learned my addr 172.21.15.50:0/3416663497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaa000640 1 --2- 172.21.15.50:0/3416663497 >> v2:172.21.15.125:3300/0 conn(0x7febac06ca80 0x7febac0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaaa00640 1 -- 172.21.15.50:0/3416663497 >> v2:172.21.15.125:3300/0 conn(0x7febac06ca80 msgr2=0x7febac0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaaa00640 1 --2- 172.21.15.50:0/3416663497 >> v2:172.21.15.125:3300/0 conn(0x7febac06ca80 0x7febac0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaaa00640 1 -- 172.21.15.50:0/3416663497 >> v1:172.21.15.125:6789/0 conn(0x7febac0c6410 legacy=0x7febac1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaaa00640 1 -- 172.21.15.50:0/3416663497 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac158d80 con 0x7febac0c4960 2024-01-30T08:10:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.059+0000 7febaa000640 1 --2- 172.21.15.50:0/3416663497 >> v2:172.21.15.125:3300/0 conn(0x7febac06ca80 0x7febac0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febaaa00640 1 --2- 172.21.15.50:0/3416663497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac0c4960 0x7febac0c3130 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7febac0c28f0 tx=0x7feb9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9b900eb5b0c650 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7feba9600640 1 -- 172.21.15.50:0/3416663497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0aa430 con 0x7febac0c4960 2024-01-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7feba9600640 1 -- 172.21.15.50:0/3416663497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0aa590 con 0x7febac0c4960 2024-01-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7feba9600640 1 -- 172.21.15.50:0/3416663497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0aa920 con 0x7febac0c4960 2024-01-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 -- 172.21.15.50:0/3416663497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac0c4960 msgr2=0x7febac0c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 --2- 172.21.15.50:0/3416663497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac0c4960 0x7febac0c3130 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7febac0c28f0 tx=0x7feb9c01c4d0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 -- 172.21.15.50:0/3416663497 shutdown_connections 2024-01-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 --2- 172.21.15.50:0/3416663497 >> v2:172.21.15.125:3300/0 conn(0x7febac06ca80 0x7febac0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 --2- 172.21.15.50:0/3416663497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac0c4960 0x7febac0c3130 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 -- 172.21.15.50:0/3416663497 >> 172.21.15.50:0/3416663497 conn(0x7febac0a9a80 msgr2=0x7febac0a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 -- 172.21.15.50:0/3416663497 shutdown_connections 2024-01-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.063+0000 7febb1800640 1 -- 172.21.15.50:0/3416663497 wait complete. 2024-01-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 Processor -- start 2024-01-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 -- start start 2024-01-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac06ca80 0x7febac15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febac0c4960 0x7febac14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febac0c6410 0x7febac06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac151590 con 0x7febac06ca80 2024-01-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac1ec9c0 con 0x7febac0c6410 2024-01-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac156800 con 0x7febac0c4960 2024-01-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac06ca80 0x7febac15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac06ca80 0x7febac15eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42442/0 (socket says 172.21.15.50:42442) 2024-01-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 -- 172.21.15.50:0/2572030880 learned_addr learned my addr 172.21.15.50:0/2572030880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaa000640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febac0c4960 0x7febac14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febab400640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febac0c6410 0x7febac06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 -- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febac0c4960 msgr2=0x7febac14b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7febac0c4960 0x7febac14b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 -- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febac0c6410 msgr2=0x7febac06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febac0c6410 0x7febac06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 -- 172.21.15.50:0/2572030880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0094d0 con 0x7febac06ca80 2024-01-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febab400640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febac0c6410 0x7febac06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febaaa00640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac06ca80 0x7febac15eb50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0190e0 tx=0x7feb9c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0b3800 con 0x7febac06ca80 2024-01-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0b3960 con 0x7febac06ca80 2024-01-30T08:10:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0b3cf0 con 0x7febac06ca80 2024-01-30T08:10:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.067+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac155a60 con 0x7febac06ca80 2024-01-30T08:10:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac1508c0 con 0x7febac06ca80 2024-01-30T08:10:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febac1558e0 con 0x7febac06ca80 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7feb9c0c6440 con 0x7febac06ca80 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7feba2a00640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feb84066500 0x7feb840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7feb9c11e780 con 0x7febac06ca80 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7feba2a00640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7feb8406c8a0 0x7feb8406ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 --> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb8406f3b0 con 0x7feb8406c8a0 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb9c120d60 con 0x7febac06ca80 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7febaa000640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feb84066500 0x7feb840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7febab400640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7feb8406c8a0 0x7feb8406ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.071+0000 7febaa000640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feb84066500 0x7feb840689c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febac06f790 tx=0x7feb94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.075+0000 7febab400640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7feb8406c8a0 0x7feb8406ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.075+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== osd.4 v2:172.21.15.125:6824/2753947898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7feb8406f3b0 con 0x7feb8406c8a0 2024-01-30T08:10:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 --> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7febac1589a0 con 0x7feb8406c8a0 2024-01-30T08:10:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7feba2a00640 1 -- 172.21.15.50:0/2572030880 <== osd.4 v2:172.21.15.125:6824/2753947898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feba4001f40 con 0x7feb8406c8a0 2024-01-30T08:10:53.093 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:53.093 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:53.093 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7feb8406c8a0 msgr2=0x7feb8406ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6824/2753947898,v1:172.21.15.125:6825/2753947898] conn(0x7feb8406c8a0 0x7feb8406ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feb84066500 msgr2=0x7feb840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7feb84066500 0x7feb840689c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febac06f790 tx=0x7feb94008040 comp rx=0 tx=0).stop 2024-01-30T08:10:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac06ca80 msgr2=0x7febac15eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 --2- 172.21.15.50:0/2572030880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febac06ca80 0x7febac15eb50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0190e0 tx=0x7feb9c01ad10 comp rx=0 tx=0).stop 2024-01-30T08:10:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febab400640 1 -- 172.21.15.50:0/2572030880 reap_dead start 2024-01-30T08:10:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 shutdown_connections 2024-01-30T08:10:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.087+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 >> 172.21.15.50:0/2572030880 conn(0x7febac0a9a80 msgr2=0x7febac154fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.091+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 shutdown_connections 2024-01-30T08:10:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.091+0000 7febb1800640 1 -- 172.21.15.50:0/2572030880 wait complete. 2024-01-30T08:10:53.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-30T08:10:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5554600640 1 Processor -- start 2024-01-30T08:10:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5554600640 1 -- start start 2024-01-30T08:10:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5554600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5554600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f554c0adb30 0x7f554c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5554600640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0c4500 con 0x7f554c1523b0 2024-01-30T08:10:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5554600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0a78f0 con 0x7f554c0adb30 2024-01-30T08:10:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5554600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c7200 con 0x7f554c0c47b0 2024-01-30T08:10:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5551c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5551200640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f554c0adb30 0x7f554c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5551c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.50:33364/0 (socket says 172.21.15.50:33364) 2024-01-30T08:10:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.251+0000 7f5551c00640 1 -- 172.21.15.50:0/2657156415 learned_addr learned my addr 172.21.15.50:0/2657156415 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f5551c00640 1 -- 172.21.15.50:0/2657156415 >> v2:172.21.15.125:3300/0 conn(0x7f554c0adb30 msgr2=0x7f554c0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f5551c00640 1 --2- 172.21.15.50:0/2657156415 >> v2:172.21.15.125:3300/0 conn(0x7f554c0adb30 0x7f554c0c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f5551c00640 1 -- 172.21.15.50:0/2657156415 >> v1:172.21.15.125:6789/0 conn(0x7f554c1523b0 legacy=0x7f554c0a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f5551c00640 1 -- 172.21.15.50:0/2657156415 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0c74e0 con 0x7f554c0c47b0 2024-01-30T08:10:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f5551c00640 1 --2- 172.21.15.50:0/2657156415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0c3f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eae384dc52cf424 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f554be00640 1 -- 172.21.15.50:0/2657156415 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0ac600 con 0x7f554c0c47b0 2024-01-30T08:10:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f554be00640 1 -- 172.21.15.50:0/2657156415 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0a8050 con 0x7f554c0c47b0 2024-01-30T08:10:53.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.255+0000 7f554be00640 1 -- 172.21.15.50:0/2657156415 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0ac980 con 0x7f554c0c47b0 2024-01-30T08:10:53.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- 172.21.15.50:0/2657156415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 msgr2=0x7f554c0c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 --2- 172.21.15.50:0/2657156415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0c3f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c01c4b0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- 172.21.15.50:0/2657156415 shutdown_connections 2024-01-30T08:10:53.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 --2- 172.21.15.50:0/2657156415 >> v2:172.21.15.125:3300/0 conn(0x7f554c0adb30 0x7f554c0c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 --2- 172.21.15.50:0/2657156415 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0c3f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- 172.21.15.50:0/2657156415 >> 172.21.15.50:0/2657156415 conn(0x7f554c06ad40 msgr2=0x7f554c0c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- 172.21.15.50:0/2657156415 shutdown_connections 2024-01-30T08:10:53.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- 172.21.15.50:0/2657156415 wait complete. 2024-01-30T08:10:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 Processor -- start 2024-01-30T08:10:53.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- start start 2024-01-30T08:10:53.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f554c0adb30 0x7f554c148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f554c1523b0 0x7f554c06b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1ecb80 con 0x7f554c0adb30 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c151410 con 0x7f554c1523b0 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5554600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1ecd90 con 0x7f554c0c47b0 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5551c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f554c0adb30 0x7f554c148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5551c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f554c0adb30 0x7f554c148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42452/0 (socket says 172.21.15.50:42452) 2024-01-30T08:10:53.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5551c00640 1 -- 172.21.15.50:0/1647154067 learned_addr learned my addr 172.21.15.50:0/1647154067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5552600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f554c1523b0 0x7f554c06b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.259+0000 7f5551200640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5551c00640 1 -- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 msgr2=0x7f554c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5551c00640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5551c00640 1 -- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f554c1523b0 msgr2=0x7f554c06b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5551c00640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f554c1523b0 0x7f554c06b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5551c00640 1 -- 172.21.15.50:0/1647154067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0094d0 con 0x7f554c0adb30 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5551c00640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f554c0adb30 0x7f554c148ad0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f553c01ab60 tx=0x7f553c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5549600640 1 -- 172.21.15.50:0/1647154067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0b7420 con 0x7f554c0adb30 2024-01-30T08:10:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5549600640 1 -- 172.21.15.50:0/1647154067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0b7580 con 0x7f554c0adb30 2024-01-30T08:10:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c1ed030 con 0x7f554c0adb30 2024-01-30T08:10:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5549600640 1 -- 172.21.15.50:0/1647154067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0b7930 con 0x7f554c0adb30 2024-01-30T08:10:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c1ed5f0 con 0x7f554c0adb30 2024-01-30T08:10:53.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c04ead0 con 0x7f554c0adb30 2024-01-30T08:10:53.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5549600640 1 -- 172.21.15.50:0/1647154067 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f553c0b3040 con 0x7f554c0adb30 2024-01-30T08:10:53.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5549600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5524066500 0x7f55240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.263+0000 7f5549600640 1 -- 172.21.15.50:0/1647154067 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f553c11e0c0 con 0x7f554c0adb30 2024-01-30T08:10:53.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.267+0000 7f5551200640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5524066500 0x7f55240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.267+0000 7f5551200640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5524066500 0x7f55240689c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f554c0a9790 tx=0x7f5534009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.267+0000 7f5549600640 1 -- 172.21.15.50:0/1647154067 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f553c0eb560 con 0x7f554c0adb30 2024-01-30T08:10:53.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.427+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f554c1527c0 con 0x7f5524066500 2024-01-30T08:10:53.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.427+0000 7f5549600640 1 -- 172.21.15.50:0/1647154067 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5534011a30 con 0x7f5524066500 2024-01-30T08:10:53.433 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2024-01-30T08:10:53.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5524066500 msgr2=0x7f55240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5524066500 0x7f55240689c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f554c0a9790 tx=0x7f5534009190 comp rx=0 tx=0).stop 2024-01-30T08:10:53.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f554c0adb30 msgr2=0x7f554c148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f554c0adb30 0x7f554c148ad0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f553c01ab60 tx=0x7f553c01acf0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 shutdown_connections 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f554c1523b0 0x7f554c06b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f5524066500 0x7f55240689c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f554c0c47b0 0x7f554c0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 --2- 172.21.15.50:0/1647154067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f554c0adb30 0x7f554c148ad0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 >> 172.21.15.50:0/1647154067 conn(0x7f554c06ad40 msgr2=0x7f554c0a71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 shutdown_connections 2024-01-30T08:10:53.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.431+0000 7f5554600640 1 -- 172.21.15.50:0/1647154067 wait complete. 2024-01-30T08:10:53.455 INFO:tasks.ceph:Scrubbing osd.5 2024-01-30T08:10:53.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f7555a00640 1 Processor -- start 2024-01-30T08:10:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f7555a00640 1 -- start start 2024-01-30T08:10:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f7555a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75500c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f7555a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75500c4420 0x7f75500c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f7555a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75501535e0 con 0x7f75500a70d0 2024-01-30T08:10:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f7555a00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755006f2e0 con 0x7f75500c4420 2024-01-30T08:10:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f7555a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7550152a60 con 0x7f755006e1f0 2024-01-30T08:10:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f754f400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75500c4420 0x7f75500c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f754ea00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f75500a70d0 0x7f755014f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51448/0 (socket says 172.21.15.50:51448) 2024-01-30T08:10:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.595+0000 7f754ea00640 1 -- 172.21.15.50:0/3168006651 learned_addr learned my addr 172.21.15.50:0/3168006651 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754e000640 1 --2- 172.21.15.50:0/3168006651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75500c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754f400640 1 -- 172.21.15.50:0/3168006651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 msgr2=0x7f75500c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754f400640 1 --2- 172.21.15.50:0/3168006651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75500c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754f400640 1 -- 172.21.15.50:0/3168006651 >> v1:172.21.15.50:6789/0 conn(0x7f75500a70d0 legacy=0x7f755014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754d600640 1 -- 172.21.15.50:0/3168006651 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263496644 0 0) 0x7f75501535e0 con 0x7f75500a70d0 2024-01-30T08:10:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754f400640 1 -- 172.21.15.50:0/3168006651 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550152d40 con 0x7f75500c4420 2024-01-30T08:10:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754f400640 1 --2- 172.21.15.50:0/3168006651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500c4420 0x7f75500c48b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7548009d90 tx=0x7f754801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8e83cda2a69fac server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754d600640 1 -- 172.21.15.50:0/3168006651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480a5870 con 0x7f75500c4420 2024-01-30T08:10:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754d600640 1 -- 172.21.15.50:0/3168006651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75480a59d0 con 0x7f75500c4420 2024-01-30T08:10:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.599+0000 7f754d600640 1 -- 172.21.15.50:0/3168006651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480a5d60 con 0x7f75500c4420 2024-01-30T08:10:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- 172.21.15.50:0/3168006651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500c4420 msgr2=0x7f75500c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 --2- 172.21.15.50:0/3168006651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500c4420 0x7f75500c48b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7548009d90 tx=0x7f754801c8c0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- 172.21.15.50:0/3168006651 shutdown_connections 2024-01-30T08:10:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 --2- 172.21.15.50:0/3168006651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500c4420 0x7f75500c48b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 --2- 172.21.15.50:0/3168006651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75500c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- 172.21.15.50:0/3168006651 >> 172.21.15.50:0/3168006651 conn(0x7f75500a9a80 msgr2=0x7f75500a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- 172.21.15.50:0/3168006651 shutdown_connections 2024-01-30T08:10:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- 172.21.15.50:0/3168006651 wait complete. 2024-01-30T08:10:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 Processor -- start 2024-01-30T08:10:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- start start 2024-01-30T08:10:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75501431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500a70d0 0x7f75501efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500c4420 0x7f755006d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75501f0cc0 con 0x7f75500a70d0 2024-01-30T08:10:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75501f0420 con 0x7f75500c4420 2024-01-30T08:10:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f7555a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75501f0700 con 0x7f755006e1f0 2024-01-30T08:10:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f754e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500a70d0 0x7f75501efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f754e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500a70d0 0x7f75501efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42470/0 (socket says 172.21.15.50:42470) 2024-01-30T08:10:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.603+0000 7f754e000640 1 -- 172.21.15.50:0/2625173992 learned_addr learned my addr 172.21.15.50:0/2625173992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754ea00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75501431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754f400640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500c4420 0x7f755006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754e000640 1 -- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 msgr2=0x7f75501431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754e000640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75501431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754e000640 1 -- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500c4420 msgr2=0x7f755006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754e000640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500c4420 0x7f755006d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754e000640 1 -- 172.21.15.50:0/2625173992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548009a70 con 0x7f75500a70d0 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754f400640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500c4420 0x7f755006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754ea00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f755006e1f0 0x7f75501431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754e000640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500a70d0 0x7f75501efd90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f753800e930 tx=0x7f753800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538009690 con 0x7f75500a70d0 2024-01-30T08:10:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753800ca00 con 0x7f75500a70d0 2024-01-30T08:10:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75501f09e0 con 0x7f75500a70d0 2024-01-30T08:10:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800cd70 con 0x7f75500a70d0 2024-01-30T08:10:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755006d5c0 con 0x7f75500a70d0 2024-01-30T08:10:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75500a74b0 con 0x7f75500a70d0 2024-01-30T08:10:53.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7538013470 con 0x7f75500a70d0 2024-01-30T08:10:53.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7528066500 0x7f75280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7538083ff0 con 0x7f75500a70d0 2024-01-30T08:10:53.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f752806c8a0 0x7f752806ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 --> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f752806f3b0 con 0x7f752806c8a0 2024-01-30T08:10:53.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7538086610 con 0x7f75500a70d0 2024-01-30T08:10:53.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.607+0000 7f754ea00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7528066500 0x7f75280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.611+0000 7f754f400640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f752806c8a0 0x7f752806ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.611+0000 7f754ea00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7528066500 0x7f75280689c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7540000f70 tx=0x7f7540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.611+0000 7f754f400640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f752806c8a0 0x7f752806ece0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.611+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== osd.5 v2:172.21.15.125:6800/1470340400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f752806f3b0 con 0x7f752806c8a0 2024-01-30T08:10:53.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.623+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 --> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f75501ecb90 con 0x7f752806c8a0 2024-01-30T08:10:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.623+0000 7f7546a00640 1 -- 172.21.15.50:0/2625173992 <== osd.5 v2:172.21.15.125:6800/1470340400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f75480a5b40 con 0x7f752806c8a0 2024-01-30T08:10:53.629 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:53.629 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:53.629 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.623+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f752806c8a0 msgr2=0x7f752806ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.623+0000 7f7555a00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6800/1470340400,v1:172.21.15.125:6801/1470340400] conn(0x7f752806c8a0 0x7f752806ece0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7528066500 msgr2=0x7f75280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7528066500 0x7f75280689c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7540000f70 tx=0x7f7540009040 comp rx=0 tx=0).stop 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500a70d0 msgr2=0x7f75501efd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 --2- 172.21.15.50:0/2625173992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75500a70d0 0x7f75501efd90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f753800e930 tx=0x7f753800edf0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f754f400640 1 -- 172.21.15.50:0/2625173992 reap_dead start 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 shutdown_connections 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 >> 172.21.15.50:0/2625173992 conn(0x7f75500a9a80 msgr2=0x7f75500c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 shutdown_connections 2024-01-30T08:10:53.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.627+0000 7f7555a00640 1 -- 172.21.15.50:0/2625173992 wait complete. 2024-01-30T08:10:53.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-30T08:10:53.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc272a00640 1 Processor -- start 2024-01-30T08:10:53.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc272a00640 1 -- start start 2024-01-30T08:10:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc272a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc272a00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c0c0ba0 con 0x7fc26c06ab20 2024-01-30T08:10:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc272a00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c06af80 con 0x7fc26c06a740 2024-01-30T08:10:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc272a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0c5f90 con 0x7fc26c155080 2024-01-30T08:10:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc270a00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc26c06ab20 0x7fc26c0c2550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51450/0 (socket says 172.21.15.50:51450) 2024-01-30T08:10:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc270a00640 1 -- 172.21.15.50:0/1685538829 learned_addr learned my addr 172.21.15.50:0/1685538829 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:53.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.787+0000 7fc26b400640 1 --2- 172.21.15.50:0/1685538829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26aa00640 1 -- 172.21.15.50:0/1685538829 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695557564 0 0) 0x7fc26c0c0ba0 con 0x7fc26c06ab20 2024-01-30T08:10:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26aa00640 1 -- 172.21.15.50:0/1685538829 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc24c003530 con 0x7fc26c06ab20 2024-01-30T08:10:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26aa00640 1 -- 172.21.15.50:0/1685538829 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095664117 0 0) 0x7fc26c06af80 con 0x7fc26c06a740 2024-01-30T08:10:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26aa00640 1 -- 172.21.15.50:0/1685538829 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc26c0c0ba0 con 0x7fc26c06a740 2024-01-30T08:10:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26b400640 1 -- 172.21.15.50:0/1685538829 >> v1:172.21.15.125:6789/0 conn(0x7fc26c06a740 legacy=0x7fc26c0a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26b400640 1 -- 172.21.15.50:0/1685538829 >> v1:172.21.15.50:6789/0 conn(0x7fc26c06ab20 legacy=0x7fc26c0c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26b400640 1 -- 172.21.15.50:0/1685538829 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c0c4cd0 con 0x7fc26c155080 2024-01-30T08:10:53.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26b400640 1 --2- 172.21.15.50:0/1685538829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0c6500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc2540097f0 tx=0x7fc25401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28bd59ce2bb10ca2 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26aa00640 1 -- 172.21.15.50:0/1685538829 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540ab600 con 0x7fc26c155080 2024-01-30T08:10:53.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26aa00640 1 -- 172.21.15.50:0/1685538829 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2540a7050 con 0x7fc26c155080 2024-01-30T08:10:53.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.791+0000 7fc26aa00640 1 -- 172.21.15.50:0/1685538829 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540ab980 con 0x7fc26c155080 2024-01-30T08:10:53.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- 172.21.15.50:0/1685538829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 msgr2=0x7fc26c0c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 --2- 172.21.15.50:0/1685538829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0c6500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc2540097f0 tx=0x7fc25401c3a0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- 172.21.15.50:0/1685538829 shutdown_connections 2024-01-30T08:10:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 --2- 172.21.15.50:0/1685538829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0c6500 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- 172.21.15.50:0/1685538829 >> 172.21.15.50:0/1685538829 conn(0x7fc26c0a8890 msgr2=0x7fc26c0a8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- 172.21.15.50:0/1685538829 shutdown_connections 2024-01-30T08:10:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- 172.21.15.50:0/1685538829 wait complete. 2024-01-30T08:10:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 Processor -- start 2024-01-30T08:10:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- start start 2024-01-30T08:10:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc26c06a740 0x7fc26c142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc26c06ab20 0x7fc26c0a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0aab80 con 0x7fc26c06a740 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0ab0d0 con 0x7fc26c06ab20 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc272a00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c06ec30 con 0x7fc26c155080 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc26be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc26c06a740 0x7fc26c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc26be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc26c06a740 0x7fc26c142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42474/0 (socket says 172.21.15.50:42474) 2024-01-30T08:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc26be00640 1 -- 172.21.15.50:0/3585324369 learned_addr learned my addr 172.21.15.50:0/3585324369 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc270a00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.795+0000 7fc26b400640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc26c06ab20 0x7fc26c0a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc26be00640 1 -- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 msgr2=0x7fc26c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc26be00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc26be00640 1 -- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc26c06ab20 msgr2=0x7fc26c0a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc26be00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc26c06ab20 0x7fc26c0a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc26be00640 1 -- 172.21.15.50:0/3585324369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009420 con 0x7fc26c06a740 2024-01-30T08:10:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc26be00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc26c06a740 0x7fc26c142550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c500 tx=0x7fc25c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc263e00640 1 -- 172.21.15.50:0/3585324369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0052d0 con 0x7fc26c06a740 2024-01-30T08:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc263e00640 1 -- 172.21.15.50:0/3585324369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c005450 con 0x7fc26c06a740 2024-01-30T08:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc263e00640 1 -- 172.21.15.50:0/3585324369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c012870 con 0x7fc26c06a740 2024-01-30T08:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c06ef10 con 0x7fc26c06a740 2024-01-30T08:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c142a90 con 0x7fc26c06a740 2024-01-30T08:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c06f150 con 0x7fc26c06a740 2024-01-30T08:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc263e00640 1 -- 172.21.15.50:0/3585324369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc25c0129d0 con 0x7fc26c06a740 2024-01-30T08:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc263e00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc244066500 0x7fc2440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.799+0000 7fc263e00640 1 -- 172.21.15.50:0/3585324369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc25c083830 con 0x7fc26c06a740 2024-01-30T08:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.803+0000 7fc26b400640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc244066500 0x7fc2440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.803+0000 7fc26b400640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc244066500 0x7fc2440689c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2540ad000 tx=0x7fc254008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:53.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.803+0000 7fc263e00640 1 -- 172.21.15.50:0/3585324369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc26c06f150 con 0x7fc26c06a740 2024-01-30T08:10:53.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.971+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc26c0aaf30 con 0x7fc244066500 2024-01-30T08:10:53.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.971+0000 7fc263e00640 1 -- 172.21.15.50:0/3585324369 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc26c0aaf30 con 0x7fc244066500 2024-01-30T08:10:53.976 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2024-01-30T08:10:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc244066500 msgr2=0x7fc2440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc244066500 0x7fc2440689c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2540ad000 tx=0x7fc254008040 comp rx=0 tx=0).stop 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc26c06a740 msgr2=0x7fc26c142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc26c06a740 0x7fc26c142550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c500 tx=0x7fc25c00c9c0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 shutdown_connections 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc26c06ab20 0x7fc26c0a9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fc244066500 0x7fc2440689c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc26c155080 0x7fc26c0a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 --2- 172.21.15.50:0/3585324369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc26c06a740 0x7fc26c142550 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 >> 172.21.15.50:0/3585324369 conn(0x7fc26c0a8890 msgr2=0x7fc26c153330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:53.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 shutdown_connections 2024-01-30T08:10:53.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:53.975+0000 7fc272a00640 1 -- 172.21.15.50:0/3585324369 wait complete. 2024-01-30T08:10:53.998 INFO:tasks.ceph:Scrubbing osd.6 2024-01-30T08:10:53.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb6a000640 1 Processor -- start 2024-01-30T08:10:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb6a000640 1 -- start start 2024-01-30T08:10:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb6a000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 0x7fcb640a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb6a000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb64070020 0x7fcb640c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb6a000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb640c0ae0 con 0x7fcb640c0570 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb6a000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb640c10e0 con 0x7fcb64070020 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb6a000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640c13c0 con 0x7fcb640a96d0 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb62a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb64070020 0x7fcb640c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb62a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb64070020 0x7fcb640c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42488/0 (socket says 172.21.15.50:42488) 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb62a00640 1 -- 172.21.15.50:0/3951106603 learned_addr learned my addr 172.21.15.50:0/3951106603 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb62a00640 1 -- 172.21.15.50:0/3951106603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 msgr2=0x7fcb640a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb62a00640 1 --2- 172.21.15.50:0/3951106603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 0x7fcb640a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb62a00640 1 -- 172.21.15.50:0/3951106603 >> v1:172.21.15.125:6789/0 conn(0x7fcb640c0570 legacy=0x7fcb640c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.139+0000 7fcb62a00640 1 -- 172.21.15.50:0/3951106603 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640c16a0 con 0x7fcb64070020 2024-01-30T08:10:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.143+0000 7fcb62a00640 1 --2- 172.21.15.50:0/3951106603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb64070020 0x7fcb640c1bc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009870 tx=0x7fcb4c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b3157641c33f58 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.143+0000 7fcb62000640 1 -- 172.21.15.50:0/3951106603 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0ab600 con 0x7fcb64070020 2024-01-30T08:10:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.143+0000 7fcb62000640 1 -- 172.21.15.50:0/3951106603 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0a7050 con 0x7fcb64070020 2024-01-30T08:10:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.143+0000 7fcb62000640 1 -- 172.21.15.50:0/3951106603 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0ab980 con 0x7fcb64070020 2024-01-30T08:10:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.143+0000 7fcb6a000640 1 -- 172.21.15.50:0/3951106603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb64070020 msgr2=0x7fcb640c1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.143+0000 7fcb6a000640 1 --2- 172.21.15.50:0/3951106603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb64070020 0x7fcb640c1bc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009870 tx=0x7fcb4c01c470 comp rx=0 tx=0).stop 2024-01-30T08:10:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.143+0000 7fcb6a000640 1 -- 172.21.15.50:0/3951106603 shutdown_connections 2024-01-30T08:10:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 --2- 172.21.15.50:0/3951106603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb64070020 0x7fcb640c1bc0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 --2- 172.21.15.50:0/3951106603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 0x7fcb640a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 -- 172.21.15.50:0/3951106603 >> 172.21.15.50:0/3951106603 conn(0x7fcb640c5bb0 msgr2=0x7fcb640c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:54.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 -- 172.21.15.50:0/3951106603 shutdown_connections 2024-01-30T08:10:54.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 -- 172.21.15.50:0/3951106603 wait complete. 2024-01-30T08:10:54.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 Processor -- start 2024-01-30T08:10:54.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 -- start start 2024-01-30T08:10:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb64070020 0x7fcb640bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 0x7fcb640be220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640c0570 0x7fcb64151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641568b0 con 0x7fcb640c0570 2024-01-30T08:10:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64157400 con 0x7fcb64070020 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb6a000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64158310 con 0x7fcb640a96d0 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640c0570 0x7fcb64151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640c0570 0x7fcb64151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42494/0 (socket says 172.21.15.50:42494) 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 -- 172.21.15.50:0/3167709535 learned_addr learned my addr 172.21.15.50:0/3167709535 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb62a00640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 0x7fcb640be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63400640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb64070020 0x7fcb640bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 -- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 msgr2=0x7fcb640be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb640a96d0 0x7fcb640be220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 -- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb64070020 msgr2=0x7fcb640bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb64070020 0x7fcb640bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 -- 172.21.15.50:0/3167709535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c0094d0 con 0x7fcb640c0570 2024-01-30T08:10:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.147+0000 7fcb63e00640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640c0570 0x7fcb64151e10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00b990 tx=0x7fcb5c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00cba0 con 0x7fcb640c0570 2024-01-30T08:10:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00cd00 con 0x7fcb640c0570 2024-01-30T08:10:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c014680 con 0x7fcb640c0570 2024-01-30T08:10:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb641585f0 con 0x7fcb640c0570 2024-01-30T08:10:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb64157980 con 0x7fcb640c0570 2024-01-30T08:10:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb64074a20 con 0x7fcb640c0570 2024-01-30T08:10:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcb5c0147e0 con 0x7fcb640c0570 2024-01-30T08:10:54.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb3c066500 0x7fcb3c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcb5c083ca0 con 0x7fcb640c0570 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7fcb3c06c8a0 0x7fcb3c06ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 --> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb3c06f3b0 con 0x7fcb3c06c8a0 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5c0882a0 con 0x7fcb640c0570 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb63400640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb3c066500 0x7fcb3c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.151+0000 7fcb62a00640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7fcb3c06c8a0 0x7fcb3c06ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.155+0000 7fcb63400640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb3c066500 0x7fcb3c0689c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb6415db20 tx=0x7fcb54009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.155+0000 7fcb62a00640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7fcb3c06c8a0 0x7fcb3c06ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.155+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== osd.6 v2:172.21.15.125:6809/2977185679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcb3c06f3b0 con 0x7fcb3c06c8a0 2024-01-30T08:10:54.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 --> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb64157b70 con 0x7fcb3c06c8a0 2024-01-30T08:10:54.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb5b400640 1 -- 172.21.15.50:0/3167709535 <== osd.6 v2:172.21.15.125:6809/2977185679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb64157b70 con 0x7fcb3c06c8a0 2024-01-30T08:10:54.173 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:54.173 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:54.173 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7fcb3c06c8a0 msgr2=0x7fcb3c06ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6809/2977185679,v1:172.21.15.125:6811/2977185679] conn(0x7fcb3c06c8a0 0x7fcb3c06ece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb3c066500 msgr2=0x7fcb3c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fcb3c066500 0x7fcb3c0689c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb6415db20 tx=0x7fcb54009110 comp rx=0 tx=0).stop 2024-01-30T08:10:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640c0570 msgr2=0x7fcb64151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 --2- 172.21.15.50:0/3167709535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640c0570 0x7fcb64151e10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00b990 tx=0x7fcb5c00be50 comp rx=0 tx=0).stop 2024-01-30T08:10:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb63e00640 1 -- 172.21.15.50:0/3167709535 reap_dead start 2024-01-30T08:10:54.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 shutdown_connections 2024-01-30T08:10:54.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.167+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 >> 172.21.15.50:0/3167709535 conn(0x7fcb640c5bb0 msgr2=0x7fcb64070440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:54.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.171+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 shutdown_connections 2024-01-30T08:10:54.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.171+0000 7fcb6a000640 1 -- 172.21.15.50:0/3167709535 wait complete. 2024-01-30T08:10:54.192 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-30T08:10:54.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b7600640 1 Processor -- start 2024-01-30T08:10:54.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b7600640 1 -- start start 2024-01-30T08:10:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b7600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 0x7f32b00c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b7600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32b006ab20 0x7f32b00c2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b7600640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00c0ba0 con 0x7f32b006a740 2024-01-30T08:10:54.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b7600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00c5f90 con 0x7f32b006ab20 2024-01-30T08:10:54.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b7600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b014ee00 con 0x7f32b0155080 2024-01-30T08:10:54.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f32b006a740 0x7f32b00a5aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51458/0 (socket says 172.21.15.50:51458) 2024-01-30T08:10:54.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 -- 172.21.15.50:0/257217013 learned_addr learned my addr 172.21.15.50:0/257217013 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:10:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b5600640 1 --2- 172.21.15.50:0/257217013 >> v2:172.21.15.125:3300/0 conn(0x7f32b006ab20 0x7f32b00c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32afe00640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 0x7f32b00c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572280385 0 0) 0x7f32b00c0ba0 con 0x7f32b006a740 2024-01-30T08:10:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3290003530 con 0x7f32b006a740 2024-01-30T08:10:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3325630845 0 0) 0x7f3290003530 con 0x7f32b006a740 2024-01-30T08:10:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 msgr2=0x7f32b00c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 0x7f32b00c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 >> v2:172.21.15.125:3300/0 conn(0x7f32b006ab20 msgr2=0x7f32b00c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 --2- 172.21.15.50:0/257217013 >> v2:172.21.15.125:3300/0 conn(0x7f32b006ab20 0x7f32b00c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b006af80 con 0x7f32b006a740 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 408923852 0 0) 0x7f32a0001680 con 0x7f32b006a740 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b5600640 1 --2- 172.21.15.50:0/257217013 >> v2:172.21.15.125:3300/0 conn(0x7f32b006ab20 0x7f32b00c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 >> v1:172.21.15.50:6789/0 conn(0x7f32b006a740 legacy=0x7f32b00a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3290003980 0x7f3290003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900047d0 0x7f3290004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 0x7f3290005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b014ee00 con 0x7f3290003980 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329000b990 con 0x7f32900047d0 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329000bb50 con 0x7f32b0155080 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3290003980 0x7f3290003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32afe00640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900047d0 0x7f3290004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b5600640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 0x7f3290005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 -- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 msgr2=0x7f3290005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f32b0155080 0x7f3290005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 -- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900047d0 msgr2=0x7f3290004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900047d0 0x7f3290004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32b4c00640 1 -- 172.21.15.50:0/257217013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290003530 con 0x7f3290003980 2024-01-30T08:10:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.331+0000 7f32afe00640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900047d0 0x7f3290004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:10:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b4c00640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3290003980 0x7f3290003da0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f32a000c240 tx=0x7f32a001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973f7eb33632e113 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00058e0 con 0x7f3290003980 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0005a40 con 0x7f3290003980 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32af400640 1 -- 172.21.15.50:0/257217013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0005e10 con 0x7f3290003980 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b7600640 1 -- 172.21.15.50:0/257217013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3290003980 msgr2=0x7f3290003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b7600640 1 --2- 172.21.15.50:0/257217013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3290003980 0x7f3290003da0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f32a000c240 tx=0x7f32a001cc60 comp rx=0 tx=0).stop 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b5600640 1 -- 172.21.15.50:0/257217013 reap_dead start 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b7600640 1 -- 172.21.15.50:0/257217013 shutdown_connections 2024-01-30T08:10:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b7600640 1 -- 172.21.15.50:0/257217013 >> 172.21.15.50:0/257217013 conn(0x7f32b00a8890 msgr2=0x7f32b00a8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b7600640 1 -- 172.21.15.50:0/257217013 shutdown_connections 2024-01-30T08:10:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.335+0000 7f32b7600640 1 -- 172.21.15.50:0/257217013 wait complete. 2024-01-30T08:10:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 Processor -- start 2024-01-30T08:10:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 -- start start 2024-01-30T08:10:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3290003980 0x7f32b01edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32b0149d20 0x7f32b014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32b0147d70 0x7f32b01481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01ee360 con 0x7f32b0149d20 2024-01-30T08:10:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b006eee0 con 0x7f32b0147d70 2024-01-30T08:10:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b006f1c0 con 0x7f3290003980 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32b0149d20 0x7f32b014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32b0149d20 0x7f32b014b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42512/0 (socket says 172.21.15.50:42512) 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 -- 172.21.15.50:0/3514388947 learned_addr learned my addr 172.21.15.50:0/3514388947 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b4c00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3290003980 0x7f32b01edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b5600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32b0147d70 0x7f32b01481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 -- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3290003980 msgr2=0x7f32b01edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3290003980 0x7f32b01edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 -- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32b0147d70 msgr2=0x7f32b01481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32b0147d70 0x7f32b01481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 -- 172.21.15.50:0/3514388947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b00a7fb0 con 0x7f32b0149d20 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b4c00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3290003980 0x7f32b01edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b5600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32b0147d70 0x7f32b01481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32afe00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32b0149d20 0x7f32b014b9f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3298009160 tx=0x7f3298011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32acc00640 1 -- 172.21.15.50:0/3514388947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298004220 con 0x7f32b0149d20 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32acc00640 1 -- 172.21.15.50:0/3514388947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3298004380 con 0x7f32b0149d20 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b00a8290 con 0x7f32b0149d20 2024-01-30T08:10:54.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32acc00640 1 -- 172.21.15.50:0/3514388947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298015890 con 0x7f32b0149d20 2024-01-30T08:10:54.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.339+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b014bf30 con 0x7f32b0149d20 2024-01-30T08:10:54.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.343+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b004ead0 con 0x7f32b0149d20 2024-01-30T08:10:54.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.343+0000 7f32acc00640 1 -- 172.21.15.50:0/3514388947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f32980159f0 con 0x7f32b0149d20 2024-01-30T08:10:54.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.343+0000 7f32acc00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3288066500 0x7f32880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.343+0000 7f32acc00640 1 -- 172.21.15.50:0/3514388947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3298084190 con 0x7f32b0149d20 2024-01-30T08:10:54.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.343+0000 7f32b4c00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3288066500 0x7f32880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.343+0000 7f32b4c00640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3288066500 0x7f32880689c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f32a00aa000 tx=0x7f32a0001a80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.347+0000 7f32acc00640 1 -- 172.21.15.50:0/3514388947 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3298051620 con 0x7f32b0149d20 2024-01-30T08:10:54.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.511+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f32b006f050 con 0x7f3288066500 2024-01-30T08:10:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.511+0000 7f32acc00640 1 -- 172.21.15.50:0/3514388947 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f32b006f050 con 0x7f3288066500 2024-01-30T08:10:54.516 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2024-01-30T08:10:54.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3288066500 msgr2=0x7f32880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3288066500 0x7f32880689c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f32a00aa000 tx=0x7f32a0001a80 comp rx=0 tx=0).stop 2024-01-30T08:10:54.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32b0149d20 msgr2=0x7f32b014b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32b0149d20 0x7f32b014b9f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3298009160 tx=0x7f3298011a60 comp rx=0 tx=0).stop 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 shutdown_connections 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32b0147d70 0x7f32b01481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f3288066500 0x7f32880689c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32b0149d20 0x7f32b014b9f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 --2- 172.21.15.50:0/3514388947 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3290003980 0x7f32b01edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 >> 172.21.15.50:0/3514388947 conn(0x7f32b00a8890 msgr2=0x7f32b00a8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:54.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 shutdown_connections 2024-01-30T08:10:54.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.515+0000 7f32b7600640 1 -- 172.21.15.50:0/3514388947 wait complete. 2024-01-30T08:10:54.539 INFO:tasks.ceph:Scrubbing osd.7 2024-01-30T08:10:54.539 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-30T08:10:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 Processor -- start 2024-01-30T08:10:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 -- start start 2024-01-30T08:10:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a980c27b0 0x7f9a980c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9a980c2b90 0x7f9a980c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c3df0 0x7f9a980a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980a9990 con 0x7f9a980c27b0 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a98072740 con 0x7f9a980c2b90 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.679+0000 7f9a9ec00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980729e0 con 0x7f9a980c3df0 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a980c27b0 0x7f9a980c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a980c27b0 0x7f9a980c16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42520/0 (socket says 172.21.15.50:42520) 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 -- 172.21.15.50:0/2777264603 learned_addr learned my addr 172.21.15.50:0/2777264603 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a9cc00640 1 --2- 172.21.15.50:0/2777264603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c3df0 0x7f9a980a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97400640 1 --2- 172.21.15.50:0/2777264603 >> v2:172.21.15.125:3300/0 conn(0x7f9a980c2b90 0x7f9a980c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 -- 172.21.15.50:0/2777264603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c3df0 msgr2=0x7f9a980a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 --2- 172.21.15.50:0/2777264603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c3df0 0x7f9a980a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 -- 172.21.15.50:0/2777264603 >> v2:172.21.15.125:3300/0 conn(0x7f9a980c2b90 msgr2=0x7f9a980c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 --2- 172.21.15.50:0/2777264603 >> v2:172.21.15.125:3300/0 conn(0x7f9a980c2b90 0x7f9a980c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 -- 172.21.15.50:0/2777264603 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98072cc0 con 0x7f9a980c27b0 2024-01-30T08:10:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a97e00640 1 --2- 172.21.15.50:0/2777264603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c27b0 0x7f9a980c16a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9a980a9310 tx=0x7f9a8801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4812e1ac82f352 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a96a00640 1 -- 172.21.15.50:0/2777264603 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a880ab600 con 0x7f9a980c27b0 2024-01-30T08:10:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a96a00640 1 -- 172.21.15.50:0/2777264603 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a880a7050 con 0x7f9a980c27b0 2024-01-30T08:10:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.683+0000 7f9a96a00640 1 -- 172.21.15.50:0/2777264603 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a880ab980 con 0x7f9a980c27b0 2024-01-30T08:10:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- 172.21.15.50:0/2777264603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c27b0 msgr2=0x7f9a980c16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 --2- 172.21.15.50:0/2777264603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c27b0 0x7f9a980c16a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9a980a9310 tx=0x7f9a8801c440 comp rx=0 tx=0).stop 2024-01-30T08:10:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- 172.21.15.50:0/2777264603 shutdown_connections 2024-01-30T08:10:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 --2- 172.21.15.50:0/2777264603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c3df0 0x7f9a980a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 --2- 172.21.15.50:0/2777264603 >> v2:172.21.15.125:3300/0 conn(0x7f9a980c2b90 0x7f9a980c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 --2- 172.21.15.50:0/2777264603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c27b0 0x7f9a980c16a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- 172.21.15.50:0/2777264603 >> 172.21.15.50:0/2777264603 conn(0x7f9a980c5bb0 msgr2=0x7f9a980c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- 172.21.15.50:0/2777264603 shutdown_connections 2024-01-30T08:10:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- 172.21.15.50:0/2777264603 wait complete. 2024-01-30T08:10:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 Processor -- start 2024-01-30T08:10:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- start start 2024-01-30T08:10:54.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a980c27b0 0x7f9a9814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c2b90 0x7f9a981ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c3df0 0x7f9a9814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9806d160 con 0x7f9a980c3df0 2024-01-30T08:10:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9814e010 con 0x7f9a980c27b0 2024-01-30T08:10:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9ec00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a981ecfb0 con 0x7f9a980c2b90 2024-01-30T08:10:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c3df0 0x7f9a9814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c3df0 0x7f9a9814eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42530/0 (socket says 172.21.15.50:42530) 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.687+0000 7f9a9cc00640 1 -- 172.21.15.50:0/4040359043 learned_addr learned my addr 172.21.15.50:0/4040359043 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a97e00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a980c27b0 0x7f9a9814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9cc00640 1 -- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c2b90 msgr2=0x7f9a981ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a97400640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c2b90 0x7f9a981ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9cc00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c2b90 0x7f9a981ed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9cc00640 1 -- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a980c27b0 msgr2=0x7f9a9814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9cc00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a980c27b0 0x7f9a9814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9cc00640 1 -- 172.21.15.50:0/4040359043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880094d0 con 0x7f9a980c3df0 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a97e00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a980c27b0 0x7f9a9814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a97400640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a980c2b90 0x7f9a981ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9cc00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c3df0 0x7f9a9814eee0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000efc0 tx=0x7f9a9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90009b20 con 0x7f9a980c3df0 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9000f040 con 0x7f9a980c3df0 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a900146c0 con 0x7f9a980c3df0 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a98071400 con 0x7f9a980c3df0 2024-01-30T08:10:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a980719c0 con 0x7f9a980c3df0 2024-01-30T08:10:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a980c0430 con 0x7f9a980c3df0 2024-01-30T08:10:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9a90014820 con 0x7f9a980c3df0 2024-01-30T08:10:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9a70066500 0x7f9a700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9a90084b20 con 0x7f9a980c3df0 2024-01-30T08:10:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f9a7006c8a0 0x7f9a7006ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 --> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a7006f3b0 con 0x7f9a7006c8a0 2024-01-30T08:10:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a900892a0 con 0x7f9a980c3df0 2024-01-30T08:10:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.691+0000 7f9a97e00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9a70066500 0x7f9a700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.695+0000 7f9a97400640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f9a7006c8a0 0x7f9a7006ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.695+0000 7f9a97e00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9a70066500 0x7f9a700689c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a880ad000 tx=0x7f9a88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.695+0000 7f9a97400640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f9a7006c8a0 0x7f9a7006ece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.695+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== osd.7 v2:172.21.15.125:6808/1793140907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9a7006f3b0 con 0x7f9a7006c8a0 2024-01-30T08:10:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.707+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 --> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9a98074a20 con 0x7f9a7006c8a0 2024-01-30T08:10:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.707+0000 7f9a8fe00640 1 -- 172.21.15.50:0/4040359043 <== osd.7 v2:172.21.15.125:6808/1793140907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9a98074a20 con 0x7f9a7006c8a0 2024-01-30T08:10:54.713 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-01-30T08:10:54.714 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-30T08:10:54.714 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-01-30T08:10:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f9a7006c8a0 msgr2=0x7f9a7006ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6808/1793140907,v1:172.21.15.125:6810/1793140907] conn(0x7f9a7006c8a0 0x7f9a7006ece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9a70066500 msgr2=0x7f9a700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f9a70066500 0x7f9a700689c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a880ad000 tx=0x7f9a88008040 comp rx=0 tx=0).stop 2024-01-30T08:10:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c3df0 msgr2=0x7f9a9814eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 --2- 172.21.15.50:0/4040359043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a980c3df0 0x7f9a9814eee0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000efc0 tx=0x7f9a9000c490 comp rx=0 tx=0).stop 2024-01-30T08:10:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9cc00640 1 -- 172.21.15.50:0/4040359043 reap_dead start 2024-01-30T08:10:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 shutdown_connections 2024-01-30T08:10:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 >> 172.21.15.50:0/4040359043 conn(0x7f9a980c5bb0 msgr2=0x7f9a980a6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 shutdown_connections 2024-01-30T08:10:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.711+0000 7f9a9ec00640 1 -- 172.21.15.50:0/4040359043 wait complete. 2024-01-30T08:10:54.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-30T08:10:54.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7ba6400640 1 Processor -- start 2024-01-30T08:10:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7ba6400640 1 -- start start 2024-01-30T08:10:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7ba6400640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ba00c4280 0x7f7ba00bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7ba6400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ba00c5540 0x7f7ba00bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7ba6400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba0154aa0 con 0x7f7ba0154490 2024-01-30T08:10:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7ba6400640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba0154870 con 0x7f7ba00c4280 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7ba6400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba0154cf0 con 0x7f7ba00c5540 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ba00c4280 0x7f7ba00bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9ea00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ba00c4280 0x7f7ba00bb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42532/0 (socket says 172.21.15.50:42532) 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9ea00640 1 -- 172.21.15.50:0/4077849994 learned_addr learned my addr 172.21.15.50:0/4077849994 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9fe00640 1 --2- 172.21.15.50:0/4077849994 >> v2:172.21.15.125:3300/0 conn(0x7f7ba00c5540 0x7f7ba00bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9ea00640 1 -- 172.21.15.50:0/4077849994 >> v2:172.21.15.125:3300/0 conn(0x7f7ba00c5540 msgr2=0x7f7ba00bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9ea00640 1 --2- 172.21.15.50:0/4077849994 >> v2:172.21.15.125:3300/0 conn(0x7f7ba00c5540 0x7f7ba00bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9ea00640 1 -- 172.21.15.50:0/4077849994 >> v1:172.21.15.125:6789/0 conn(0x7f7ba0154490 legacy=0x7f7ba006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.871+0000 7f7b9ea00640 1 -- 172.21.15.50:0/4077849994 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba0154fd0 con 0x7f7ba00c4280 2024-01-30T08:10:54.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7b9ea00640 1 --2- 172.21.15.50:0/4077849994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba00bb820 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00c0ec0 tx=0x7f7b8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a58623c18049ef server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7b9e000640 1 -- 172.21.15.50:0/4077849994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880aa5f0 con 0x7f7ba00c4280 2024-01-30T08:10:54.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7b9e000640 1 -- 172.21.15.50:0/4077849994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b880aa750 con 0x7f7ba00c4280 2024-01-30T08:10:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7b9e000640 1 -- 172.21.15.50:0/4077849994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880aaae0 con 0x7f7ba00c4280 2024-01-30T08:10:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7ba6400640 1 -- 172.21.15.50:0/4077849994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 msgr2=0x7f7ba00bb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7ba6400640 1 --2- 172.21.15.50:0/4077849994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba00bb820 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00c0ec0 tx=0x7f7b8801c490 comp rx=0 tx=0).stop 2024-01-30T08:10:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7ba6400640 1 -- 172.21.15.50:0/4077849994 shutdown_connections 2024-01-30T08:10:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7ba6400640 1 --2- 172.21.15.50:0/4077849994 >> v2:172.21.15.125:3300/0 conn(0x7f7ba00c5540 0x7f7ba00bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7ba6400640 1 --2- 172.21.15.50:0/4077849994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba00bb820 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.875+0000 7f7ba6400640 1 -- 172.21.15.50:0/4077849994 >> 172.21.15.50:0/4077849994 conn(0x7f7ba00c5f10 msgr2=0x7f7ba00c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 -- 172.21.15.50:0/4077849994 shutdown_connections 2024-01-30T08:10:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 -- 172.21.15.50:0/4077849994 wait complete. 2024-01-30T08:10:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 Processor -- start 2024-01-30T08:10:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 -- start start 2024-01-30T08:10:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba01422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ba00c5540 0x7f7ba01427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ba0154490 0x7f7ba014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00bdd70 con 0x7f7ba00c4280 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0150c30 con 0x7f7ba00c5540 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7ba6400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00bf790 con 0x7f7ba0154490 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba01422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba01422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42534/0 (socket says 172.21.15.50:42534) 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 -- 172.21.15.50:0/3295403287 learned_addr learned my addr 172.21.15.50:0/3295403287 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9ea00640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ba00c5540 0x7f7ba01427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9fe00640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ba0154490 0x7f7ba014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 -- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ba0154490 msgr2=0x7f7ba014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ba0154490 0x7f7ba014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 -- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ba00c5540 msgr2=0x7f7ba01427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ba00c5540 0x7f7ba01427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 -- 172.21.15.50:0/3295403287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880094d0 con 0x7f7ba00c4280 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b9f400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba01422a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b410 tx=0x7f7b9000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.879+0000 7f7b97400640 1 -- 172.21.15.50:0/3295403287 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90004020 con 0x7f7ba00c4280 2024-01-30T08:10:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba014f580 con 0x7f7ba00c4280 2024-01-30T08:10:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7b97400640 1 -- 172.21.15.50:0/3295403287 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b90004180 con 0x7f7ba00c4280 2024-01-30T08:10:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7b97400640 1 -- 172.21.15.50:0/3295403287 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90011630 con 0x7f7ba00c4280 2024-01-30T08:10:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba014fb40 con 0x7f7ba00c4280 2024-01-30T08:10:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba004ead0 con 0x7f7ba00c4280 2024-01-30T08:10:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7b97400640 1 -- 172.21.15.50:0/3295403287 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7b90011790 con 0x7f7ba00c4280 2024-01-30T08:10:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7b97400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b78066500 0x7f7b780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7b97400640 1 -- 172.21.15.50:0/3295403287 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7b90083940 con 0x7f7ba00c4280 2024-01-30T08:10:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7b9ea00640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b78066500 0x7f7b780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.883+0000 7f7b9ea00640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b78066500 0x7f7b780689c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7b880ae000 tx=0x7f7b880b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:54.887+0000 7f7b97400640 1 -- 172.21.15.50:0/3295403287 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7b90050e00 con 0x7f7ba00c4280 2024-01-30T08:10:55.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.047+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ba015e5f0 con 0x7f7b78066500 2024-01-30T08:10:55.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.047+0000 7f7b97400640 1 -- 172.21.15.50:0/3295403287 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b880aa8c0 con 0x7f7b78066500 2024-01-30T08:10:55.053 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2024-01-30T08:10:55.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b78066500 msgr2=0x7f7b780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b78066500 0x7f7b780689c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7b880ae000 tx=0x7f7b880b5040 comp rx=0 tx=0).stop 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 msgr2=0x7f7ba01422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba01422a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b410 tx=0x7f7b9000b8d0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 shutdown_connections 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ba00c5540 0x7f7ba01427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f7b78066500 0x7f7b780689c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ba0154490 0x7f7ba014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 --2- 172.21.15.50:0/3295403287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba00c4280 0x7f7ba01422a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 >> 172.21.15.50:0/3295403287 conn(0x7f7ba00c5f10 msgr2=0x7f7ba00bb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:55.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 shutdown_connections 2024-01-30T08:10:55.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.051+0000 7f7ba6400640 1 -- 172.21.15.50:0/3295403287 wait complete. 2024-01-30T08:10:55.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:10:55.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.211+0000 7f625e800640 1 Processor -- start 2024-01-30T08:10:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f625e800640 1 -- start start 2024-01-30T08:10:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f625e800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62580c1840 0x7f62580a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f625e800640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62580c5650 0x7f62580a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:55.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f625e800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62580a8cf0 con 0x7f62580c4760 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f625e800640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6258072a30 con 0x7f62580c5650 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f625e800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62580a8f40 con 0x7f62580c1840 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6256a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62580c5650 0x7f62580a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6256a00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62580c5650 0x7f62580a5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42550/0 (socket says 172.21.15.50:42550) 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6256a00640 1 -- 172.21.15.50:0/3052112743 learned_addr learned my addr 172.21.15.50:0/3052112743 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6257400640 1 --2- 172.21.15.50:0/3052112743 >> v2:172.21.15.125:3300/0 conn(0x7f62580c1840 0x7f62580a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6256a00640 1 -- 172.21.15.50:0/3052112743 >> v2:172.21.15.125:3300/0 conn(0x7f62580c1840 msgr2=0x7f62580a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:10:55.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6256a00640 1 --2- 172.21.15.50:0/3052112743 >> v2:172.21.15.125:3300/0 conn(0x7f62580c1840 0x7f62580a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6256a00640 1 -- 172.21.15.50:0/3052112743 >> v1:172.21.15.125:6789/0 conn(0x7f62580c4760 legacy=0x7f625806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.215+0000 7f6256a00640 1 -- 172.21.15.50:0/3052112743 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258072cd0 con 0x7f62580c5650 2024-01-30T08:10:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f6256a00640 1 --2- 172.21.15.50:0/3052112743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c5650 0x7f62580a5290 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f625806b770 tx=0x7f624001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40902c54708f584 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f6256000640 1 -- 172.21.15.50:0/3052112743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400ad680 con 0x7f62580c5650 2024-01-30T08:10:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f6256000640 1 -- 172.21.15.50:0/3052112743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62400ad7e0 con 0x7f62580c5650 2024-01-30T08:10:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f6256000640 1 -- 172.21.15.50:0/3052112743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400adb70 con 0x7f62580c5650 2024-01-30T08:10:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 -- 172.21.15.50:0/3052112743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c5650 msgr2=0x7f62580a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 --2- 172.21.15.50:0/3052112743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c5650 0x7f62580a5290 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f625806b770 tx=0x7f624001c3e0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 -- 172.21.15.50:0/3052112743 shutdown_connections 2024-01-30T08:10:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 --2- 172.21.15.50:0/3052112743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c5650 0x7f62580a5290 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 --2- 172.21.15.50:0/3052112743 >> v2:172.21.15.125:3300/0 conn(0x7f62580c1840 0x7f62580a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 -- 172.21.15.50:0/3052112743 >> 172.21.15.50:0/3052112743 conn(0x7f62580c5b50 msgr2=0x7f62580c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 -- 172.21.15.50:0/3052112743 shutdown_connections 2024-01-30T08:10:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 -- 172.21.15.50:0/3052112743 wait complete. 2024-01-30T08:10:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 Processor -- start 2024-01-30T08:10:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.219+0000 7f625e800640 1 -- start start 2024-01-30T08:10:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62580c1840 0x7f6258157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c4760 0x7f6258152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62580c5650 0x7f6258151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258156e60 con 0x7f62580c4760 2024-01-30T08:10:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258156b80 con 0x7f62580c1840 2024-01-30T08:10:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6258158600 con 0x7f62580c5650 2024-01-30T08:10:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c4760 0x7f6258152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c4760 0x7f6258152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42554/0 (socket says 172.21.15.50:42554) 2024-01-30T08:10:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 -- 172.21.15.50:0/1133141990 learned_addr learned my addr 172.21.15.50:0/1133141990 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:10:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6257e00640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62580c5650 0x7f6258151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6257400640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62580c1840 0x7f6258157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 -- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62580c5650 msgr2=0x7f6258151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62580c5650 0x7f6258151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 -- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62580c1840 msgr2=0x7f6258157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62580c1840 0x7f6258157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 -- 172.21.15.50:0/1133141990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400094d0 con 0x7f62580c4760 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f6256a00640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c4760 0x7f6258152c20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f624001a010 tx=0x7f6240019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f624f400640 1 -- 172.21.15.50:0/1133141990 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400ade60 con 0x7f62580c4760 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f624f400640 1 -- 172.21.15.50:0/1133141990 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62400b6460 con 0x7f62580c4760 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f624f400640 1 -- 172.21.15.50:0/1133141990 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400b67f0 con 0x7f62580c4760 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62581588e0 con 0x7f62580c4760 2024-01-30T08:10:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6258153160 con 0x7f62580c4760 2024-01-30T08:10:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.223+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6258158460 con 0x7f62580c4760 2024-01-30T08:10:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.227+0000 7f624f400640 1 -- 172.21.15.50:0/1133141990 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f62400b4070 con 0x7f62580c4760 2024-01-30T08:10:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.227+0000 7f624f400640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6230066530 0x7f62300689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:10:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.227+0000 7f624f400640 1 -- 172.21.15.50:0/1133141990 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f624011e160 con 0x7f62580c4760 2024-01-30T08:10:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.227+0000 7f6257400640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6230066530 0x7f62300689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:10:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.227+0000 7f6257400640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6230066530 0x7f62300689f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f624800b930 tx=0x7f6248008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:10:55.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.231+0000 7f624f400640 1 -- 172.21.15.50:0/1133141990 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6258158460 con 0x7f62580c4760 2024-01-30T08:10:55.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.387+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f625815bb30 con 0x7f6230066530 2024-01-30T08:10:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f624f400640 1 -- 172.21.15.50:0/1133141990 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50618 (secure 0 0 0) 0x7f625815bb30 con 0x7f6230066530 2024-01-30T08:10:55.395 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:10:55.395 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6230066530 msgr2=0x7f62300689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6230066530 0x7f62300689f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f624800b930 tx=0x7f6248008040 comp rx=0 tx=0).stop 2024-01-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c4760 msgr2=0x7f6258152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c4760 0x7f6258152c20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f624001a010 tx=0x7f6240019180 comp rx=0 tx=0).stop 2024-01-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 shutdown_connections 2024-01-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f6230066530 0x7f62300689f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62580c5650 0x7f6258151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62580c4760 0x7f6258152c20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 --2- 172.21.15.50:0/1133141990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62580c1840 0x7f6258157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 >> 172.21.15.50:0/1133141990 conn(0x7f62580c5b50 msgr2=0x7f625815b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 shutdown_connections 2024-01-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:10:55.391+0000 7f625e800640 1 -- 172.21.15.50:0/1133141990 wait complete. 2024-01-30T08:10:55.416 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-01-30T08:10:55.084707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":241872,"kb_used_data":4896,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732848,"statfs":{"total":773094113280,"available":772846436352,"internally_reserved":0,"allocated":5013504,"data_stored":3394528,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.553655"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-30T08:10:47.125109+0000","last_change":"2024-01-30T08:08:36.906616+0000","last_active":"2024-01-30T08:10:47.125109+0000","last_peered":"2024-01-30T08:10:47.125109+0000","last_clean":"2024-01-30T08:10:47.125109+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:47.125109+0000","last_undegraded":"2024-01-30T08:10:47.125109+0000","last_fullsized":"2024-01-30T08:10:47.125109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-30T08:08:35.843425+0000","last_clean_scrub_stamp":"2024-01-30T08:08:35.843425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T10:06:25.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":867092,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.92700000000000005,"15min":0.96699999999999997},"min":{"1min":0.51800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.82299999999999995,"15min":0.85299999999999998},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.80100000000000005}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.542,"15min":1.542},"last":0.88},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.86899999999999999}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":0.81499999999999995},"min":{"1min":0.50700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0349999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.94399999999999995,"15min":0.97999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92200000000000004,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.93300000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.997}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.754},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.90100000000000002}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.95999999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.89500000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88700000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.52600000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.874},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84099999999999997,"15min":0.86799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0980000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.016},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68100000000000005,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.80200000000000005},"min":{"1min":0.52900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.753,"15min":0.752},"min":{"1min":0.53300000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.077,"5min":1.159,"15min":1.159},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.995}]}]},{"osd":4,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.624,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78700000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.755}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67800000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.502}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2250000000000001,"5min":1.387,"15min":1.387},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.56200000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57199999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56200000000000006,"5min":1.137,"15min":1.137},"last":0.437},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.58099999999999996,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.63500000000000001,"15min":0.67500000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52600000000000002,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55100000000000005,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.69099999999999995,"15min":0.72699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64400000000000002,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.86299999999999999,"15min":0.88800000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.878,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.755}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.63100000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89500000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94899999999999995,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91200000000000003,"5min":1.097,"15min":1.097},"last":0.67800000000000005}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":1.288,"15min":1.288},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.63700000000000001,"5min":0.625,"15min":0.625},"max":{"1min":1.01,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.70999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63600000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1020000000000001,"5min":1.121,"15min":1.121},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.044,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.66100000000000003}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98399999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59899999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.52800000000000002,"15min":0.54900000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55700000000000005,"5min":2.657,"15min":2.657},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.57199999999999995,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66900000000000004,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.626,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.46300000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.67000000000000004,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.626,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.57999999999999996}]},{"osd":4,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96099999999999997,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.51,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.69299999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96899999999999997,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98199999999999998,"5min":1.639,"15min":1.639},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.95099999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.409,"5min":5.383,"15min":5.383},"last":0.623}]},{"osd":7,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0049999999999999,"5min":1.79,"15min":1.79},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.6989999999999998,"5min":4.6989999999999998,"15min":4.6989999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.71599999999999997,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.436,"15min":0.436},"max":{"1min":6.3719999999999999,"5min":6.3719999999999999,"15min":6.3719999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.1859999999999999,"5min":7.1859999999999999,"15min":7.1859999999999999},"last":0.621}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.1639999999999997,"5min":6.1639999999999997,"15min":6.1639999999999997},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.748,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":6.1180000000000003,"5min":6.1180000000000003,"15min":6.1180000000000003},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.749},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73699999999999999,"15min":0.71999999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.79800000000000004}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":867092,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.437,"15min":0.435},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.31}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.67400000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.33800000000000002}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.35599999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1080000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.629}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.153,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.079,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.149,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.405,"15min":1.405},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:10:55.420 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-30T08:08:35.843425+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=30, tm_hour=8, tm_min=8, tm_sec=35, tm_wday=1, tm_yday=30, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=49, tm_wday=1, tm_yday=30, tm_isdst=0) 2024-01-30T08:10:55.420 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-30T08:11:15.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-30T08:11:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd9400640 1 Processor -- start 2024-01-30T08:11:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd9400640 1 -- start start 2024-01-30T08:11:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd9400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd414fbf0 0x7fbbd41559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd9400640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40c3ed0 con 0x7fbbd40c1de0 2024-01-30T08:11:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd9400640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd406bca0 con 0x7fbbd40c0ee0 2024-01-30T08:11:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd9400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40a5520 con 0x7fbbd414fbf0 2024-01-30T08:11:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd3200640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbbd40c1de0 0x7fbbd406a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59926/0 (socket says 172.21.15.50:59926) 2024-01-30T08:11:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd3200640 1 -- 172.21.15.50:0/4125624803 learned_addr learned my addr 172.21.15.50:0/4125624803 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:11:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd2800640 1 --2- 172.21.15.50:0/4125624803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd414fbf0 0x7fbbd41559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd1400640 1 -- 172.21.15.50:0/4125624803 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442955063 0 0) 0x7fbbd40c3ed0 con 0x7fbbd40c1de0 2024-01-30T08:11:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd1400640 1 -- 172.21.15.50:0/4125624803 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb4003530 con 0x7fbbd40c1de0 2024-01-30T08:11:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd2800640 1 -- 172.21.15.50:0/4125624803 >> v1:172.21.15.125:6789/0 conn(0x7fbbd40c0ee0 legacy=0x7fbbd40a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd1400640 1 -- 172.21.15.50:0/4125624803 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303288347 0 0) 0x7fbbd406bca0 con 0x7fbbd40c0ee0 2024-01-30T08:11:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd2800640 1 -- 172.21.15.50:0/4125624803 >> v1:172.21.15.50:6789/0 conn(0x7fbbd40c1de0 legacy=0x7fbbd406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.571+0000 7fbbd2800640 1 -- 172.21.15.50:0/4125624803 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd406bef0 con 0x7fbbd414fbf0 2024-01-30T08:11:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd2800640 1 --2- 172.21.15.50:0/4125624803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd414fbf0 0x7fbbd41559c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40097f0 tx=0x7fbbc401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18f80303213c04c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd1400640 1 -- 172.21.15.50:0/4125624803 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40ac620 con 0x7fbbd414fbf0 2024-01-30T08:11:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd1400640 1 -- 172.21.15.50:0/4125624803 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40ac780 con 0x7fbbd414fbf0 2024-01-30T08:11:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd1400640 1 -- 172.21.15.50:0/4125624803 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40acb10 con 0x7fbbd414fbf0 2024-01-30T08:11:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd9400640 1 -- 172.21.15.50:0/4125624803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd414fbf0 msgr2=0x7fbbd41559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd9400640 1 --2- 172.21.15.50:0/4125624803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd414fbf0 0x7fbbd41559c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40097f0 tx=0x7fbbc401c3a0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd9400640 1 -- 172.21.15.50:0/4125624803 shutdown_connections 2024-01-30T08:11:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd9400640 1 --2- 172.21.15.50:0/4125624803 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd414fbf0 0x7fbbd41559c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd9400640 1 -- 172.21.15.50:0/4125624803 >> 172.21.15.50:0/4125624803 conn(0x7fbbd40c5b50 msgr2=0x7fbbd40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:11:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.575+0000 7fbbd9400640 1 -- 172.21.15.50:0/4125624803 shutdown_connections 2024-01-30T08:11:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 -- 172.21.15.50:0/4125624803 wait complete. 2024-01-30T08:11:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 Processor -- start 2024-01-30T08:11:15.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 -- start start 2024-01-30T08:11:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd40c0ee0 0x7fbbd4152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbd40c1de0 0x7fbbd415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbd414fbf0 0x7fbbd4150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4152950 con 0x7fbbd40c1de0 2024-01-30T08:11:15.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd41edcf0 con 0x7fbbd414fbf0 2024-01-30T08:11:15.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd9400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd41ed0e0 con 0x7fbbd40c0ee0 2024-01-30T08:11:15.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbd40c1de0 0x7fbbd415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbd40c1de0 0x7fbbd415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54098/0 (socket says 172.21.15.50:54098) 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 -- 172.21.15.50:0/3503183580 learned_addr learned my addr 172.21.15.50:0/3503183580 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd3200640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbd414fbf0 0x7fbbd4150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd2800640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd40c0ee0 0x7fbbd4152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 -- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd40c0ee0 msgr2=0x7fbbd4152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd40c0ee0 0x7fbbd4152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 -- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbd414fbf0 msgr2=0x7fbbd4150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbd414fbf0 0x7fbbd4150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 -- 172.21.15.50:0/3503183580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4009420 con 0x7fbbd40c1de0 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.579+0000 7fbbd1e00640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbd40c1de0 0x7fbbd415c9b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c410 tx=0x7fbbbc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbcaa00640 1 -- 172.21.15.50:0/3503183580 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0054e0 con 0x7fbbd40c1de0 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbcaa00640 1 -- 172.21.15.50:0/3503183580 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc003600 con 0x7fbbd40c1de0 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbcaa00640 1 -- 172.21.15.50:0/3503183580 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0039b0 con 0x7fbbd40c1de0 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd41ed3c0 con 0x7fbbd40c1de0 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd41ed980 con 0x7fbbd40c1de0 2024-01-30T08:11:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd40a5af0 con 0x7fbbd40c1de0 2024-01-30T08:11:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbcaa00640 1 -- 172.21.15.50:0/3503183580 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbbbc003b10 con 0x7fbbd40c1de0 2024-01-30T08:11:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbcaa00640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbbac066530 0x7fbbac0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.583+0000 7fbbcaa00640 1 -- 172.21.15.50:0/3503183580 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fbbbc083210 con 0x7fbbd40c1de0 2024-01-30T08:11:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.587+0000 7fbbd2800640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbbac066530 0x7fbbac0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.587+0000 7fbbd2800640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbbac066530 0x7fbbac0689f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40ae000 tx=0x7fbbc40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.591+0000 7fbbcaa00640 1 -- 172.21.15.50:0/3503183580 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbbd40a5af0 con 0x7fbbd40c1de0 2024-01-30T08:11:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.743+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 --> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbd4160560 con 0x7fbbac066530 2024-01-30T08:11:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbcaa00640 1 -- 172.21.15.50:0/3503183580 <== mgr.4106 v2:172.21.15.125:6832/2956883845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50562 (secure 0 0 0) 0x7fbbc40ac600 con 0x7fbbac066530 2024-01-30T08:11:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:11:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-01-30T08:11:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbbac066530 msgr2=0x7fbbac0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbbac066530 0x7fbbac0689f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40ae000 tx=0x7fbbc40a7000 comp rx=0 tx=0).stop 2024-01-30T08:11:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbd40c1de0 msgr2=0x7fbbd415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbd40c1de0 0x7fbbd415c9b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c410 tx=0x7fbbbc00c8d0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 shutdown_connections 2024-01-30T08:11:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbd414fbf0 0x7fbbd4150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fbbac066530 0x7fbbac0689f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbd40c1de0 0x7fbbd415c9b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 --2- 172.21.15.50:0/3503183580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbd40c0ee0 0x7fbbd4152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 >> 172.21.15.50:0/3503183580 conn(0x7fbbd40c5b50 msgr2=0x7fbbd406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:11:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 shutdown_connections 2024-01-30T08:11:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.751+0000 7fbbd9400640 1 -- 172.21.15.50:0/3503183580 wait complete. 2024-01-30T08:11:15.774 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-01-30T08:11:15.088328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":241856,"kb_used_data":4896,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732864,"statfs":{"total":773094113280,"available":772846452736,"internally_reserved":0,"allocated":5013504,"data_stored":3394528,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002063"},"pg_stats":[{"pgid":"1.0","version":"51'119","reported_seq":238,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-30T08:10:55.769971+0000","last_change":"2024-01-30T08:10:55.770013+0000","last_active":"2024-01-30T08:10:55.769971+0000","last_peered":"2024-01-30T08:10:55.769971+0000","last_clean":"2024-01-30T08:10:55.769971+0000","last_became_active":"2024-01-30T08:08:36.905224+0000","last_became_peered":"2024-01-30T08:08:36.905224+0000","last_unstale":"2024-01-30T08:10:55.769971+0000","last_undegraded":"2024-01-30T08:10:55.769971+0000","last_fullsized":"2024-01-30T08:10:55.769971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'119","last_scrub_stamp":"2024-01-30T08:10:55.769880+0000","last_deep_scrub":"51'119","last_deep_scrub_stamp":"2024-01-30T08:10:55.769880+0000","last_clean_scrub_stamp":"2024-01-30T08:10:55.769880+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-31T12:40:26.540434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66746,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":675840,"data_stored":867092,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.92700000000000005,"15min":0.96699999999999997},"min":{"1min":0.51800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.82299999999999995,"15min":0.85299999999999998},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.623}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.542,"15min":1.542},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.68200000000000005}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":0.81499999999999995},"min":{"1min":0.50700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.88500000000000001,"15min":0.90900000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.73099999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0349999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.94399999999999995,"15min":0.97999999999999998},"min":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92200000000000004,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.59799999999999998}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70499999999999996}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.748},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.64500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.78000000000000003}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88700000000000001,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84099999999999997,"15min":0.86799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0980000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.752},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.016},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.628},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68100000000000005,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.80200000000000005},"min":{"1min":0.52900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.753,"15min":0.752},"min":{"1min":0.53300000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.077,"5min":1.159,"15min":1.159},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.624,"15min":0.629},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77700000000000002}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68200000000000005}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79300000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69299999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2250000000000001,"5min":1.387,"15min":1.387},"last":0.432},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.56200000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.54700000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56200000000000006,"5min":1.137,"15min":1.137},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.58099999999999996,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.63500000000000001,"15min":0.67500000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52600000000000002,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55100000000000005,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.626}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.69099999999999995,"15min":0.72699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64400000000000002,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.747}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.86299999999999999,"15min":0.88800000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.878,"5min":3.9740000000000002,"15min":3.9740000000000002},"last":0.95499999999999996}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.878,"5min":1.097,"15min":1.097},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.63100000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89500000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.089}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94899999999999995,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91200000000000003,"5min":1.097,"15min":1.097},"last":1.0669999999999999}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":1.288,"15min":1.288},"last":1.042},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.63700000000000001,"5min":0.625,"15min":0.625},"max":{"1min":1.01,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.91400000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.439}]},{"osd":1,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63600000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.377},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1020000000000001,"5min":1.121,"15min":1.121},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.044,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":0.629},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98399999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.52800000000000002,"15min":0.54900000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55700000000000005,"5min":2.657,"15min":2.657},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.57199999999999995,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66900000000000004,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.626,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":0.48299999999999998}]},{"osd":3,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.67000000000000004,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.34899999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.626,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96099999999999997,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.51,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":0.747}]},{"osd":5,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96899999999999997,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.83499999999999996}]},{"osd":6,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98199999999999998,"5min":1.639,"15min":1.639},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.95099999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.409,"5min":5.383,"15min":5.383},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Jan 30 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0049999999999999,"5min":1.79,"15min":1.79},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":276724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 30 08:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.68899999999999995}]},{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.6989999999999998,"5min":4.6989999999999998,"15min":4.6989999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.71599999999999997,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.436,"15min":0.436},"max":{"1min":6.3719999999999999,"5min":6.3719999999999999,"15min":6.3719999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.1859999999999999,"5min":7.1859999999999999,"15min":7.1859999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.75},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.1639999999999997,"5min":6.1639999999999997,"15min":6.1639999999999997},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.748,"15min":0.71199999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":6.1180000000000003,"5min":6.1180000000000003,"15min":6.1180000000000003},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.58599999999999997}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73699999999999999,"15min":0.71999999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.51800000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.78600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":675840,"data_stored":867092,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.437,"15min":0.435},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.67400000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70099999999999996}]},{"osd":4,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1080000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.153,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99299999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.079,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Tue Jan 30 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.149,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.405,"15min":1.405},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33373,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-30T08:11:15.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-30T08:11:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd748800640 1 Processor -- start 2024-01-30T08:11:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd748800640 1 -- start start 2024-01-30T08:11:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd748800640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd740155500 0x7fd7400c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd748800640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd740158b70 con 0x7fd74006f6d0 2024-01-30T08:11:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd748800640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd740157f60 con 0x7fd74006f240 2024-01-30T08:11:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd748800640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74006fae0 con 0x7fd740155500 2024-01-30T08:11:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd746800640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd74006f6d0 0x7fd7400c1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59934/0 (socket says 172.21.15.50:59934) 2024-01-30T08:11:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd746800640 1 -- 172.21.15.50:0/403698138 learned_addr learned my addr 172.21.15.50:0/403698138 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-01-30T08:11:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd745e00640 1 --2- 172.21.15.50:0/403698138 >> v2:172.21.15.125:3300/0 conn(0x7fd740155500 0x7fd7400c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd744a00640 1 -- 172.21.15.50:0/403698138 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402412727 0 0) 0x7fd740158b70 con 0x7fd74006f6d0 2024-01-30T08:11:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd744a00640 1 -- 172.21.15.50:0/403698138 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd720003530 con 0x7fd74006f6d0 2024-01-30T08:11:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd744a00640 1 -- 172.21.15.50:0/403698138 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290063007 0 0) 0x7fd740157f60 con 0x7fd74006f240 2024-01-30T08:11:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd744a00640 1 -- 172.21.15.50:0/403698138 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd740158b70 con 0x7fd74006f240 2024-01-30T08:11:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd745e00640 1 -- 172.21.15.50:0/403698138 >> v1:172.21.15.125:6789/0 conn(0x7fd74006f240 legacy=0x7fd7400c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd745e00640 1 -- 172.21.15.50:0/403698138 >> v1:172.21.15.50:6789/0 conn(0x7fd74006f6d0 legacy=0x7fd7400c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.911+0000 7fd745e00640 1 -- 172.21.15.50:0/403698138 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740158240 con 0x7fd740155500 2024-01-30T08:11:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd745e00640 1 --2- 172.21.15.50:0/403698138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 0x7fd7400c85e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd74006fc20 tx=0x7fd73001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beca0bd90a7a8a44 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd744a00640 1 -- 172.21.15.50:0/403698138 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300ab600 con 0x7fd740155500 2024-01-30T08:11:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd744a00640 1 -- 172.21.15.50:0/403698138 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7300a7050 con 0x7fd740155500 2024-01-30T08:11:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd744a00640 1 -- 172.21.15.50:0/403698138 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300ab980 con 0x7fd740155500 2024-01-30T08:11:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd748800640 1 -- 172.21.15.50:0/403698138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 msgr2=0x7fd7400c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd748800640 1 --2- 172.21.15.50:0/403698138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 0x7fd7400c85e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd74006fc20 tx=0x7fd73001c330 comp rx=0 tx=0).stop 2024-01-30T08:11:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd748800640 1 -- 172.21.15.50:0/403698138 shutdown_connections 2024-01-30T08:11:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd748800640 1 --2- 172.21.15.50:0/403698138 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 0x7fd7400c85e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd748800640 1 -- 172.21.15.50:0/403698138 >> 172.21.15.50:0/403698138 conn(0x7fd7400727c0 msgr2=0x7fd74006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:11:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd748800640 1 -- 172.21.15.50:0/403698138 shutdown_connections 2024-01-30T08:11:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.915+0000 7fd748800640 1 -- 172.21.15.50:0/403698138 wait complete. 2024-01-30T08:11:15.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 Processor -- start 2024-01-30T08:11:15.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 -- start start 2024-01-30T08:11:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74006f240 0x7fd7400c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd74006f6d0 0x7fd7401ecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 0x7fd7401ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74015cb40 con 0x7fd74006f240 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7401f0d20 con 0x7fd740155500 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400aa890 con 0x7fd74006f6d0 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74006f240 0x7fd7400c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74006f240 0x7fd7400c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54110/0 (socket says 172.21.15.50:54110) 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 -- 172.21.15.50:0/2572533836 learned_addr learned my addr 172.21.15.50:0/2572533836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd746800640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 0x7fd7401ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745400640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd74006f6d0 0x7fd7401ecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 -- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd74006f6d0 msgr2=0x7fd7401ecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd74006f6d0 0x7fd7401ecbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 -- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 msgr2=0x7fd7401ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 0x7fd7401ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 -- 172.21.15.50:0/2572533836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd730009420 con 0x7fd74006f240 2024-01-30T08:11:15.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd745e00640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74006f240 0x7fd7400c1460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd73001c810 tx=0x7fd7300190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:15.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300abe50 con 0x7fd74006f240 2024-01-30T08:11:15.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730004030 con 0x7fd74006f240 2024-01-30T08:11:15.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300043c0 con 0x7fd74006f240 2024-01-30T08:11:15.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7401f0110 con 0x7fd74006f240 2024-01-30T08:11:15.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.919+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7401f06d0 con 0x7fd74006f240 2024-01-30T08:11:15.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.923+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740074a20 con 0x7fd74006f240 2024-01-30T08:11:15.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.923+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd7300b2040 con 0x7fd74006f240 2024-01-30T08:11:15.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.923+0000 7fd73e000640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd718066500 0x7fd7180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:15.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.923+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd73011da70 con 0x7fd74006f240 2024-01-30T08:11:15.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.923+0000 7fd745400640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd718066500 0x7fd7180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:15.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.923+0000 7fd745400640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd718066500 0x7fd7180689c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd74006fe00 tx=0x7fd728009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:15.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:15.927+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd7300eaf10 con 0x7fd74006f240 2024-01-30T08:11:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.087+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd7400c83c0 con 0x7fd74006f240 2024-01-30T08:11:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.091+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd7300b00c0 con 0x7fd74006f240 2024-01-30T08:11:16.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.091+0000 7fd73e000640 1 -- 172.21.15.50:0/2572533836 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd730004520 con 0x7fd74006f240 2024-01-30T08:11:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd718066500 msgr2=0x7fd7180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd718066500 0x7fd7180689c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd74006fe00 tx=0x7fd728009040 comp rx=0 tx=0).stop 2024-01-30T08:11:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74006f240 msgr2=0x7fd7400c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74006f240 0x7fd7400c1460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd73001c810 tx=0x7fd7300190d0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 shutdown_connections 2024-01-30T08:11:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd740155500 0x7fd7401ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7fd718066500 0x7fd7180689c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd74006f6d0 0x7fd7401ecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 --2- 172.21.15.50:0/2572533836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74006f240 0x7fd7400c1460 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 >> 172.21.15.50:0/2572533836 conn(0x7fd7400727c0 msgr2=0x7fd7400acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:11:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 shutdown_connections 2024-01-30T08:11:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.095+0000 7fd748800640 1 -- 172.21.15.50:0/2572533836 wait complete. 2024-01-30T08:11:16.118 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-30T08:11:16.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-30T08:11:16.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f040c000640 1 Processor -- start 2024-01-30T08:11:16.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f040c000640 1 -- start start 2024-01-30T08:11:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f040c000640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04040a4e50 0x7f04040729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f040c000640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04040c3e40 con 0x7f04040c4e00 2024-01-30T08:11:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f040c000640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04040a8c20 con 0x7f0404158a00 2024-01-30T08:11:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f040c000640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04040c42d0 con 0x7f04040a4e50 2024-01-30T08:11:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f0408c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04040a4e50 0x7f04040729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f0408c00640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04040a4e50 0x7f04040729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54124/0 (socket says 172.21.15.50:54124) 2024-01-30T08:11:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f0408c00640 1 -- 172.21.15.50:0/1234953810 learned_addr learned my addr 172.21.15.50:0/1234953810 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:11:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.255+0000 7f0409600640 1 --1- 172.21.15.50:0/1234953810 >> v1:172.21.15.50:6789/0 conn(0x7f04040c4e00 0x7f04040a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59942/0 (socket says 172.21.15.50:59942) 2024-01-30T08:11:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.259+0000 7f0408c00640 1 -- 172.21.15.50:0/1234953810 >> v1:172.21.15.125:6789/0 conn(0x7f0404158a00 legacy=0x7f040415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-30T08:11:16.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.259+0000 7f0408c00640 1 -- 172.21.15.50:0/1234953810 >> v1:172.21.15.50:6789/0 conn(0x7f04040c4e00 legacy=0x7f04040a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.259+0000 7f0408c00640 1 -- 172.21.15.50:0/1234953810 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040c3b10 con 0x7f04040a4e50 2024-01-30T08:11:16.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.259+0000 7f0408c00640 1 --2- 172.21.15.50:0/1234953810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040a4e50 0x7f04040729a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00bb20 tx=0x7f03ec01e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb083c332738225 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:16.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.259+0000 7f0403e00640 1 -- 172.21.15.50:0/1234953810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec004230 con 0x7f04040a4e50 2024-01-30T08:11:16.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.259+0000 7f0403e00640 1 -- 172.21.15.50:0/1234953810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03ec0ab070 con 0x7f04040a4e50 2024-01-30T08:11:16.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.259+0000 7f0403e00640 1 -- 172.21.15.50:0/1234953810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0a7770 con 0x7f04040a4e50 2024-01-30T08:11:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- 172.21.15.50:0/1234953810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040a4e50 msgr2=0x7f04040729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 --2- 172.21.15.50:0/1234953810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040a4e50 0x7f04040729a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00bb20 tx=0x7f03ec01e960 comp rx=0 tx=0).stop 2024-01-30T08:11:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- 172.21.15.50:0/1234953810 shutdown_connections 2024-01-30T08:11:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 --2- 172.21.15.50:0/1234953810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040a4e50 0x7f04040729a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- 172.21.15.50:0/1234953810 >> 172.21.15.50:0/1234953810 conn(0x7f04040c5b50 msgr2=0x7f04040c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:11:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- 172.21.15.50:0/1234953810 shutdown_connections 2024-01-30T08:11:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- 172.21.15.50:0/1234953810 wait complete. 2024-01-30T08:11:16.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 Processor -- start 2024-01-30T08:11:16.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- start start 2024-01-30T08:11:16.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04040a4e50 0x7f040406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:16.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040c4e00 0x7f04041e3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0404158a00 0x7f04041ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04041f0ca0 con 0x7f04040c4e00 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04041f1190 con 0x7f0404158a00 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040c000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040414eb40 con 0x7f04040a4e50 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f0408c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040c4e00 0x7f04041e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f0408c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040c4e00 0x7f04041e3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54136/0 (socket says 172.21.15.50:54136) 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f0408c00640 1 -- 172.21.15.50:0/4273112796 learned_addr learned my addr 172.21.15.50:0/4273112796 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f040a000640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0404158a00 0x7f04041ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f0409600640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04040a4e50 0x7f040406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.263+0000 7f0408c00640 1 -- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04040a4e50 msgr2=0x7f040406daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0408c00640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04040a4e50 0x7f040406daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0408c00640 1 -- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0404158a00 msgr2=0x7f04041ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0408c00640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0404158a00 0x7f04041ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0408c00640 1 -- 172.21.15.50:0/4273112796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec00b780 con 0x7f04040c4e00 2024-01-30T08:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0409600640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04040a4e50 0x7f040406daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-30T08:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0408c00640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040c4e00 0x7f04041e3750 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fd0 tx=0x7f03ec01b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0401600640 1 -- 172.21.15.50:0/4273112796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0a8c80 con 0x7f04040c4e00 2024-01-30T08:11:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0401600640 1 -- 172.21.15.50:0/4273112796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03ec0a8e00 con 0x7f04040c4e00 2024-01-30T08:11:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0401600640 1 -- 172.21.15.50:0/4273112796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec003880 con 0x7f04040c4e00 2024-01-30T08:11:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04041f0eb0 con 0x7f04040c4e00 2024-01-30T08:11:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04041ecd20 con 0x7f04040c4e00 2024-01-30T08:11:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040414efb0 con 0x7f04040c4e00 2024-01-30T08:11:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0401600640 1 -- 172.21.15.50:0/4273112796 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f03ec0039e0 con 0x7f04040c4e00 2024-01-30T08:11:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0401600640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f03dc066500 0x7f03dc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-30T08:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0401600640 1 -- 172.21.15.50:0/4273112796 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f03ec11e560 con 0x7f04040c4e00 2024-01-30T08:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.267+0000 7f0409600640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f03dc066500 0x7f03dc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-30T08:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.271+0000 7f0409600640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f03dc066500 0x7f03dc0689c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f03f4000f70 tx=0x7f03f4007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-30T08:11:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.271+0000 7f0401600640 1 -- 172.21.15.50:0/4273112796 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f03ec0eba00 con 0x7f04040c4e00 2024-01-30T08:11:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.463+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f040414efb0 con 0x7f04040c4e00 2024-01-30T08:11:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.463+0000 7f0401600640 1 -- 172.21.15.50:0/4273112796 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f03ec0ade90 con 0x7f04040c4e00 2024-01-30T08:11:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-01-30T08:11:16.469 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3353827677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3353827677},{"type":"v1","addr":"172.21.15.50:6833","nonce":3353827677}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4074620496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4074620496},{"type":"v1","addr":"172.21.15.125:6836","nonce":4074620496}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/3187725258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":3187725258},{"type":"v1","addr":"172.21.15.125:6837","nonce":3187725258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1118410887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1118410887},{"type":"v1","addr":"172.21.15.50:6835","nonce":1118410887}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2024-01-30T08:11:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2024-01-30T08:11:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f03dc066500 msgr2=0x7f03dc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f03dc066500 0x7f03dc0689c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f03f4000f70 tx=0x7f03f4007d70 comp rx=0 tx=0).stop 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040c4e00 msgr2=0x7f04041e3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040c4e00 0x7f04041e3750 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fd0 tx=0x7f03ec01b700 comp rx=0 tx=0).stop 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 shutdown_connections 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0404158a00 0x7f04041ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:6832/2956883845,v1:172.21.15.125:6833/2956883845] conn(0x7f03dc066500 0x7f03dc0689c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04040c4e00 0x7f04041e3750 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 --2- 172.21.15.50:0/4273112796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04040a4e50 0x7f040406daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-30T08:11:16.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 >> 172.21.15.50:0/4273112796 conn(0x7f04040c5b50 msgr2=0x7f04040bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-30T08:11:16.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 shutdown_connections 2024-01-30T08:11:16.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-01-30T08:11:16.467+0000 7f040c000640 1 -- 172.21.15.50:0/4273112796 wait complete. 2024-01-30T08:11:16.491 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-30T08:11:16.491 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-30T08:11:16.491 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-30T08:11:16.491 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.502 INFO:tasks.ceph.mds.a:Stopped 2024-01-30T08:11:16.503 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-30T08:11:16.503 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.556 INFO:tasks.ceph.mds.c:Stopped 2024-01-30T08:11:16.556 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-30T08:11:16.556 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.570 INFO:tasks.ceph.mds.b:Stopped 2024-01-30T08:11:16.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-30T08:11:16.570 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.624 INFO:tasks.ceph.mds.d:Stopped 2024-01-30T08:11:16.624 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-30T08:11:16.625 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-30T08:11:16.625 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.704 INFO:tasks.ceph.osd.0:Stopped 2024-01-30T08:11:16.704 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-30T08:11:16.705 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.800 INFO:tasks.ceph.osd.1:Stopped 2024-01-30T08:11:16.800 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-30T08:11:16.800 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-30T08:11:16.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-30T08:11:16.879 INFO:tasks.ceph.osd.2:Stopped 2024-01-30T08:11:16.880 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-30T08:11:16.880 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:16.961 INFO:tasks.ceph.osd.3:Stopped 2024-01-30T08:11:16.961 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-30T08:11:16.962 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:17.055 INFO:tasks.ceph.osd.4:Stopped 2024-01-30T08:11:17.056 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-30T08:11:17.056 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:20.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:11:20.261 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:11:22.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-30T08:11:22.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-01-30T08:11:22.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-01-30T08:11:23.158 INFO:tasks.ceph.osd.5:Stopped 2024-01-30T08:11:23.158 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-30T08:11:23.158 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:23.230 INFO:tasks.ceph.osd.6:Stopped 2024-01-30T08:11:23.230 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-30T08:11:23.230 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:23.318 INFO:tasks.ceph.osd.7:Stopped 2024-01-30T08:11:23.318 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-30T08:11:23.318 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-30T08:11:23.318 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:23.373 INFO:tasks.ceph.mgr.y:Stopped 2024-01-30T08:11:23.373 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-30T08:11:23.373 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:23.429 INFO:tasks.ceph.mgr.x:Stopped 2024-01-30T08:11:23.429 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-30T08:11:23.430 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-30T08:11:23.430 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:23.449 INFO:tasks.ceph.mon.a:Stopped 2024-01-30T08:11:23.449 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-30T08:11:23.449 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:23.464 INFO:tasks.ceph.mon.b:Stopped 2024-01-30T08:11:23.465 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-30T08:11:23.465 INFO:teuthology.orchestra.run:waiting for 300 2024-01-30T08:11:23.525 INFO:tasks.ceph.mon.c:Stopped 2024-01-30T08:11:23.526 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-30T08:11:23.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-30T08:11:23.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:11:23.556 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-30T08:11:23.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:11:23.835 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-30T08:11:24.055 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:11:24.055 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-30T08:11:24.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:11:24.199 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-30T08:11:24.341 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:11:24.341 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-30T08:11:24.546 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:11:24.547 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-30T08:11:24.743 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:11:24.743 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-30T08:11:24.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:11:24.926 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-30T08:11:25.092 INFO:tasks.ceph:Archiving mon data... 2024-01-30T08:11:25.093 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/data/mon.a.tgz 2024-01-30T08:11:25.093 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-01-30T08:11:25.103 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.y81viJYilB 2024-01-30T08:11:25.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.y81viJYilB 2024-01-30T08:11:25.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.y81viJYilB 2024-01-30T08:11:25.310 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.y81viJYilB is 334KB 2024-01-30T08:11:25.376 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.y81viJYilB 2024-01-30T08:11:25.385 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/data/mon.b.tgz 2024-01-30T08:11:25.385 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2024-01-30T08:11:25.393 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.dALuFMbAJj 2024-01-30T08:11:25.394 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dALuFMbAJj 2024-01-30T08:11:25.539 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.dALuFMbAJj 2024-01-30T08:11:25.614 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.dALuFMbAJj is 441KB 2024-01-30T08:11:25.680 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.dALuFMbAJj 2024-01-30T08:11:25.688 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/data/mon.c.tgz 2024-01-30T08:11:25.689 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2024-01-30T08:11:25.741 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.Y6Ry5rQk8U 2024-01-30T08:11:25.742 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Y6Ry5rQk8U 2024-01-30T08:11:25.885 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.Y6Ry5rQk8U 2024-01-30T08:11:25.962 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.Y6Ry5rQk8U is 441KB 2024-01-30T08:11:26.025 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.Y6Ry5rQk8U 2024-01-30T08:11:26.033 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-30T08:11:26.033 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-30T08:11:26.037 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-30T08:11:26.106 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-30T08:11:26.142 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-30T08:11:26.142 INFO:tasks.ceph:Archiving crash dumps... 2024-01-30T08:11:26.143 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/remote/smithi050/crash 2024-01-30T08:11:26.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-30T08:11:26.170 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/remote/smithi125/crash 2024-01-30T08:11:26.171 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-30T08:11:26.199 INFO:tasks.ceph:Shutting down logrotate 2024-01-30T08:11:26.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:11:26.220 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-30T08:11:26.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-30T08:11:26.343 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-30T08:11:26.361 INFO:tasks.ceph:Compressing logs... 2024-01-30T08:11:26.361 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-30T08:11:26.392 DEBUG:teuthology.orchestra.run.smithi125:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-30T08:11:26.418 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36023.log 2024-01-30T08:11:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35084.log 2024-01-30T08:11:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-01-30T08:11:26.420 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36023.log.gz 2024-01-30T08:11:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2024-01-30T08:11:26.421 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35084.log.gz 2024-01-30T08:11:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-01-30T08:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-01-30T08:11:26.424 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.36792.log 2024-01-30T08:11:26.424 INFO:teuthology.orchestra.run.smithi050.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2024-01-30T08:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34385.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-01-30T08:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2024-01-30T08:11:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.testuser.36792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.36792.log.gz 2024-01-30T08:11:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33800.log 2024-01-30T08:11:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27288.log 2024-01-30T08:11:26.427 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31230.log 2024-01-30T08:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38067.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-30T08:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz 2024-01-30T08:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37175.log 2024-01-30T08:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33800.log.gz 2024-01-30T08:11:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34619.log 2024-01-30T08:11:26.431 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27288.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-30T08:11:26.431 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27288.log.gz 2024-01-30T08:11:26.432 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.1.31230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31230.log.gz 2024-01-30T08:11:26.432 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-30T08:11:26.432 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27264.log 2024-01-30T08:11:26.432 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27192.log 2024-01-30T08:11:26.432 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27216.log 2024-01-30T08:11:26.433 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27264.log.gz 2024-01-30T08:11:26.438 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31428.log 2024-01-30T08:11:26.438 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27192.log.gz 2024-01-30T08:11:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27216.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27216.log.gz 2024-01-30T08:11:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-30T08:11:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.1.31428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31428.log.gz 2024-01-30T08:11:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31374.log 2024-01-30T08:11:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27240.log 2024-01-30T08:11:26.439 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.1.31374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31374.log.gz 2024-01-30T08:11:26.440 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27360.log 2024-01-30T08:11:26.440 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27240.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-30T08:11:26.446 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27240.log.gz 2024-01-30T08:11:26.446 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27360.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27360.log.gz 2024-01-30T08:11:26.446 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-30T08:11:26.446 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-30T08:11:26.446 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27336.log 2024-01-30T08:11:26.447 INFO:teuthology.orchestra.run.smithi125.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-30T08:11:26.447 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31433.log 2024-01-30T08:11:26.447 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27336.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-30T08:11:26.447 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27336.log.gz 2024-01-30T08:11:26.447 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.1.31433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31433.log.gz 2024-01-30T08:11:26.447 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27312.log 2024-01-30T08:11:26.449 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37175.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.37175.log.gz /var/log/ceph/ceph-client.admin.37123.log 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32290.log 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34619.log.gz 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37123.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37123.log.gz 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37305.log 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32290.log.gz 2024-01-30T08:11:26.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32481.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36679.log 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37305.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37305.log.gz -5 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36153.log 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36863.log 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36679.log.gz 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34120.log 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36153.log.gz 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36941.log 2024-01-30T08:11:26.451 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36863.log.gz 2024-01-30T08:11:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32067.log 2024-01-30T08:11:26.452 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34120.log.gz 2024-01-30T08:11:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31166.log 2024-01-30T08:11:26.452 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36941.log.gz 2024-01-30T08:11:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36549.log 2024-01-30T08:11:26.452 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32067.log.gz 2024-01-30T08:11:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31166.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31166.log.gz 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36915.log 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36549.log.gz 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34008.log 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33358.log 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36915.log.gz 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37937.log 2024-01-30T08:11:26.453 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34008.log.gz 2024-01-30T08:11:26.454 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34925.log 2024-01-30T08:11:26.454 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33358.log.gz 2024-01-30T08:11:26.454 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-01-30T08:11:26.454 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37937.log.gz 2024-01-30T08:11:26.455 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31248.log 2024-01-30T08:11:26.456 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.27312.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27312.log.gz 2024-01-30T08:11:26.456 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.1.31248.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-30T08:11:26.456 INFO:teuthology.orchestra.run.smithi125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31248.log.gz 2024-01-30T08:11:26.456 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-30T08:11:26.456 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-30T08:11:26.456 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-30T08:11:26.460 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34925.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34925.log.gz 2024-01-30T08:11:26.460 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30673.log 2024-01-30T08:11:26.460 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32990.log 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30673.log.gz 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34593.log 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34463.log 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32990.log.gz 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31008.log 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34593.log.gz 2024-01-30T08:11:26.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34463.log.gz 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31846.log 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31008.log.gz 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33488.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36627.log 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31846.log.gz 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32498.log 2024-01-30T08:11:26.462 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36627.log.gz 2024-01-30T08:11:26.463 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-30T08:11:26.464 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-30T08:11:26.464 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31369.log 2024-01-30T08:11:26.465 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32082.log 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32498.log.gz 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37402.log 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32082.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.32082.log.gz --verbose 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.26987.log 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31737.log 2024-01-30T08:11:26.466 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37402.log.gz 2024-01-30T08:11:26.468 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.31369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31369.log.gz 2024-01-30T08:11:26.469 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26987.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26987.log.gz 2024-01-30T08:11:26.469 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37454.log 2024-01-30T08:11:26.469 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38197.log 2024-01-30T08:11:26.469 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31737.log.gz 2024-01-30T08:11:26.469 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35110.log 2024-01-30T08:11:26.469 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37454.log.gz 2024-01-30T08:11:26.471 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 2024-01-30T08:11:26.471 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38197.log.gz 2024-01-30T08:11:26.471 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38403.log 2024-01-30T08:11:26.471 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2024-01-30T08:11:26.472 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35488.log 2024-01-30T08:11:26.472 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz 2024-01-30T08:11:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31820.log 2024-01-30T08:11:26.473 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38403.log.gz 2024-01-30T08:11:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35488.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35488.log.gz 2024-01-30T08:11:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30927.log 2024-01-30T08:11:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30982.log 2024-01-30T08:11:26.475 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31820.log.gz 2024-01-30T08:11:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30927.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30927.log.gz 2024-01-30T08:11:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37149.log 2024-01-30T08:11:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-01-30T08:11:26.477 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30982.log.gz 2024-01-30T08:11:26.478 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37149.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37149.log.gz 2024-01-30T08:11:26.478 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31088.log 2024-01-30T08:11:26.479 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34034.log 2024-01-30T08:11:26.480 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-01-30T08:11:26.481 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31088.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-30T08:11:26.481 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31088.log.gz 2024-01-30T08:11:26.481 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35226.log 2024-01-30T08:11:26.481 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34034.log.gz 2024-01-30T08:11:26.482 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32278.log 2024-01-30T08:11:26.483 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35226.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35226.log.gz 2024-01-30T08:11:26.483 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36575.log 2024-01-30T08:11:26.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2024-01-30T08:11:26.484 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32278.log.gz 2024-01-30T08:11:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36575.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36575.log.gz 2024-01-30T08:11:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37767.log 2024-01-30T08:11:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-01-30T08:11:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37532.log 2024-01-30T08:11:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37767.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37767.log.gz 2024-01-30T08:11:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34899.log 2024-01-30T08:11:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37532.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37532.log.gz 2024-01-30T08:11:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35164.log 2024-01-30T08:11:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34899.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34899.log.gz 2024-01-30T08:11:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35997.log 2024-01-30T08:11:26.490 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35164.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35164.log.gz 2024-01-30T08:11:26.490 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-01-30T08:11:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35997.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35997.log.gz -5 2024-01-30T08:11:26.491 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35384.log 2024-01-30T08:11:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37715.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-01-30T08:11:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32479.log 2024-01-30T08:11:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35384.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-30T08:11:26.494 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35384.log.gz 2024-01-30T08:11:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32479.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32479.log.gz 2024-01-30T08:11:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33332.log 2024-01-30T08:11:26.496 INFO:teuthology.orchestra.run.smithi125.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-30T08:11:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31872.log 2024-01-30T08:11:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33332.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33332.log.gz 2024-01-30T08:11:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37793.log 2024-01-30T08:11:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31872.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31872.log.gz 2024-01-30T08:11:26.499 INFO:teuthology.orchestra.run.smithi125.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-30T08:11:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35592.log 2024-01-30T08:11:26.500 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34750.log 2024-01-30T08:11:26.501 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35592.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37793.log.gz 2024-01-30T08:11:26.501 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35592.log.gz 2024-01-30T08:11:26.501 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38145.log 2024-01-30T08:11:26.502 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31528.log 2024-01-30T08:11:26.503 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34750.log.gz 2024-01-30T08:11:26.504 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35733.log 2024-01-30T08:11:26.504 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38145.log.gz 2024-01-30T08:11:26.505 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31528.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31528.log.gz 2024-01-30T08:11:26.505 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36967.log 2024-01-30T08:11:26.506 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32782.log 2024-01-30T08:11:26.507 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35733.log.gz 2024-01-30T08:11:26.508 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36967.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36967.log.gz 2024-01-30T08:11:26.508 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33312.log 2024-01-30T08:11:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32782.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32782.log.gz 2024-01-30T08:11:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31450.log 2024-01-30T08:11:26.510 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.33312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33181.log 2024-01-30T08:11:26.510 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33312.log.gz 2024-01-30T08:11:26.511 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31450.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31450.log.gz 2024-01-30T08:11:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35192.log 2024-01-30T08:11:26.512 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34671.log 2024-01-30T08:11:26.513 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35192.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33181.log.gz 2024-01-30T08:11:26.514 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35192.log.gz 2024-01-30T08:11:26.514 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30847.log 2024-01-30T08:11:26.515 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33120.log 2024-01-30T08:11:26.515 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34671.log.gz 2024-01-30T08:11:26.516 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30847.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.30847.log.gz 2024-01-30T08:11:26.516 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27098.log 2024-01-30T08:11:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32286.log 2024-01-30T08:11:26.518 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33120.log.gz 2024-01-30T08:11:26.519 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.27098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34307.log 2024-01-30T08:11:26.519 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27098.log.gz 2024-01-30T08:11:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32286.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32286.log.gz 2024-01-30T08:11:26.520 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36311.log 2024-01-30T08:11:26.521 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34307.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34307.log.gz 2024-01-30T08:11:26.522 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30815.log 2024-01-30T08:11:26.523 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34094.log 2024-01-30T08:11:26.523 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36311.log.gz 2024-01-30T08:11:26.524 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30815.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30815.log.gz 2024-01-30T08:11:26.524 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2024-01-30T08:11:26.526 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34094.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34094.log.gz 2024-01-30T08:11:26.526 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32074.log 2024-01-30T08:11:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32075.log 2024-01-30T08:11:26.527 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz 2024-01-30T08:11:26.528 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32074.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32074.log.gz 2024-01-30T08:11:26.528 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34437.log 2024-01-30T08:11:26.529 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34255.log 2024-01-30T08:11:26.530 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32075.log.gz 2024-01-30T08:11:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34437.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34437.log.gz 2024-01-30T08:11:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35785.log 2024-01-30T08:11:26.532 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-01-30T08:11:26.532 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34255.log.gz 2024-01-30T08:11:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35785.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35785.log.gz 2024-01-30T08:11:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32078.log 2024-01-30T08:11:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34698.log 2024-01-30T08:11:26.534 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-01-30T08:11:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31580.log 2024-01-30T08:11:26.536 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32078.log.gz 2024-01-30T08:11:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34698.log.gz 2024-01-30T08:11:26.537 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2024-01-30T08:11:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.36797.log 2024-01-30T08:11:26.538 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31580.log.gz 2024-01-30T08:11:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38353.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2024-01-30T08:11:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33540.log 2024-01-30T08:11:26.540 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.testuser.36797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.36797.log.gz 2024-01-30T08:11:26.541 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35759.log 2024-01-30T08:11:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33540.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22195.log 2024-01-30T08:11:26.542 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33540.log.gz 2024-01-30T08:11:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35759.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35759.log.gz 2024-01-30T08:11:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32028.log 2024-01-30T08:11:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.tmp-client.admin.22195.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22195.log.gz 2024-01-30T08:11:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37883.log 2024-01-30T08:11:26.546 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32028.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32028.log.gz 2024-01-30T08:11:26.547 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33384.log 2024-01-30T08:11:26.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37989.log 2024-01-30T08:11:26.549 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37883.log.gz 2024-01-30T08:11:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33384.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33384.log.gz 2024-01-30T08:11:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31476.log 2024-01-30T08:11:26.550 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37045.log 2024-01-30T08:11:26.551 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37989.log.gz 2024-01-30T08:11:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31502.log 2024-01-30T08:11:26.552 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31476.log.gz 2024-01-30T08:11:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37045.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37045.log.gz 2024-01-30T08:11:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37227.log 2024-01-30T08:11:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37253.log 2024-01-30T08:11:26.555 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31502.log.gz 2024-01-30T08:11:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37227.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37227.log.gz 2024-01-30T08:11:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2024-01-30T08:11:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37253.log.gz 2024-01-30T08:11:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34978.log 2024-01-30T08:11:26.558 INFO:teuthology.orchestra.run.smithi125.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-30T08:11:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-01-30T08:11:26.559 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2024-01-30T08:11:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37480.log 2024-01-30T08:11:26.560 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34978.log.gz 2024-01-30T08:11:26.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36837.log 2024-01-30T08:11:26.561 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-01-30T08:11:26.563 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36653.log 2024-01-30T08:11:26.563 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37480.log.gz 2024-01-30T08:11:26.563 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36837.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36837.log.gz 2024-01-30T08:11:26.564 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38327.log 2024-01-30T08:11:26.565 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37331.log 2024-01-30T08:11:26.566 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36653.log.gz 2024-01-30T08:11:26.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38327.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-30T08:11:26.567 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38327.log.gz 2024-01-30T08:11:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32756.log 2024-01-30T08:11:26.568 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37331.log.gz 2024-01-30T08:11:26.569 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30638.log 2024-01-30T08:11:26.571 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34645.log 2024-01-30T08:11:26.571 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32756.log.gz 2024-01-30T08:11:26.572 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31685.log 2024-01-30T08:11:26.572 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30638.log.gz 2024-01-30T08:11:26.573 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-01-30T08:11:26.573 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34645.log.gz 2024-01-30T08:11:26.575 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-01-30T08:11:26.575 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31685.log.gz 2024-01-30T08:11:26.576 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32284.log 2024-01-30T08:11:26.576 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-01-30T08:11:26.577 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33696.log 2024-01-30T08:11:26.578 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-01-30T08:11:26.579 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36363.log 2024-01-30T08:11:26.579 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32284.log.gz 2024-01-30T08:11:26.580 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37857.log 2024-01-30T08:11:26.580 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2024-01-30T08:11:26.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-01-30T08:11:26.582 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36363.log.gz 2024-01-30T08:11:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34333.log 2024-01-30T08:11:26.583 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37857.log.gz 2024-01-30T08:11:26.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-01-30T08:11:26.584 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-01-30T08:11:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34281.log 2024-01-30T08:11:26.586 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34333.log.gz 2024-01-30T08:11:26.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31554.log 2024-01-30T08:11:26.587 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-01-30T08:11:26.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35889.log 2024-01-30T08:11:26.588 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34281.log.gz 2024-01-30T08:11:26.589 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33904.log 2024-01-30T08:11:26.590 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-01-30T08:11:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35889.log.gz 2024-01-30T08:11:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37506.log 2024-01-30T08:11:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33068.log 2024-01-30T08:11:26.593 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33904.log.gz 2024-01-30T08:11:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31140.log 2024-01-30T08:11:26.594 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37506.log.gz 2024-01-30T08:11:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-01-30T08:11:26.595 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33068.log.gz 2024-01-30T08:11:26.596 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35540.log 2024-01-30T08:11:26.597 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31140.log.gz 2024-01-30T08:11:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33982.log 2024-01-30T08:11:26.598 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-01-30T08:11:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-01-30T08:11:26.599 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35540.log.gz 2024-01-30T08:11:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35056.log 2024-01-30T08:11:26.601 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33982.log.gz 2024-01-30T08:11:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32704.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-01-30T08:11:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-01-30T08:11:26.603 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35056.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-30T08:11:26.603 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35056.log.gz 2024-01-30T08:11:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30789.log 2024-01-30T08:11:26.605 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gz 2024-01-30T08:11:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35030.log 2024-01-30T08:11:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30955.log 2024-01-30T08:11:26.608 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30789.log.gz 2024-01-30T08:11:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35030.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35030.log.gz 2024-01-30T08:11:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2024-01-30T08:11:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30955.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30955.log.gz 2024-01-30T08:11:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37637.log 2024-01-30T08:11:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35863.log 2024-01-30T08:11:26.612 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2024-01-30T08:11:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34873.log 2024-01-30T08:11:26.614 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37637.log.gz 2024-01-30T08:11:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35863.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35863.log.gz 2024-01-30T08:11:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32938.log 2024-01-30T08:11:26.616 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34873.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34873.log.gz 2024-01-30T08:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35566.log 2024-01-30T08:11:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33436.log 2024-01-30T08:11:26.618 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32938.log.gz 2024-01-30T08:11:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35566.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35566.log.gz 2024-01-30T08:11:26.621 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33436.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33436.log.gz 2024-01-30T08:11:26.621 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2024-01-30T08:11:26.623 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37428.log 2024-01-30T08:11:26.624 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31607.log 2024-01-30T08:11:26.624 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2024-01-30T08:11:26.625 INFO:teuthology.orchestra.run.smithi125.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-30T08:11:26.625 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37428.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37428.log.gz -5 2024-01-30T08:11:26.626 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32002.log 2024-01-30T08:11:26.627 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31607.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31607.log.gz 2024-01-30T08:11:26.628 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33930.log 2024-01-30T08:11:26.628 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32002.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32002.log.gz 2024-01-30T08:11:26.629 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36993.log 2024-01-30T08:11:26.630 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33930.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33930.log.gz 2024-01-30T08:11:26.630 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31924.log 2024-01-30T08:11:26.631 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32270.log 2024-01-30T08:11:26.632 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36993.log.gz 2024-01-30T08:11:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31924.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31924.log.gz 2024-01-30T08:11:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36441.log 2024-01-30T08:11:26.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32270.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32270.log.gz 2024-01-30T08:11:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33852.log 2024-01-30T08:11:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32071.log 2024-01-30T08:11:26.636 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36441.log.gz 2024-01-30T08:11:26.638 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33852.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33852.log.gz 2024-01-30T08:11:26.639 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32071.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32071.log.gz 2024-01-30T08:11:26.639 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31036.log 2024-01-30T08:11:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36889.log 2024-01-30T08:11:26.642 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33878.log 2024-01-30T08:11:26.642 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31036.log.gz 2024-01-30T08:11:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36889.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36889.log.gz 2024-01-30T08:11:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33878.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33878.log.gz 2024-01-30T08:11:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33644.log 2024-01-30T08:11:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35514.log 2024-01-30T08:11:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-01-30T08:11:26.648 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33644.log.gz 2024-01-30T08:11:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36415.log 2024-01-30T08:11:26.649 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35514.log.gz 2024-01-30T08:11:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz 2024-01-30T08:11:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33566.log 2024-01-30T08:11:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36415.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36415.log.gz 2024-01-30T08:11:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37663.log 2024-01-30T08:11:26.654 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33566.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-30T08:11:26.654 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33566.log.gz 2024-01-30T08:11:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35004.log 2024-01-30T08:11:26.656 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37663.log.gz 2024-01-30T08:11:26.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30873.log 2024-01-30T08:11:26.658 INFO:teuthology.orchestra.run.smithi050.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-30T08:11:26.659 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35004.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35004.log.gz 2024-01-30T08:11:26.659 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37279.log 2024-01-30T08:11:26.660 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30873.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30873.log.gz 2024-01-30T08:11:26.660 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38301.log 2024-01-30T08:11:26.662 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31062.log 2024-01-30T08:11:26.662 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-01-30T08:11:26.663 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38301.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38301.log.gz 2024-01-30T08:11:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31062.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31062.log.gz 2024-01-30T08:11:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31396.log 2024-01-30T08:11:26.666 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36811.log 2024-01-30T08:11:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38429.log 2024-01-30T08:11:26.669 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36811.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36811.log.gz 2024-01-30T08:11:26.669 INFO:teuthology.orchestra.run.smithi050.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.31396.log.gz 2024-01-30T08:11:26.670 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 2024-01-30T08:11:26.671 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35410.log 2024-01-30T08:11:26.671 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38429.log.gz 2024-01-30T08:11:26.672 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37741.log 2024-01-30T08:11:26.673 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2024-01-30T08:11:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34198.log 2024-01-30T08:11:26.674 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35410.log.gz 2024-01-30T08:11:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30738.log 2024-01-30T08:11:26.675 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37741.log.gz 2024-01-30T08:11:26.677 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34198.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34198.log.gz 2024-01-30T08:11:26.677 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35278.log 2024-01-30T08:11:26.678 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30738.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30738.log.gz 2024-01-30T08:11:26.678 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37611.log 2024-01-30T08:11:26.680 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31659.log 2024-01-30T08:11:26.680 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35278.log.gz 2024-01-30T08:11:26.682 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37611.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37611.log.gz 2024-01-30T08:11:26.683 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31659.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31659.log.gz 2024-01-30T08:11:26.683 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35693.log 2024-01-30T08:11:26.684 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27206.log 2024-01-30T08:11:26.686 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.35693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35693.log.gz 2024-01-30T08:11:26.686 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35358.log 2024-01-30T08:11:26.687 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.27206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-01-30T08:11:26.688 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27206.log.gz 2024-01-30T08:11:26.689 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31192.log 2024-01-30T08:11:26.689 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35358.log.gz 2024-01-30T08:11:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35688.log 2024-01-30T08:11:26.690 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-01-30T08:11:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31192.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.31192.log.gz 2024-01-30T08:11:26.692 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33826.log 2024-01-30T08:11:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.35688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35688.log.gz 2024-01-30T08:11:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31633.log 2024-01-30T08:11:26.695 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2024-01-30T08:11:26.695 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33826.log.gz 2024-01-30T08:11:26.696 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34515.log 2024-01-30T08:11:26.697 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31633.log.gz 2024-01-30T08:11:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34068.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2024-01-30T08:11:26.698 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37559.log 2024-01-30T08:11:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33294.log 2024-01-30T08:11:26.699 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34515.log.gz 2024-01-30T08:11:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36493.log 2024-01-30T08:11:26.701 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37559.log.gz 2024-01-30T08:11:26.702 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.33294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33294.log.gz 2024-01-30T08:11:26.703 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36493.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36493.log.gz 2024-01-30T08:11:26.704 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33016.log 2024-01-30T08:11:26.705 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35917.log 2024-01-30T08:11:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35811.log 2024-01-30T08:11:26.707 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33016.log.gz 2024-01-30T08:11:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35917.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35917.log.gz 2024-01-30T08:11:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35811.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35811.log.gz 2024-01-30T08:11:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34808.log 2024-01-30T08:11:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34952.log 2024-01-30T08:11:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2024-01-30T08:11:26.712 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34808.log.gz 2024-01-30T08:11:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34952.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-30T08:11:26.714 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34952.log.gz 2024-01-30T08:11:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36179.log 2024-01-30T08:11:26.715 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz 2024-01-30T08:11:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-30T08:11:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36179.log: 88.8% 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-30T08:11:26.718 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36179.log.gz 2024-01-30T08:11:26.720 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-30T08:11:26.721 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32497.log 2024-01-30T08:11:26.722 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31114.log 2024-01-30T08:11:26.723 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35642.log 2024-01-30T08:11:26.724 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32497.log.gz 2024-01-30T08:11:26.725 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36205.log 2024-01-30T08:11:26.725 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31114.log.gz 2024-01-30T08:11:26.726 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35642.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35642.log.gz 2024-01-30T08:11:26.727 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34411.log 2024-01-30T08:11:26.728 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36205.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-30T08:11:26.728 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36205.log.gz 2024-01-30T08:11:26.730 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34411.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34411.log.gz 2024-01-30T08:11:26.730 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30899.log 2024-01-30T08:11:26.732 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33094.log 2024-01-30T08:11:26.733 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30899.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30899.log.gz 2024-01-30T08:11:26.734 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33094.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33094.log.gz 2024-01-30T08:11:26.735 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38041.log 2024-01-30T08:11:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37019.log 2024-01-30T08:11:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38041.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38041.log.gz 2024-01-30T08:11:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37019.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37019.log.gz 2024-01-30T08:11:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34229.log 2024-01-30T08:11:26.741 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38275.log 2024-01-30T08:11:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34229.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34229.log.gz 2024-01-30T08:11:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38275.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38275.log.gz 2024-01-30T08:11:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-01-30T08:11:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34567.log 2024-01-30T08:11:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36737.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-01-30T08:11:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34567.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34567.log.gz 2024-01-30T08:11:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36467.log 2024-01-30T08:11:26.750 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37909.log 2024-01-30T08:11:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36467.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36467.log.gz 2024-01-30T08:11:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34724.log 2024-01-30T08:11:26.754 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37909.log.gz 2024-01-30T08:11:26.755 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32860.log 2024-01-30T08:11:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34724.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-30T08:11:26.757 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34724.log.gz 2024-01-30T08:11:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32860.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32860.log.gz 2024-01-30T08:11:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37831.log 2024-01-30T08:11:26.759 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35971.log 2024-01-30T08:11:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36049.log 2024-01-30T08:11:26.761 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37831.log.gz 2024-01-30T08:11:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35971.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35971.log.gz 2024-01-30T08:11:26.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36049.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36049.log.gz 2024-01-30T08:11:26.764 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-01-30T08:11:26.765 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34776.log 2024-01-30T08:11:26.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31270.log 2024-01-30T08:11:26.767 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-01-30T08:11:26.768 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34776.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34776.log.gz 2024-01-30T08:11:26.770 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31270.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31270.log.gz 2024-01-30T08:11:26.770 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37376.log 2024-01-30T08:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35252.log 2024-01-30T08:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-01-30T08:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37376.log.gz 2024-01-30T08:11:26.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35252.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35252.log.gz 2024-01-30T08:11:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38015.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-01-30T08:11:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31218.log 2024-01-30T08:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32678.log 2024-01-30T08:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-01-30T08:11:26.780 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% 91.4% -- replaced with /var/log/ceph/ceph-client.admin.31218.log.gz 2024-01-30T08:11:26.780 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-30T08:11:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35945.log 2024-01-30T08:11:26.781 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32678.log.gz 2024-01-30T08:11:26.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35136.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz 2024-01-30T08:11:26.782 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32495.log 2024-01-30T08:11:26.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32886.log 2024-01-30T08:11:26.784 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35945.log.gz 2024-01-30T08:11:26.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32495.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32495.log.gz 2024-01-30T08:11:26.785 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32486.log 2024-01-30T08:11:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36101.log 2024-01-30T08:11:26.786 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32886.log.gz 2024-01-30T08:11:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32486.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32486.log.gz 2024-01-30T08:11:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-01-30T08:11:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36601.log 2024-01-30T08:11:26.788 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36101.log.gz 2024-01-30T08:11:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31711.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-01-30T08:11:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33956.log 2024-01-30T08:11:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36285.log 2024-01-30T08:11:26.791 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36601.log.gz 2024-01-30T08:11:26.792 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33956.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33956.log.gz 2024-01-30T08:11:26.792 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36519.log 2024-01-30T08:11:26.793 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37097.log 2024-01-30T08:11:26.794 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36285.log.gz 2024-01-30T08:11:26.795 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36519.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36519.log.gz 2024-01-30T08:11:26.795 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31950.log 2024-01-30T08:11:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2024-01-30T08:11:26.797 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-01-30T08:11:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31950.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31950.log.gz 2024-01-30T08:11:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-01-30T08:11:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37585.log 2024-01-30T08:11:26.799 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2024-01-30T08:11:26.800 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36127.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-01-30T08:11:26.800 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35707.log 2024-01-30T08:11:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36389.log 2024-01-30T08:11:26.802 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37585.log.gz 2024-01-30T08:11:26.803 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35707.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35707.log.gz 2024-01-30T08:11:26.803 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32834.log 2024-01-30T08:11:26.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37689.log 2024-01-30T08:11:26.805 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36389.log.gz 2024-01-30T08:11:26.805 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31976.log 2024-01-30T08:11:26.806 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32834.log.gz 2024-01-30T08:11:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37689.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37689.log.gz 2024-01-30T08:11:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32483.log 2024-01-30T08:11:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32063.log 2024-01-30T08:11:26.808 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31976.log.gz 2024-01-30T08:11:26.809 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32483.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32483.log.gz 2024-01-30T08:11:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32273.log 2024-01-30T08:11:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2024-01-30T08:11:26.811 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32063.log.gz 2024-01-30T08:11:26.812 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32730.log 2024-01-30T08:11:26.813 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32273.log.gz 2024-01-30T08:11:26.813 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38223.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2024-01-30T08:11:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37201.log 2024-01-30T08:11:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31768.log 2024-01-30T08:11:26.815 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32730.log.gz 2024-01-30T08:11:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37201.log.gz 2024-01-30T08:11:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38093.log 2024-01-30T08:11:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32470.log 2024-01-30T08:11:26.818 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31768.log.gz 2024-01-30T08:11:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38093.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38093.log.gz 2024-01-30T08:11:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2024-01-30T08:11:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32081.log 2024-01-30T08:11:26.821 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32470.log.gz 2024-01-30T08:11:26.821 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-01-30T08:11:26.822 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2024-01-30T08:11:26.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32081.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32081.log.gz 2024-01-30T08:11:26.823 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32274.log 2024-01-30T08:11:26.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31898.log 2024-01-30T08:11:26.825 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz/var/log/ceph/ceph-client.admin.32274.log: 2024-01-30T08:11:26.825 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32274.log.gz 2024-01-30T08:11:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34359.log 2024-01-30T08:11:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31898.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31898.log.gz 2024-01-30T08:11:26.827 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34541.log 2024-01-30T08:11:26.828 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34359.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34359.log.gz 2024-01-30T08:11:26.828 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36259.log 2024-01-30T08:11:26.829 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33042.log 2024-01-30T08:11:26.830 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34541.log.gz 2024-01-30T08:11:26.831 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32964.log 2024-01-30T08:11:26.831 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36259.log.gz 2024-01-30T08:11:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33042.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33042.log.gz 2024-01-30T08:11:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33410.log 2024-01-30T08:11:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33670.log 2024-01-30T08:11:26.834 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32964.log.gz 2024-01-30T08:11:26.835 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33410.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33410.log.gz 2024-01-30T08:11:26.836 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33670.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33670.log.gz 2024-01-30T08:11:27.135 INFO:teuthology.orchestra.run.smithi125.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-30T08:11:27.136 INFO:teuthology.orchestra.run.smithi125.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-30T08:11:27.137 INFO:teuthology.orchestra.run.smithi125.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-30T08:11:27.218 INFO:teuthology.orchestra.run.smithi125.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-30T08:11:27.220 INFO:teuthology.orchestra.run.smithi125.stderr: 2024-01-30T08:11:27.220 INFO:teuthology.orchestra.run.smithi125.stderr:real 0m0.812s 2024-01-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:user 0m3.043s 2024-01-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi125.stderr:sys 0m0.303s 2024-01-30T08:11:27.222 INFO:teuthology.orchestra.run.smithi050.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-30T08:11:27.285 INFO:teuthology.orchestra.run.smithi050.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-30T08:11:27.361 INFO:teuthology.orchestra.run.smithi050.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-30T08:11:27.394 INFO:teuthology.orchestra.run.smithi050.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-30T08:11:27.396 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-01-30T08:11:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m1.000s 2024-01-30T08:11:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m3.609s 2024-01-30T08:11:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.770s 2024-01-30T08:11:27.397 INFO:tasks.ceph:Archiving logs... 2024-01-30T08:11:27.398 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/remote/smithi050/log 2024-01-30T08:11:27.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-30T08:11:27.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-30T08:11:28.037 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/remote/smithi125/log 2024-01-30T08:11:28.038 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-30T08:11:28.452 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-30T08:11:28.468 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-30T08:11:28.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-30T08:11:28.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-30T08:11:28.545 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-30T08:11:28.553 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-30T08:11:28.554 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-30T08:11:28.557 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-30T08:11:28.570 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-01-30T08:11:28.570 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-01-30T08:11:28.570 INFO:teuthology.orchestra.run.smithi050.stdout:*hv01.front.sepi 44.4.53.2 2 u 57 64 77 0.120 -2.623 1.377 2024-01-30T08:11:28.570 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 77 0.104 -0.908 1.367 2024-01-30T08:11:28.570 INFO:teuthology.orchestra.run.smithi050.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 64 77 0.100 -0.266 1.356 2024-01-30T08:11:28.571 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:11:28.572 INFO:teuthology.orchestra.run.smithi125.stdout: remote refid st t when poll reach delay offset jitter 2024-01-30T08:11:28.572 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================== 2024-01-30T08:11:28.572 INFO:teuthology.orchestra.run.smithi125.stdout:*hv01.front.sepi 44.4.53.2 2 u 63 64 77 0.129 -0.782 2.205 2024-01-30T08:11:28.572 INFO:teuthology.orchestra.run.smithi125.stdout:+hv02.front.sepi 63.231.80.2 3 u 58 64 77 0.121 -1.223 1.276 2024-01-30T08:11:28.572 INFO:teuthology.orchestra.run.smithi125.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 77 0.099 +1.591 2.225 2024-01-30T08:11:28.573 INFO:teuthology.orchestra.run.smithi125.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-30T08:11:28.573 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-30T08:11:28.582 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-30T08:11:28.583 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-30T08:11:28.590 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-30T08:11:28.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-30T08:11:28.607 INFO:teuthology.task.internal:Duration was 846.363671 seconds 2024-01-30T08:11:28.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-30T08:11:28.616 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-30T08:11:28.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-30T08:11:28.620 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-30T08:11:28.711 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-30T08:11:28.711 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-01-30T08:11:28.711 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-30T08:11:28.733 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2024-01-30T08:11:28.733 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-30T08:11:28.754 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-30T08:11:28.755 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-30T08:11:28.784 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-30T08:11:28.838 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-30T08:11:28.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-30T08:11:28.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-30T08:11:28.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-30T08:11:28.959 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-30T08:11:29.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-30T08:11:29.036 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-30T08:11:29.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-30T08:11:29.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-30T08:11:29.084 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-30T08:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-01-30T08:11:29.115 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2024-01-30T08:11:29.133 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-30T08:11:29.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:11:29.172 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-30T08:11:29.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:11:29.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-30T08:11:29.199 INFO:teuthology.task.internal:Transferring archived files... 2024-01-30T08:11:29.200 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/remote/smithi050 2024-01-30T08:11:29.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-30T08:11:29.239 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527/remote/smithi125 2024-01-30T08:11:29.239 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-30T08:11:29.265 INFO:teuthology.task.internal:Removing archive directory... 2024-01-30T08:11:29.265 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-30T08:11:29.279 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-30T08:11:29.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-30T08:11:29.325 INFO:teuthology.task.internal:Not uploading archives. 2024-01-30T08:11:29.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-30T08:11:29.362 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-30T08:11:29.362 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-30T08:11:29.365 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-30T08:11:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: 658074 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 30 08:11 /home/ubuntu/cephtest 2024-01-30T08:11:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: 786433 4 d--------- 2 ubuntu ubuntu 4096 Jan 30 08:10 /home/ubuntu/cephtest/mnt.0 2024-01-30T08:11:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:find: '/home/ubuntu/cephtest/mnt.0': Permission denied 2024-01-30T08:11:29.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-30T08:11:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-01-30T08:11:29.373 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-30T08:11:29.381 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-30T08:11:29.463 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-30T08:11:29.478 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi050 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-30T08:11:29.478 INFO:teuthology.nuke:Checking targets against current locks 2024-01-30T08:11:29.485 INFO:teuthology.orchestra.run.smithi125.stdout: 658078 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 30 08:11 /home/ubuntu/cephtest 2024-01-30T08:11:29.509 DEBUG:teuthology.nuke:shortname: smithi050 2024-01-30T08:11:29.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-30T08:11:29.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-30 07:47:19.082437', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhcXTz47Q+zkZzTIXI2j0hmxu83s4Q995ZrafznMRDBN9wT/6b91rIdjaURyGLi/T//ffQ16Huu2EBCf5xKBRY='} 2024-01-30T08:11:29.535 DEBUG:teuthology.nuke:shortname: smithi125 2024-01-30T08:11:29.535 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-30T08:11:29.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-30 07:47:19.080985', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBISYSxzPJZxz2tLlA24jtu5bAFrYxWA3NZeD2gUlridovHbk4HybnS7vBAPs6U45ldUaxhJDNwBpxu2lt13Gv/g='} 2024-01-30T08:11:29.571 INFO:teuthology.orchestra.console.smithi050:Power off 2024-01-30T08:11:29.572 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-30T08:11:29.597 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2024-01-30T08:11:29.597 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T08:11:29.613 INFO:teuthology.orchestra.console.smithi125:Power off 2024-01-30T08:11:29.614 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-30T08:11:29.623 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-01-30T08:11:29.648 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-01-30T08:11:29.648 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T08:11:29.671 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-30T08:11:33.625 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T08:11:33.672 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T08:11:33.736 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-01-30T08:11:33.783 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-30T08:11:37.736 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T08:11:37.784 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T08:11:37.847 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-01-30T08:11:37.894 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-30T08:11:37.995 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-01-30T08:11:41.852 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T08:11:41.962 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-01-30T08:11:42.063 INFO:teuthology.orchestra.console.smithi050:Power off completed 2024-01-30T08:11:42.168 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda client.1-kernel-sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 846.3636705875397 failure_reason: 'Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=6451fd514ecb4e3985085520adbb7212 status: fail success: false 2024-01-30T08:11:42.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T08:11:42.255 INFO:teuthology.run:FAIL